2023-10-16T19:53:50.861 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T19:53:50.862 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} --name rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/orig.config.yaml 2023-10-16T19:53:50.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:53:50.996 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} email: null first_in_suite: false job_id: '7430097' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - client session with non-allowable root sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-qa2 sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-qa2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 19fd96fe3581520b6d9f50ffdabf29051aee5d4d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_sessionmap teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_18:49:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T19:53:50.996 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa; will attempt to use it 2023-10-16T19:53:50.997 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks 2023-10-16T19:53:50.997 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T19:53:50.999 INFO:teuthology.task.internal:Checking packages... 2023-10-16T19:53:51.028 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T19:53:51.028 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T19:53:51.028 INFO:teuthology.packaging:ref: None 2023-10-16T19:53:51.029 INFO:teuthology.packaging:tag: None 2023-10-16T19:53:51.029 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T19:53:51.029 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T19:53:51.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T19:53:51.272 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T19:53:51.272 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T19:53:51.278 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T19:53:51.278 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T19:53:51.321 INFO:teuthology.task.internal:Saving configuration 2023-10-16T19:53:51.338 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T19:53:51.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T19:53:51.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:48:15.947730', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:53:51.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:48:15.945828', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T19:53:51.393 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T19:53:51.399 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-16T19:53:51.400 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-16T19:53:51.400 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T19:53:51.497 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f34e992ea60>, signals=[15]) 2023-10-16T19:53:51.498 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T19:53:51.504 INFO:teuthology.task.internal:Opening connections... 2023-10-16T19:53:51.504 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T19:53:51.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:51.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T19:53:51.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:51.648 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T19:53:51.654 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-10-16T19:53:51.676 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-10-16T19:53:51.676 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-10-16T19:53:51.735 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:53:51.736 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:53:51.736 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-10-16T19:53:51.736 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-10-16T19:53:51.736 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-10-16T19:53:51.737 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:53:51.737 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:53:51.737 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-10-16T19:53:51.737 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:53:51.737 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:53:51.738 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:53:51.738 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:53:51.738 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T19:53:51.738 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:53:51.738 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:53:51.739 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:53:51.739 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:53:51.740 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-10-16T19:53:51.761 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-10-16T19:53:51.781 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-10-16T19:53:51.781 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-16T19:53:51.845 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:53:51.845 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:53:51.845 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-10-16T19:53:51.846 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-10-16T19:53:51.846 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6" 2023-10-16T19:53:51.846 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:53:51.846 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:53:51.846 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-10-16T19:53:51.847 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:53:51.847 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:53:51.847 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:53:51.848 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:53:51.848 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T19:53:51.848 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:53:51.848 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:53:51.849 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:53:51.849 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:53:51.849 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-16T19:53:51.869 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T19:53:51.880 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T19:53:51.913 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T19:53:51.913 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:53:51.916 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2023-10-16T19:53:51.935 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T19:53:51.941 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T19:53:51.941 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:53:51.979 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2023-10-16T19:53:52.015 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T19:53:52.067 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T19:53:52.081 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T19:53:52.083 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-16T19:53:52.083 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-16T19:53:52.083 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:53:52.084 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T19:53:52.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:53:52.104 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-10-16T19:53:52.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:53:52.105 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-10-16T19:53:52.165 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T19:53:52.165 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:53:52.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2023-10-16T19:53:52.167 INFO:teuthology.orchestra.run.smithi163.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-16T19:53:52.167 INFO:teuthology.task.kernel:Running kernel on smithi163: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:53:52.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2023-10-16T19:53:53.294 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-16T19:53:53.295 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-10-16T19:53:53.336 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T19:53:53.336 INFO:teuthology.orchestra.run.smithi152.stdout:Unable to read consumer identity 2023-10-16T19:53:54.806 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-16T19:53:54.810 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-16T19:53:56.561 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2023-10-16T19:53:56.623 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 16 MB 00:01 2023-10-16T19:54:00.174 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 676 kB/s | 24 kB 00:00 2023-10-16T19:54:00.231 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 129 kB/s | 24 kB 00:00 2023-10-16T19:54:00.868 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T19:54:00.923 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-10-16T19:54:00.924 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2023-10-16T19:54:00.925 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-10-16T19:54:00.947 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-16T19:54:01.018 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-10-16T19:54:01.019 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-10-16T19:54:01.019 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-10-16T19:54:01.058 DEBUG:teuthology.orchestra.run.smithi163:> echo no | sudo yum reinstall kernel || true 2023-10-16T19:54:01.150 DEBUG:teuthology.orchestra.run.smithi152:> echo no | sudo yum reinstall kernel || true 2023-10-16T19:54:01.391 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:01.392 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-10-16T19:54:01.480 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:01.480 INFO:teuthology.orchestra.run.smithi152.stdout:Unable to read consumer identity 2023-10-16T19:54:01.655 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Oct 2023 07:54:00 PM UTC. 2023-10-16T19:54:01.704 INFO:teuthology.orchestra.run.smithi163.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:54:01.743 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:01 ago on Mon 16 Oct 2023 07:54:00 PM UTC. 2023-10-16T19:54:01.745 INFO:teuthology.orchestra.run.smithi163.stderr:Error: No packages marked for reinstall. 2023-10-16T19:54:01.784 INFO:teuthology.orchestra.run.smithi152.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:54:01.792 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum reinstall -y kernel || true 2023-10-16T19:54:01.818 INFO:teuthology.orchestra.run.smithi152.stderr:Error: No packages marked for reinstall. 2023-10-16T19:54:01.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum reinstall -y kernel || true 2023-10-16T19:54:02.126 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:02.127 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-10-16T19:54:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T19:54:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:Unable to read consumer identity 2023-10-16T19:54:02.385 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 07:54:00 PM UTC. 2023-10-16T19:54:02.426 INFO:teuthology.orchestra.run.smithi163.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:54:02.454 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:02 ago on Mon 16 Oct 2023 07:54:00 PM UTC. 2023-10-16T19:54:02.464 INFO:teuthology.orchestra.run.smithi163.stderr:Error: No packages marked for reinstall. 2023-10-16T19:54:02.493 INFO:teuthology.orchestra.run.smithi152.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-16T19:54:02.510 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T19:54:02.516 INFO:teuthology.orchestra.run.smithi152.stderr:Error: No packages marked for reinstall. 2023-10-16T19:54:02.562 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2023-10-16T19:54:02.590 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T19:54:02.591 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:54:02.591 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T19:54:02.592 DEBUG:teuthology.parallel:result is None 2023-10-16T19:54:02.642 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-16T19:54:02.643 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-16T19:54:02.643 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-16T19:54:02.643 DEBUG:teuthology.parallel:result is None 2023-10-16T19:54:02.644 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T19:54:02.650 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T19:54:02.650 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:54:02.652 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T19:54:02.669 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T19:54:02.687 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T19:54:02.738 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T19:54:02.738 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:54:02.740 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T19:54:02.766 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T19:54:02.788 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T19:54:02.788 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:54:02.803 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T19:54:02.835 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:54:02.846 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:54:02.854 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:54:02.869 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T19:54:02.871 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T19:54:02.880 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T19:54:02.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:54:02.890 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T19:54:02.916 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T19:54:02.954 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T19:54:02.955 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:54:02.958 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T19:54:02.975 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:54:03.056 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:54:03.117 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:54:03.160 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:54:03.202 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T19:54:03.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:54:03.269 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:54:03.312 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T19:54:03.365 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:54:03.448 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T19:54:03.490 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T19:54:03.490 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T19:54:03.557 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-10-16T19:54:03.560 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2023-10-16T19:54:03.629 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:54:03.660 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T19:54:04.075 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T19:54:04.083 INFO:teuthology.task.internal:Starting timer... 2023-10-16T19:54:04.083 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T19:54:04.125 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T19:54:04.182 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-16T19:54:04.183 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2023-10-16T19:54:04.238 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2023-10-16T19:54:04.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2023-10-16T19:54:04.308 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2023-10-16T19:54:04.309 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T19:54:04.310 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2023-10-16T19:54:04.330 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2023-10-16T19:54:04.330 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2023-10-16T19:54:04.353 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2023-10-16T19:54:04.354 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive'} 2023-10-16T19:54:04.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:54:04.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:54:04.397 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T19:54:04.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T19:54:04.426 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T19:54:04.426 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:54:04.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2023-10-16T19:54:04.493 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T19:54:04.503 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T19:54:04.512 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T19:54:04.651 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T19:54:04.667 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T19:54:04.668 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T20:02:55.187 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2023-10-16T20:02:55.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-10-16T20:02:55.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T20:02:55.258 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-10-16T20:02:55.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-10-16T20:02:55.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-16T20:02:55.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T20:02:55.392 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-10-16T20:02:55.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-16T20:02:55.459 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T20:02:55.472 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T20:02:55.472 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T20:02:55.473 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T20:02:55.475 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T20:02:55.475 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T20:02:55.505 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T20:02:55.519 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T20:02:55.530 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T20:02:55.545 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T20:02:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2023-10-16T20:02:55.599 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2023-10-16T20:02:55.612 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2023-10-16T20:02:55.614 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T20:02:55.624 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2023-10-16T20:02:55.628 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T20:02:55.638 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T20:02:55.652 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T20:02:55.697 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-10-16T20:02:55.701 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T20:02:55.701 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-10-16T20:02:55.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-10-16T20:02:55.741 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T20:02:55.741 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-10-16T20:02:55.741 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.741 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.742 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.742 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:02:55.743 INFO:teuthology.run_tasks:Running task install... 2023-10-16T20:02:55.752 DEBUG:teuthology.task.install:project ceph 2023-10-16T20:02:55.753 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T20:02:55.753 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T20:02:55.753 INFO:teuthology.task.install:Using flavor: default 2023-10-16T20:02:55.762 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T20:02:55.762 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T20:02:55.763 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T20:02:55.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T20:02:55.765 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T20:02:55.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T20:02:55.923 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T20:02:55.924 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T20:02:56.031 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T20:02:56.032 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:02:56.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T20:02:56.058 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-16T20:02:56.058 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T20:02:56.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T20:02:56.063 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T20:02:56.131 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T20:02:56.163 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T20:02:56.163 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:02:56.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T20:02:56.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T20:02:56.192 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T20:02:56.207 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T20:02:56.260 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T20:02:56.273 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2023-10-16T20:02:56.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2023-10-16T20:02:56.336 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T20:02:56.402 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2023-10-16T20:02:56.404 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2023-10-16T20:02:56.648 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T20:02:56.775 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-16T20:02:56.899 INFO:teuthology.orchestra.run.smithi152.stdout:44 files removed 2023-10-16T20:02:56.947 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T20:02:57.008 INFO:teuthology.orchestra.run.smithi163.stdout:44 files removed 2023-10-16T20:02:57.054 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T20:02:57.277 INFO:teuthology.orchestra.run.smithi152.stdout:Updating Subscription Management repositories. 2023-10-16T20:02:57.387 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-10-16T20:02:58.168 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 151 kB/s | 81 kB 00:00 2023-10-16T20:02:58.169 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 190 kB/s | 81 kB 00:00 2023-10-16T20:02:58.419 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 43 kB/s | 9.4 kB 00:00 2023-10-16T20:02:58.553 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-10-16T20:02:58.762 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-10-16T20:02:58.987 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-16T20:02:59.012 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-10-16T20:02:59.221 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-16T20:03:01.232 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 16 MB 00:02 2023-10-16T20:03:04.113 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 3.3 MB/s | 16 MB 00:04 2023-10-16T20:03:04.738 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 400 kB/s | 24 kB 00:00 2023-10-16T20:03:05.666 INFO:teuthology.orchestra.run.smithi152.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-16T20:03:07.587 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 466 kB/s | 24 kB 00:00 2023-10-16T20:03:08.522 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-16T20:03:13.691 INFO:teuthology.orchestra.run.smithi152.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-10-16T20:03:16.590 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-10-16T20:03:24.948 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T20:03:24.949 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T20:03:24.963 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T20:03:24.964 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T20:03:24.965 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T20:03:24.967 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T20:03:24.969 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T20:03:24.972 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T20:03:24.973 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T20:03:25.102 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-10-16T20:03:25.114 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-10-16T20:03:25.115 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-10-16T20:03:25.115 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-10-16T20:03:25.115 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-10-16T20:03:25.115 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T20:03:25.115 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T20:03:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T20:03:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T20:03:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T20:03:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T20:03:25.116 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T20:03:25.117 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T20:03:25.117 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T20:03:25.117 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T20:03:25.117 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T20:03:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T20:03:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T20:03:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T20:03:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T20:03:25.118 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T20:03:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T20:03:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T20:03:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T20:03:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T20:03:25.119 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T20:03:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T20:03:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T20:03:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T20:03:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T20:03:25.120 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T20:03:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T20:03:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T20:03:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T20:03:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T20:03:25.121 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T20:03:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T20:03:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T20:03:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T20:03:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T20:03:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T20:03:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T20:03:25.123 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-10-16T20:03:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T20:03:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T20:03:25.123 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T20:03:25.124 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-10-16T20:03:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T20:03:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T20:03:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T20:03:25.124 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T20:03:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T20:03:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T20:03:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T20:03:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T20:03:25.125 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T20:03:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T20:03:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T20:03:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T20:03:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T20:03:25.126 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T20:03:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T20:03:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T20:03:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T20:03:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T20:03:25.127 INFO:teuthology.orchestra.run.smithi152.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T20:03:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T20:03:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T20:03:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T20:03:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T20:03:25.128 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T20:03:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T20:03:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T20:03:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T20:03:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T20:03:25.129 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T20:03:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T20:03:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T20:03:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T20:03:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T20:03:25.130 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T20:03:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T20:03:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T20:03:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T20:03:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T20:03:25.131 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T20:03:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T20:03:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T20:03:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T20:03:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T20:03:25.132 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T20:03:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T20:03:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T20:03:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T20:03:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T20:03:25.133 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T20:03:25.134 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T20:03:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T20:03:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T20:03:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T20:03:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T20:03:25.135 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T20:03:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T20:03:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T20:03:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T20:03:25.136 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T20:03:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T20:03:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T20:03:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T20:03:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T20:03:25.137 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T20:03:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T20:03:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T20:03:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T20:03:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T20:03:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T20:03:25.138 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T20:03:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T20:03:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T20:03:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T20:03:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T20:03:25.139 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T20:03:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T20:03:25.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T20:03:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T20:03:25.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T20:03:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T20:03:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T20:03:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T20:03:25.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T20:03:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T20:03:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T20:03:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T20:03:25.143 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T20:03:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T20:03:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T20:03:25.144 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T20:03:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T20:03:25.145 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-10-16T20:03:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql 10 2023-10-16T20:03:25.145 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:03:25.146 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-10-16T20:03:25.146 INFO:teuthology.orchestra.run.smithi152.stdout:=========================================================================================================================== 2023-10-16T20:03:25.146 INFO:teuthology.orchestra.run.smithi152.stdout:Install 128 Packages 2023-10-16T20:03:25.147 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 3 Packages 2023-10-16T20:03:25.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:03:25.147 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 209 M 2023-10-16T20:03:25.148 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-10-16T20:03:25.658 INFO:teuthology.orchestra.run.smithi152.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-16T20:03:26.908 INFO:teuthology.orchestra.run.smithi152.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 735 kB/s | 918 kB 00:01 2023-10-16T20:03:27.100 INFO:teuthology.orchestra.run.smithi152.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 872 kB/s | 167 kB 00:00 2023-10-16T20:03:27.471 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T20:03:27.472 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-16T20:03:27.486 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-16T20:03:27.487 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-16T20:03:27.488 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-16T20:03:27.489 INFO:teuthology.orchestra.run.smithi163.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-16T20:03:27.491 INFO:teuthology.orchestra.run.smithi163.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-16T20:03:27.494 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-16T20:03:27.495 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-16T20:03:27.630 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-10-16T20:03:27.642 INFO:teuthology.orchestra.run.smithi163.stdout:=========================================================================================================================== 2023-10-16T20:03:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2023-10-16T20:03:27.643 INFO:teuthology.orchestra.run.smithi163.stdout:=========================================================================================================================== 2023-10-16T20:03:27.643 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2023-10-16T20:03:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-16T20:03:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-16T20:03:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-16T20:03:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-16T20:03:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-16T20:03:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-16T20:03:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-16T20:03:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-16T20:03:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-16T20:03:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-16T20:03:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-16T20:03:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-16T20:03:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-16T20:03:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-16T20:03:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-16T20:03:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-16T20:03:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-16T20:03:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-16T20:03:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-16T20:03:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-16T20:03:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-16T20:03:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-16T20:03:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-16T20:03:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-16T20:03:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-16T20:03:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-16T20:03:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-16T20:03:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-16T20:03:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-16T20:03:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-16T20:03:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-16T20:03:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-16T20:03:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-16T20:03:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-16T20:03:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-16T20:03:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-16T20:03:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-16T20:03:27.650 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2023-10-16T20:03:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-16T20:03:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T20:03:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-16T20:03:27.651 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-10-16T20:03:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-16T20:03:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-16T20:03:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-16T20:03:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-16T20:03:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-16T20:03:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-16T20:03:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-16T20:03:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-16T20:03:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-16T20:03:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-16T20:03:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-16T20:03:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-16T20:03:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-16T20:03:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-16T20:03:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-16T20:03:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-16T20:03:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-16T20:03:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-16T20:03:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-16T20:03:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-16T20:03:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-16T20:03:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-16T20:03:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-16T20:03:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-16T20:03:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-16T20:03:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-16T20:03:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-16T20:03:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-16T20:03:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-16T20:03:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-16T20:03:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-16T20:03:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-16T20:03:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-16T20:03:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-16T20:03:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-16T20:03:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-16T20:03:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-16T20:03:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-16T20:03:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-16T20:03:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-16T20:03:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-16T20:03:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-16T20:03:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-16T20:03:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-16T20:03:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-16T20:03:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-16T20:03:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-16T20:03:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-16T20:03:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-16T20:03:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-16T20:03:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-16T20:03:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-16T20:03:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-16T20:03:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T20:03:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-16T20:03:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-16T20:03:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-16T20:03:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-16T20:03:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-16T20:03:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-16T20:03:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-16T20:03:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-16T20:03:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-16T20:03:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-16T20:03:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-16T20:03:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-16T20:03:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-16T20:03:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-16T20:03:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-16T20:03:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-16T20:03:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-16T20:03:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-16T20:03:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-16T20:03:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-16T20:03:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-16T20:03:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-16T20:03:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-16T20:03:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-16T20:03:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-16T20:03:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-16T20:03:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-16T20:03:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-16T20:03:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-16T20:03:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-16T20:03:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-16T20:03:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-16T20:03:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-16T20:03:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-16T20:03:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-16T20:03:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-16T20:03:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-16T20:03:27.669 INFO:teuthology.orchestra.run.smithi163.stdout:Enabling module streams: 2023-10-16T20:03:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql 10 2023-10-16T20:03:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:03:27.669 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-10-16T20:03:27.669 INFO:teuthology.orchestra.run.smithi163.stdout:=========================================================================================================================== 2023-10-16T20:03:27.670 INFO:teuthology.orchestra.run.smithi163.stdout:Install 128 Packages 2023-10-16T20:03:27.670 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 3 Packages 2023-10-16T20:03:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:03:27.670 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 209 M 2023-10-16T20:03:27.671 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-10-16T20:03:28.357 INFO:teuthology.orchestra.run.smithi163.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-10-16T20:03:28.492 INFO:teuthology.orchestra.run.smithi152.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 1.7 MB/s | 2.3 MB 00:01 2023-10-16T20:03:29.015 INFO:teuthology.orchestra.run.smithi163.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 918 kB 00:00 2023-10-16T20:03:29.141 INFO:teuthology.orchestra.run.smithi163.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 1.3 MB/s | 167 kB 00:00 2023-10-16T20:03:29.226 INFO:teuthology.orchestra.run.smithi152.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 2.2 MB/s | 1.6 MB 00:00 2023-10-16T20:03:30.041 INFO:teuthology.orchestra.run.smithi163.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-10-16T20:03:30.766 INFO:teuthology.orchestra.run.smithi163.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 2.2 MB/s | 1.6 MB 00:00 2023-10-16T20:03:31.585 INFO:teuthology.orchestra.run.smithi152.stdout:(6/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 2.0 MB/s | 4.6 MB 00:02 2023-10-16T20:03:31.791 INFO:teuthology.orchestra.run.smithi163.stdout:(6/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-10-16T20:03:32.343 INFO:teuthology.orchestra.run.smithi152.stdout:(7/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 787 kB/s | 5.4 MB 00:07 2023-10-16T20:03:32.650 INFO:teuthology.orchestra.run.smithi163.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 2.5 MB/s | 4.6 MB 00:01 2023-10-16T20:03:38.083 INFO:teuthology.orchestra.run.smithi163.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 2.6 MB/s | 14 MB 00:05 2023-10-16T20:03:38.166 INFO:teuthology.orchestra.run.smithi163.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 293 kB/s | 24 kB 00:00 2023-10-16T20:03:39.467 INFO:teuthology.orchestra.run.smithi163.stdout:(10/131): ceph-common-18.0.0-6730.g4ba8a190.el8 2.0 MB/s | 23 MB 00:11 2023-10-16T20:03:39.717 INFO:teuthology.orchestra.run.smithi163.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.0 MB/s | 261 kB 00:00 2023-10-16T20:03:39.817 INFO:teuthology.orchestra.run.smithi163.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 310 kB/s | 31 kB 00:00 2023-10-16T20:03:40.326 INFO:teuthology.orchestra.run.smithi163.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 1.6 MB/s | 839 kB 00:00 2023-10-16T20:03:40.509 INFO:teuthology.orchestra.run.smithi163.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.0 MB/s | 184 kB 00:00 2023-10-16T20:03:40.626 INFO:teuthology.orchestra.run.smithi163.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.2 MB/s | 139 kB 00:00 2023-10-16T20:03:40.934 INFO:teuthology.orchestra.run.smithi152.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 1.4 MB/s | 23 MB 00:15 2023-10-16T20:03:40.951 INFO:teuthology.orchestra.run.smithi163.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 1.6 MB/s | 518 kB 00:00 2023-10-16T20:03:41.042 INFO:teuthology.orchestra.run.smithi152.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 225 kB/s | 24 kB 00:00 2023-10-16T20:03:42.477 INFO:teuthology.orchestra.run.smithi163.stdout:(17/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 1.7 MB/s | 18 MB 00:10 2023-10-16T20:03:42.610 INFO:teuthology.orchestra.run.smithi163.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 337 kB/s | 45 kB 00:00 2023-10-16T20:03:42.852 INFO:teuthology.orchestra.run.smithi163.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 520 kB/s | 126 kB 00:00 2023-10-16T20:03:43.102 INFO:teuthology.orchestra.run.smithi163.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 788 kB/s | 197 kB 00:00 2023-10-16T20:03:43.427 INFO:teuthology.orchestra.run.smithi163.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.1 MB/s | 371 kB 00:00 2023-10-16T20:03:43.736 INFO:teuthology.orchestra.run.smithi163.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 1.2 MB/s | 365 kB 00:00 2023-10-16T20:03:43.870 INFO:teuthology.orchestra.run.smithi163.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 800 kB/s | 107 kB 00:00 2023-10-16T20:03:43.987 INFO:teuthology.orchestra.run.smithi163.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 803 kB/s | 94 kB 00:00 2023-10-16T20:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 1.4 MB/s | 18 MB 00:12 2023-10-16T20:03:44.809 INFO:teuthology.orchestra.run.smithi152.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 435 kB/s | 261 kB 00:00 2023-10-16T20:03:44.918 INFO:teuthology.orchestra.run.smithi152.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 286 kB/s | 31 kB 00:00 2023-10-16T20:03:45.335 INFO:teuthology.orchestra.run.smithi152.stdout:(13/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 1.1 MB/s | 14 MB 00:12 2023-10-16T20:03:45.495 INFO:teuthology.orchestra.run.smithi163.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 1.5 MB/s | 6.9 MB 00:04 2023-10-16T20:03:45.544 INFO:teuthology.orchestra.run.smithi152.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 883 kB/s | 184 kB 00:00 2023-10-16T20:03:45.729 INFO:teuthology.orchestra.run.smithi163.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 768 kB/s | 179 kB 00:00 2023-10-16T20:03:45.846 INFO:teuthology.orchestra.run.smithi163.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 198 kB/s | 23 kB 00:00 2023-10-16T20:03:45.961 INFO:teuthology.orchestra.run.smithi152.stdout:(15/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 805 kB/s | 839 kB 00:01 2023-10-16T20:03:45.963 INFO:teuthology.orchestra.run.smithi163.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.1 MB/s | 132 kB 00:00 2023-10-16T20:03:46.094 INFO:teuthology.orchestra.run.smithi152.stdout:(16/131): librados-devel-18.0.0-6730.g4ba8a190. 253 kB/s | 139 kB 00:00 2023-10-16T20:03:46.288 INFO:teuthology.orchestra.run.smithi163.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 1.6 MB/s | 3.6 MB 00:02 2023-10-16T20:03:46.619 INFO:teuthology.orchestra.run.smithi152.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 787 kB/s | 518 kB 00:00 2023-10-16T20:03:46.720 INFO:teuthology.orchestra.run.smithi152.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 446 kB/s | 45 kB 00:00 2023-10-16T20:03:46.887 INFO:teuthology.orchestra.run.smithi152.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 754 kB/s | 126 kB 00:00 2023-10-16T20:03:47.121 INFO:teuthology.orchestra.run.smithi152.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 845 kB/s | 197 kB 00:00 2023-10-16T20:03:47.180 INFO:teuthology.orchestra.run.smithi163.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 1.4 MB/s | 1.8 MB 00:01 2023-10-16T20:03:47.405 INFO:teuthology.orchestra.run.smithi163.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 1.1 MB/s | 242 kB 00:00 2023-10-16T20:03:47.505 INFO:teuthology.orchestra.run.smithi163.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 475 kB/s | 47 kB 00:00 2023-10-16T20:03:47.579 INFO:teuthology.orchestra.run.smithi152.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 809 kB/s | 371 kB 00:00 2023-10-16T20:03:47.614 INFO:teuthology.orchestra.run.smithi163.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 138 kB/s | 15 kB 00:00 2023-10-16T20:03:47.906 INFO:teuthology.orchestra.run.smithi163.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 896 kB/s | 261 kB 00:00 2023-10-16T20:03:48.004 INFO:teuthology.orchestra.run.smithi152.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 860 kB/s | 365 kB 00:00 2023-10-16T20:03:48.089 INFO:teuthology.orchestra.run.smithi163.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.0 MB/s | 192 kB 00:00 2023-10-16T20:03:48.180 INFO:teuthology.orchestra.run.smithi152.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 610 kB/s | 107 kB 00:00 2023-10-16T20:03:48.198 INFO:teuthology.orchestra.run.smithi163.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 167 kB/s | 18 kB 00:00 2023-10-16T20:03:48.355 INFO:teuthology.orchestra.run.smithi152.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 534 kB/s | 94 kB 00:00 2023-10-16T20:03:48.815 INFO:teuthology.orchestra.run.smithi163.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 497 kB/s | 306 kB 00:00 2023-10-16T20:03:48.940 INFO:teuthology.orchestra.run.smithi163.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-10-16T20:03:49.032 INFO:teuthology.orchestra.run.smithi163.stdout:(39/131): ceph-mgr-diskprediction-local-18.0.0- 2.7 MB/s | 7.4 MB 00:02 2023-10-16T20:03:49.058 INFO:teuthology.orchestra.run.smithi163.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2023-10-16T20:03:49.566 INFO:teuthology.orchestra.run.smithi163.stdout:(41/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 4.3 MB/s | 49 MB 00:11 2023-10-16T20:03:49.600 INFO:teuthology.orchestra.run.smithi163.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 80 kB/s | 44 kB 00:00 2023-10-16T20:03:49.725 INFO:teuthology.orchestra.run.smithi163.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-10-16T20:03:49.850 INFO:teuthology.orchestra.run.smithi163.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-16T20:03:49.993 INFO:teuthology.orchestra.run.smithi163.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-16T20:03:50.097 INFO:teuthology.orchestra.run.smithi152.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 1.7 MB/s | 6.9 MB 00:04 2023-10-16T20:03:50.234 INFO:teuthology.orchestra.run.smithi163.stdout:(46/131): python3-asyncssh-2.7.0-2.el8.noarch.r 396 kB/s | 476 kB 00:01 2023-10-16T20:03:50.260 INFO:teuthology.orchestra.run.smithi163.stdout:(47/131): python3-beautifulsoup4-4.6.3-2.el8.1. 269 kB/s | 185 kB 00:00 2023-10-16T20:03:50.281 INFO:teuthology.orchestra.run.smithi152.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 978 kB/s | 179 kB 00:00 2023-10-16T20:03:50.285 INFO:teuthology.orchestra.run.smithi163.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2023-10-16T20:03:50.360 INFO:teuthology.orchestra.run.smithi163.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 648 kB/s | 81 kB 00:00 2023-10-16T20:03:50.381 INFO:teuthology.orchestra.run.smithi152.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 231 kB/s | 23 kB 00:00 2023-10-16T20:03:50.402 INFO:teuthology.orchestra.run.smithi163.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-10-16T20:03:50.428 INFO:teuthology.orchestra.run.smithi163.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 123 kB/s | 18 kB 00:00 2023-10-16T20:03:50.536 INFO:teuthology.orchestra.run.smithi163.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 365 kB/s | 49 kB 00:00 2023-10-16T20:03:50.561 INFO:teuthology.orchestra.run.smithi163.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 440 kB/s | 59 kB 00:00 2023-10-16T20:03:50.653 INFO:teuthology.orchestra.run.smithi163.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-10-16T20:03:50.687 INFO:teuthology.orchestra.run.smithi163.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 3.6 MB/s | 1.2 MB 00:00 2023-10-16T20:03:50.712 INFO:teuthology.orchestra.run.smithi163.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-16T20:03:50.754 INFO:teuthology.orchestra.run.smithi163.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-10-16T20:03:50.788 INFO:teuthology.orchestra.run.smithi163.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 334 kB/s | 34 kB 00:00 2023-10-16T20:03:50.798 INFO:teuthology.orchestra.run.smithi152.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 317 kB/s | 132 kB 00:00 2023-10-16T20:03:50.830 INFO:teuthology.orchestra.run.smithi163.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-10-16T20:03:50.880 INFO:teuthology.orchestra.run.smithi163.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 511 kB/s | 64 kB 00:00 2023-10-16T20:03:50.905 INFO:teuthology.orchestra.run.smithi163.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-10-16T20:03:50.930 INFO:teuthology.orchestra.run.smithi163.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-16T20:03:50.980 INFO:teuthology.orchestra.run.smithi163.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2023-10-16T20:03:51.006 INFO:teuthology.orchestra.run.smithi163.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-16T20:03:51.056 INFO:teuthology.orchestra.run.smithi163.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-16T20:03:51.106 INFO:teuthology.orchestra.run.smithi163.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2023-10-16T20:03:51.157 INFO:teuthology.orchestra.run.smithi163.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 853 kB/s | 85 kB 00:00 2023-10-16T20:03:51.190 INFO:teuthology.orchestra.run.smithi163.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-10-16T20:03:51.215 INFO:teuthology.orchestra.run.smithi163.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-10-16T20:03:51.241 INFO:teuthology.orchestra.run.smithi163.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-16T20:03:51.299 INFO:teuthology.orchestra.run.smithi163.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-10-16T20:03:51.324 INFO:teuthology.orchestra.run.smithi163.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.5 MB/s | 200 kB 00:00 2023-10-16T20:03:51.367 INFO:teuthology.orchestra.run.smithi163.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 637 kB/s | 43 kB 00:00 2023-10-16T20:03:51.401 INFO:teuthology.orchestra.run.smithi163.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-10-16T20:03:51.426 INFO:teuthology.orchestra.run.smithi163.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 823 kB/s | 48 kB 00:00 2023-10-16T20:03:51.468 INFO:teuthology.orchestra.run.smithi163.stdout:(76/131): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-10-16T20:03:51.493 INFO:teuthology.orchestra.run.smithi163.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 638 kB/s | 43 kB 00:00 2023-10-16T20:03:51.518 INFO:teuthology.orchestra.run.smithi163.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 741 kB/s | 87 kB 00:00 2023-10-16T20:03:51.552 INFO:teuthology.orchestra.run.smithi163.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-10-16T20:03:51.577 INFO:teuthology.orchestra.run.smithi163.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.9 MB/s | 229 kB 00:00 2023-10-16T20:03:51.602 INFO:teuthology.orchestra.run.smithi163.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-10-16T20:03:51.628 INFO:teuthology.orchestra.run.smithi163.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-16T20:03:51.661 INFO:teuthology.orchestra.run.smithi163.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-10-16T20:03:51.678 INFO:teuthology.orchestra.run.smithi163.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-10-16T20:03:51.712 INFO:teuthology.orchestra.run.smithi163.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-10-16T20:03:51.715 INFO:teuthology.orchestra.run.smithi152.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 1.1 MB/s | 3.6 MB 00:03 2023-10-16T20:03:51.737 INFO:teuthology.orchestra.run.smithi163.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-16T20:03:51.771 INFO:teuthology.orchestra.run.smithi163.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-10-16T20:03:51.796 INFO:teuthology.orchestra.run.smithi163.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-10-16T20:03:51.813 INFO:teuthology.orchestra.run.smithi163.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-16T20:03:51.838 INFO:teuthology.orchestra.run.smithi163.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-10-16T20:03:51.863 INFO:teuthology.orchestra.run.smithi163.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-16T20:03:51.880 INFO:teuthology.orchestra.run.smithi163.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2023-10-16T20:03:51.882 INFO:teuthology.orchestra.run.smithi152.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 1.6 MB/s | 1.8 MB 00:01 2023-10-16T20:03:51.905 INFO:teuthology.orchestra.run.smithi163.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 926 kB/s | 39 kB 00:00 2023-10-16T20:03:51.956 INFO:teuthology.orchestra.run.smithi163.stdout:(94/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 9.5 MB/s | 2.3 MB 00:00 2023-10-16T20:03:51.981 INFO:teuthology.orchestra.run.smithi163.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.2 MB/s | 171 kB 00:00 2023-10-16T20:03:52.015 INFO:teuthology.orchestra.run.smithi163.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.7 MB/s | 644 kB 00:00 2023-10-16T20:03:52.048 INFO:teuthology.orchestra.run.smithi163.stdout:(97/131): NetworkManager-initscripts-updown-1.3 1.5 MB/s | 138 kB 00:00 2023-10-16T20:03:52.073 INFO:teuthology.orchestra.run.smithi163.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-16T20:03:52.099 INFO:teuthology.orchestra.run.smithi163.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-16T20:03:52.124 INFO:teuthology.orchestra.run.smithi163.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-16T20:03:52.158 INFO:teuthology.orchestra.run.smithi163.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-16T20:03:52.183 INFO:teuthology.orchestra.run.smithi152.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 808 kB/s | 242 kB 00:00 2023-10-16T20:03:52.183 INFO:teuthology.orchestra.run.smithi163.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-10-16T20:03:52.308 INFO:teuthology.orchestra.run.smithi152.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 381 kB/s | 47 kB 00:00 2023-10-16T20:03:52.308 INFO:teuthology.orchestra.run.smithi163.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2023-10-16T20:03:52.424 INFO:teuthology.orchestra.run.smithi152.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 129 kB/s | 15 kB 00:00 2023-10-16T20:03:52.593 INFO:teuthology.orchestra.run.smithi163.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 1.3 MB/s | 538 kB 00:00 2023-10-16T20:03:52.625 INFO:teuthology.orchestra.run.smithi152.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 1.3 MB/s | 261 kB 00:00 2023-10-16T20:03:52.634 INFO:teuthology.orchestra.run.smithi163.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 482 kB/s | 157 kB 00:00 2023-10-16T20:03:52.651 INFO:teuthology.orchestra.run.smithi163.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-16T20:03:52.710 INFO:teuthology.orchestra.run.smithi163.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-16T20:03:52.752 INFO:teuthology.orchestra.run.smithi163.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-10-16T20:03:52.802 INFO:teuthology.orchestra.run.smithi163.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-16T20:03:52.809 INFO:teuthology.orchestra.run.smithi152.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.0 MB/s | 192 kB 00:00 2023-10-16T20:03:52.886 INFO:teuthology.orchestra.run.smithi163.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-16T20:03:52.902 INFO:teuthology.orchestra.run.smithi163.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 439 kB/s | 44 kB 00:00 2023-10-16T20:03:52.909 INFO:teuthology.orchestra.run.smithi152.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 181 kB/s | 18 kB 00:00 2023-10-16T20:03:52.961 INFO:teuthology.orchestra.run.smithi163.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-16T20:03:53.045 INFO:teuthology.orchestra.run.smithi163.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 24 MB/s | 3.7 MB 00:00 2023-10-16T20:03:53.070 INFO:teuthology.orchestra.run.smithi163.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2023-10-16T20:03:53.087 INFO:teuthology.orchestra.run.smithi163.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-10-16T20:03:53.220 INFO:teuthology.orchestra.run.smithi163.stdout:(116/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-10-16T20:03:53.237 INFO:teuthology.orchestra.run.smithi163.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 133 kB/s | 20 kB 00:00 2023-10-16T20:03:53.271 INFO:teuthology.orchestra.run.smithi163.stdout:(118/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 630 kB/s | 126 kB 00:00 2023-10-16T20:03:53.284 INFO:teuthology.orchestra.run.smithi152.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 817 kB/s | 306 kB 00:00 2023-10-16T20:03:53.304 INFO:teuthology.orchestra.run.smithi163.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.2 MB/s | 103 kB 00:00 2023-10-16T20:03:53.338 INFO:teuthology.orchestra.run.smithi163.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-10-16T20:03:53.363 INFO:teuthology.orchestra.run.smithi163.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-16T20:03:53.368 INFO:teuthology.orchestra.run.smithi152.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 706 kB/s | 59 kB 00:00 2023-10-16T20:03:53.414 INFO:teuthology.orchestra.run.smithi163.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-10-16T20:03:53.443 INFO:teuthology.orchestra.run.smithi152.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-10-16T20:03:53.497 INFO:teuthology.orchestra.run.smithi163.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 21 MB/s | 4.9 MB 00:00 2023-10-16T20:03:53.531 INFO:teuthology.orchestra.run.smithi163.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-10-16T20:03:53.585 INFO:teuthology.orchestra.run.smithi152.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-10-16T20:03:53.597 INFO:teuthology.orchestra.run.smithi163.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-16T20:03:53.631 INFO:teuthology.orchestra.run.smithi163.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-10-16T20:03:53.661 INFO:teuthology.orchestra.run.smithi152.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 580 kB/s | 44 kB 00:00 2023-10-16T20:03:53.690 INFO:teuthology.orchestra.run.smithi163.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-10-16T20:03:53.774 INFO:teuthology.orchestra.run.smithi163.stdout:(128/131): postgresql-server-10.21-2.module+el8 18 MB/s | 5.1 MB 00:00 2023-10-16T20:03:53.803 INFO:teuthology.orchestra.run.smithi152.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-16T20:03:53.832 INFO:teuthology.orchestra.run.smithi163.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 14 MB/s | 798 kB 00:00 2023-10-16T20:03:53.878 INFO:teuthology.orchestra.run.smithi152.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 440 kB/s | 33 kB 00:00 2023-10-16T20:03:53.954 INFO:teuthology.orchestra.run.smithi152.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-10-16T20:03:54.037 INFO:teuthology.orchestra.run.smithi152.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-10-16T20:03:54.121 INFO:teuthology.orchestra.run.smithi152.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-10-16T20:03:54.204 INFO:teuthology.orchestra.run.smithi152.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 976 kB/s | 81 kB 00:00 2023-10-16T20:03:54.296 INFO:teuthology.orchestra.run.smithi152.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-10-16T20:03:54.380 INFO:teuthology.orchestra.run.smithi152.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 211 kB/s | 18 kB 00:00 2023-10-16T20:03:54.557 INFO:teuthology.orchestra.run.smithi163.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 4.0 MB/s | 3.7 MB 00:00 2023-10-16T20:03:54.572 INFO:teuthology.orchestra.run.smithi152.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-10-16T20:03:54.664 INFO:teuthology.orchestra.run.smithi152.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-10-16T20:03:54.756 INFO:teuthology.orchestra.run.smithi152.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 640 kB/s | 59 kB 00:00 2023-10-16T20:03:54.857 INFO:teuthology.orchestra.run.smithi152.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 602 kB/s | 60 kB 00:00 2023-10-16T20:03:54.965 INFO:teuthology.orchestra.run.smithi152.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-10-16T20:03:55.066 INFO:teuthology.orchestra.run.smithi152.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-10-16T20:03:55.133 INFO:teuthology.orchestra.run.smithi163.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.6 MB/s | 3.7 MB 00:01 2023-10-16T20:03:55.135 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-10-16T20:03:55.136 INFO:teuthology.orchestra.run.smithi163.stdout:Total 7.6 MB/s | 209 MB 00:27 2023-10-16T20:03:55.141 INFO:teuthology.orchestra.run.smithi152.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 449 kB/s | 34 kB 00:00 2023-10-16T20:03:55.233 INFO:teuthology.orchestra.run.smithi152.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2023-10-16T20:03:55.316 INFO:teuthology.orchestra.run.smithi152.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 773 kB/s | 64 kB 00:00 2023-10-16T20:03:55.401 INFO:teuthology.orchestra.run.smithi152.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-10-16T20:03:55.484 INFO:teuthology.orchestra.run.smithi152.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 287 kB/s | 24 kB 00:00 2023-10-16T20:03:55.568 INFO:teuthology.orchestra.run.smithi152.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 351 kB/s | 29 kB 00:00 2023-10-16T20:03:55.958 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-10-16T20:03:55.993 INFO:teuthology.orchestra.run.smithi152.stdout:(62/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 3.3 MB/s | 49 MB 00:14 2023-10-16T20:03:56.018 INFO:teuthology.orchestra.run.smithi152.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 61 kB/s | 27 kB 00:00 2023-10-16T20:03:56.079 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-10-16T20:03:56.079 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-10-16T20:03:56.127 INFO:teuthology.orchestra.run.smithi152.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-16T20:03:56.220 INFO:teuthology.orchestra.run.smithi152.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 668 kB/s | 61 kB 00:00 2023-10-16T20:03:56.328 INFO:teuthology.orchestra.run.smithi152.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 790 kB/s | 85 kB 00:00 2023-10-16T20:03:56.737 INFO:teuthology.orchestra.run.smithi152.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 56 kB/s | 23 kB 00:00 2023-10-16T20:03:56.795 INFO:teuthology.orchestra.run.smithi152.stdout:(68/131): python3-waitress-1.4.3-1.el8.noarch.r 319 kB/s | 255 kB 00:00 2023-10-16T20:03:56.821 INFO:teuthology.orchestra.run.smithi152.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-16T20:03:57.138 INFO:teuthology.orchestra.run.smithi152.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-10-16T20:03:57.179 INFO:teuthology.orchestra.run.smithi152.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 3.9 MB/s | 1.7 MB 00:00 2023-10-16T20:03:57.205 INFO:teuthology.orchestra.run.smithi152.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-16T20:03:57.211 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-10-16T20:03:57.215 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-10-16T20:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 809 kB/s | 54 kB 00:00 2023-10-16T20:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.1 MB/s | 259 kB 00:00 2023-10-16T20:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-16T20:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 922 kB/s | 39 kB 00:00 2023-10-16T20:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-10-16T20:03:57.382 INFO:teuthology.orchestra.run.smithi152.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-10-16T20:03:57.407 INFO:teuthology.orchestra.run.smithi152.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-16T20:03:57.432 INFO:teuthology.orchestra.run.smithi152.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-16T20:03:57.466 INFO:teuthology.orchestra.run.smithi152.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-16T20:03:57.500 INFO:teuthology.orchestra.run.smithi152.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 799 kB/s | 27 kB 00:00 2023-10-16T20:03:57.680 INFO:teuthology.orchestra.run.smithi152.stdout:(83/131): ceph-mgr-diskprediction-local-18.0.0- 1.2 MB/s | 7.4 MB 00:05 2023-10-16T20:03:57.717 INFO:teuthology.orchestra.run.smithi152.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2023-10-16T20:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 504 kB/s | 44 kB 00:00 2023-10-16T20:03:57.843 INFO:teuthology.orchestra.run.smithi152.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-10-16T20:03:57.876 INFO:teuthology.orchestra.run.smithi152.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-10-16T20:03:57.902 INFO:teuthology.orchestra.run.smithi152.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.7 MB/s | 225 kB 00:00 2023-10-16T20:03:57.927 INFO:teuthology.orchestra.run.smithi152.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-10-16T20:03:57.952 INFO:teuthology.orchestra.run.smithi152.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2023-10-16T20:03:57.978 INFO:teuthology.orchestra.run.smithi152.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-16T20:03:58.003 INFO:teuthology.orchestra.run.smithi152.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-16T20:03:58.037 INFO:teuthology.orchestra.run.smithi152.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-16T20:03:58.104 INFO:teuthology.orchestra.run.smithi152.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 9.8 MB/s | 3.7 MB 00:00 2023-10-16T20:03:58.129 INFO:teuthology.orchestra.run.smithi152.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-10-16T20:03:58.171 INFO:teuthology.orchestra.run.smithi152.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-16T20:03:58.213 INFO:teuthology.orchestra.run.smithi152.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-16T20:03:58.288 INFO:teuthology.orchestra.run.smithi152.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 17 MB/s | 4.9 MB 00:00 2023-10-16T20:03:58.372 INFO:teuthology.orchestra.run.smithi152.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-16T20:03:58.406 INFO:teuthology.orchestra.run.smithi152.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.7 MB/s | 808 kB 00:00 2023-10-16T20:03:58.448 INFO:teuthology.orchestra.run.smithi152.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-16T20:03:58.481 INFO:teuthology.orchestra.run.smithi152.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-10-16T20:03:58.506 INFO:teuthology.orchestra.run.smithi152.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.3 MB/s | 200 kB 00:00 2023-10-16T20:03:58.532 INFO:teuthology.orchestra.run.smithi152.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-10-16T20:03:58.557 INFO:teuthology.orchestra.run.smithi152.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-16T20:03:58.583 INFO:teuthology.orchestra.run.smithi152.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-10-16T20:03:58.608 INFO:teuthology.orchestra.run.smithi152.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-16T20:03:58.633 INFO:teuthology.orchestra.run.smithi152.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 848 kB/s | 43 kB 00:00 2023-10-16T20:03:58.658 INFO:teuthology.orchestra.run.smithi152.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-16T20:03:58.684 INFO:teuthology.orchestra.run.smithi152.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-10-16T20:03:58.717 INFO:teuthology.orchestra.run.smithi152.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-10-16T20:03:58.743 INFO:teuthology.orchestra.run.smithi152.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 317 kB/s | 19 kB 00:00 2023-10-16T20:03:58.810 INFO:teuthology.orchestra.run.smithi152.stdout:(113/131): postgresql-server-10.21-2.module+el8 8.5 MB/s | 5.1 MB 00:00 2023-10-16T20:03:58.835 INFO:teuthology.orchestra.run.smithi152.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.3 MB/s | 155 kB 00:00 2023-10-16T20:03:58.869 INFO:teuthology.orchestra.run.smithi152.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 303 kB/s | 18 kB 00:00 2023-10-16T20:03:58.930 INFO:teuthology.orchestra.run.smithi152.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 2.9 MB/s | 559 kB 00:00 2023-10-16T20:03:58.961 INFO:teuthology.orchestra.run.smithi152.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-16T20:03:58.987 INFO:teuthology.orchestra.run.smithi152.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2023-10-16T20:03:59.012 INFO:teuthology.orchestra.run.smithi152.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-16T20:03:59.037 INFO:teuthology.orchestra.run.smithi152.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-16T20:03:59.062 INFO:teuthology.orchestra.run.smithi152.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-16T20:03:59.088 INFO:teuthology.orchestra.run.smithi152.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-16T20:03:59.113 INFO:teuthology.orchestra.run.smithi152.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-16T20:03:59.138 INFO:teuthology.orchestra.run.smithi152.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 763 kB/s | 39 kB 00:00 2023-10-16T20:03:59.180 INFO:teuthology.orchestra.run.smithi152.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-10-16T20:03:59.206 INFO:teuthology.orchestra.run.smithi152.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-16T20:03:59.231 INFO:teuthology.orchestra.run.smithi152.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-16T20:03:59.290 INFO:teuthology.orchestra.run.smithi152.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.5 MB/s | 2.3 MB 00:00 2023-10-16T20:03:59.332 INFO:teuthology.orchestra.run.smithi152.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 19 MB/s | 798 kB 00:00 2023-10-16T20:04:00.724 INFO:teuthology.orchestra.run.smithi152.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.5 MB/s | 3.7 MB 00:01 2023-10-16T20:04:00.807 INFO:teuthology.orchestra.run.smithi152.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 2.3 MB/s | 3.7 MB 00:01 2023-10-16T20:04:00.810 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-10-16T20:04:00.810 INFO:teuthology.orchestra.run.smithi152.stdout:Total 5.8 MB/s | 209 MB 00:35 2023-10-16T20:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-10-16T20:04:01.773 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-10-16T20:04:01.773 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-10-16T20:04:02.207 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-10-16T20:04:02.387 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T20:04:02.570 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T20:04:02.748 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T20:04:02.859 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-16T20:04:02.902 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-10-16T20:04:02.906 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-10-16T20:04:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T20:04:03.466 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-16T20:04:03.681 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T20:04:04.092 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-16T20:04:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T20:04:04.430 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T20:04:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T20:04:04.715 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T20:04:04.871 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T20:04:05.064 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-16T20:04:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T20:04:05.508 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T20:04:05.891 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T20:04:06.130 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T20:04:06.297 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T20:04:06.408 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T20:04:06.589 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T20:04:06.739 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T20:04:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-16T20:04:07.094 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-16T20:04:07.271 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-16T20:04:07.396 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T20:04:07.527 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-16T20:04:07.672 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T20:04:07.754 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-10-16T20:04:07.932 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-16T20:04:08.122 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-16T20:04:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-16T20:04:08.324 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-16T20:04:08.455 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T20:04:08.492 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T20:04:08.623 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-16T20:04:08.817 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T20:04:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-16T20:04:09.221 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-16T20:04:09.238 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T20:04:09.442 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T20:04:09.854 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T20:04:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-16T20:04:10.058 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T20:04:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-16T20:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T20:04:10.360 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-16T20:04:10.367 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T20:04:10.465 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T20:04:10.589 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T20:04:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T20:04:10.761 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T20:04:10.890 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T20:04:10.937 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-16T20:04:11.150 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T20:04:11.161 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-16T20:04:11.379 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T20:04:11.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-16T20:04:11.799 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-16T20:04:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T20:04:12.083 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-16T20:04:12.267 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T20:04:12.353 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-16T20:04:12.483 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T20:04:12.629 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-16T20:04:12.783 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T20:04:13.142 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-16T20:04:13.402 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-16T20:04:13.583 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T20:04:14.143 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-16T20:04:14.178 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-16T20:04:14.366 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T20:04:14.460 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-16T20:04:14.723 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-16T20:04:14.963 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-16T20:04:15.058 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-16T20:04:15.183 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T20:04:15.314 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-16T20:04:15.364 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T20:04:15.534 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-16T20:04:15.543 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T20:04:15.735 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T20:04:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-16T20:04:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-16T20:04:15.980 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-16T20:04:16.014 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-16T20:04:16.188 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-16T20:04:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T20:04:16.254 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-16T20:04:16.409 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-16T20:04:16.475 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-16T20:04:16.589 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-16T20:04:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-16T20:04:16.718 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-16T20:04:16.845 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T20:04:16.923 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-16T20:04:17.141 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-16T20:04:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-16T20:04:17.495 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-16T20:04:17.604 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-16T20:04:17.646 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-16T20:04:17.831 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-16T20:04:17.905 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-16T20:04:17.956 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-16T20:04:18.157 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-16T20:04:18.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-16T20:04:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-16T20:04:18.452 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-16T20:04:18.657 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T20:04:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-16T20:04:18.988 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-16T20:04:19.189 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-16T20:04:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-16T20:04:19.633 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-16T20:04:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-16T20:04:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-16T20:04:20.370 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-16T20:04:20.426 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-16T20:04:20.600 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-16T20:04:20.742 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-16T20:04:20.774 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-16T20:04:20.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-16T20:04:20.956 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-16T20:04:21.168 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-16T20:04:21.251 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-16T20:04:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-16T20:04:21.500 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-16T20:04:21.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-16T20:04:21.677 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-16T20:04:21.732 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-16T20:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-16T20:04:22.012 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-16T20:04:22.051 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-16T20:04:22.177 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T20:04:22.219 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-16T20:04:22.347 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T20:04:22.447 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-16T20:04:22.612 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T20:04:22.663 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-16T20:04:22.817 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T20:04:22.973 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T20:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-16T20:04:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T20:04:23.276 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-16T20:04:23.310 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T20:04:23.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-16T20:04:23.496 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T20:04:23.695 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T20:04:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-16T20:04:23.846 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T20:04:23.977 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-16T20:04:23.983 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T20:04:24.204 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T20:04:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-16T20:04:24.430 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T20:04:24.556 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-16T20:04:24.633 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T20:04:24.744 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-16T20:04:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T20:04:24.978 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-16T20:04:25.160 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T20:04:25.177 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-16T20:04:25.325 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T20:04:25.343 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-16T20:04:25.537 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T20:04:25.646 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-16T20:04:25.920 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-16T20:04:26.160 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-16T20:04:26.404 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-16T20:04:26.580 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-16T20:04:26.614 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T20:04:26.741 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-16T20:04:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T20:04:26.931 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T20:04:27.025 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-16T20:04:27.102 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T20:04:27.246 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-16T20:04:27.388 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T20:04:27.459 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-16T20:04:27.648 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T20:04:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T20:04:27.729 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-16T20:04:27.894 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T20:04:27.936 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-16T20:04:28.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-16T20:04:28.294 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-16T20:04:28.770 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T20:04:28.803 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-16T20:04:28.943 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T20:04:29.012 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T20:04:29.104 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-16T20:04:29.177 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T20:04:29.338 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-16T20:04:29.485 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-16T20:04:29.659 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-16T20:04:29.866 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-16T20:04:30.077 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-16T20:04:30.284 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-16T20:04:30.434 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-16T20:04:30.586 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-16T20:04:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-16T20:04:31.059 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-16T20:04:31.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-16T20:04:31.512 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-16T20:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-16T20:04:31.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-16T20:04:32.180 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-16T20:04:32.878 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T20:04:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T20:04:33.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-16T20:04:33.542 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-16T20:04:33.650 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T20:04:33.762 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-16T20:04:34.097 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-16T20:04:34.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-16T20:04:34.628 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-16T20:04:34.702 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T20:04:34.784 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T20:04:34.917 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T20:04:35.446 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-16T20:04:35.613 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T20:04:35.691 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-16T20:04:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-16T20:04:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T20:04:39.796 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T20:04:40.400 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-16T20:04:40.696 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T20:04:40.781 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-16T20:04:40.920 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T20:04:53.712 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T20:04:53.712 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2023-10-16T20:04:53.713 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2023-10-16T20:04:53.713 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-10-16T20:04:53.713 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /run 2023-10-16T20:04:53.713 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2023-10-16T20:04:53.713 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2023-10-16T20:04:53.714 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2023-10-16T20:04:53.714 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2023-10-16T20:04:53.714 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-10-16T20:04:53.714 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:04:54.047 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T20:04:55.643 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T20:04:55.806 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T20:04:56.027 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T20:04:56.180 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T20:04:56.647 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T20:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T20:04:56.848 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T20:04:58.533 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T20:04:58.734 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T20:04:58.869 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T20:04:59.045 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T20:04:59.230 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T20:04:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T20:04:59.674 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-16T20:04:59.674 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2023-10-16T20:04:59.675 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2023-10-16T20:04:59.675 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-10-16T20:04:59.675 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2023-10-16T20:04:59.675 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2023-10-16T20:04:59.675 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2023-10-16T20:04:59.676 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2023-10-16T20:04:59.676 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2023-10-16T20:04:59.676 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-10-16T20:04:59.676 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:04:59.764 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T20:05:00.009 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T20:05:00.726 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T20:05:00.896 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T20:05:00.987 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T20:05:01.375 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T20:05:01.572 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T20:05:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-16T20:05:01.607 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T20:05:01.775 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T20:05:01.787 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T20:05:01.799 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T20:05:01.995 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-16T20:05:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T20:05:02.611 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-16T20:05:02.809 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T20:05:02.825 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-16T20:05:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T20:05:03.316 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T20:05:03.350 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T20:05:03.488 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T20:05:03.530 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T20:05:03.679 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T20:05:04.049 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T20:05:04.187 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T20:05:04.637 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T20:05:04.844 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-16T20:05:04.965 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-16T20:05:05.157 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-16T20:05:05.358 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T20:05:05.581 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-16T20:05:05.916 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T20:05:06.877 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-16T20:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T20:05:07.132 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-16T20:05:07.488 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-16T20:05:07.674 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T20:05:07.710 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-16T20:05:07.949 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T20:05:07.961 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-16T20:05:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T20:05:09.310 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-16T20:05:09.540 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T20:05:09.574 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-16T20:05:09.733 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T20:05:09.738 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T20:05:09.775 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-16T20:05:09.933 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T20:05:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-16T20:05:10.266 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-16T20:05:10.304 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-16T20:05:10.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T20:05:10.541 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-16T20:05:10.711 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T20:05:10.903 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-16T20:05:11.157 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-16T20:05:11.332 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T20:05:11.495 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T20:05:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T20:05:13.919 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T20:05:13.937 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T20:05:14.095 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T20:05:14.369 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T20:05:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T20:05:15.010 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T20:05:15.150 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-16T20:05:15.185 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T20:05:15.269 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-16T20:05:15.440 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-16T20:05:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T20:05:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-16T20:05:15.615 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T20:05:15.677 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T20:05:15.684 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-16T20:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-16T20:05:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-16T20:05:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T20:05:16.030 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T20:05:16.030 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T20:05:16.272 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T20:05:16.467 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T20:05:16.679 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-16T20:05:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T20:05:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T20:05:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T20:05:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T20:05:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T20:05:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T20:05:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T20:05:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T20:05:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T20:05:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T20:05:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T20:05:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T20:05:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T20:05:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T20:05:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T20:05:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T20:05:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T20:05:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T20:05:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T20:05:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T20:05:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T20:05:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T20:05:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T20:05:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T20:05:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T20:05:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T20:05:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T20:05:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T20:05:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T20:05:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T20:05:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T20:05:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T20:05:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T20:05:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T20:05:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T20:05:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T20:05:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T20:05:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T20:05:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T20:05:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T20:05:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T20:05:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T20:05:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T20:05:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T20:05:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T20:05:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T20:05:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T20:05:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T20:05:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T20:05:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T20:05:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T20:05:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T20:05:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T20:05:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T20:05:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T20:05:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T20:05:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T20:05:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T20:05:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T20:05:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T20:05:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T20:05:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T20:05:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T20:05:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T20:05:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T20:05:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T20:05:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T20:05:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T20:05:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T20:05:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T20:05:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T20:05:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T20:05:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-16T20:05:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-16T20:05:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-16T20:05:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-16T20:05:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-16T20:05:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-16T20:05:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-16T20:05:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-16T20:05:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-16T20:05:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-16T20:05:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-16T20:05:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-16T20:05:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-16T20:05:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-16T20:05:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-16T20:05:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-16T20:05:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-16T20:05:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-16T20:05:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-16T20:05:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-16T20:05:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-16T20:05:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-16T20:05:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-16T20:05:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-16T20:05:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-16T20:05:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-16T20:05:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-16T20:05:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-16T20:05:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-16T20:05:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-16T20:05:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-16T20:05:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-16T20:05:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-16T20:05:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-16T20:05:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-16T20:05:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-16T20:05:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-16T20:05:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-16T20:05:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-16T20:05:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-16T20:05:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-16T20:05:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-16T20:05:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-16T20:05:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-16T20:05:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T20:05:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T20:05:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T20:05:17.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-16T20:05:17.173 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-16T20:05:17.344 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T20:05:17.518 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-16T20:05:17.666 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T20:05:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T20:05:19.585 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:02:03 ago on Mon 16 Oct 2023 08:03:16 PM UTC. 2023-10-16T20:05:19.853 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T20:05:20.106 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T20:05:20.124 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-16T20:05:20.281 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-16T20:05:20.531 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-16T20:05:20.807 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-16T20:05:21.124 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-16T20:05:21.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T20:05:21.280 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T20:05:21.452 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-16T20:05:21.622 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T20:05:21.702 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-16T20:05:21.906 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T20:05:21.918 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-16T20:05:21.918 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T20:05:22.098 INFO:teuthology.orchestra.run.smithi163.stdout:Installed products updated. 2023-10-16T20:05:22.125 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T20:05:22.125 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T20:05:22.321 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:22.321 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2023-10-16T20:05:22.321 INFO:teuthology.orchestra.run.smithi163.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T20:05:22.322 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.322 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.322 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-10-16T20:05:22.322 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T20:05:22.322 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T20:05:22.323 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T20:05:22.323 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.323 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.323 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.323 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.324 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.324 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.324 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.324 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.324 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.324 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.325 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.325 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.325 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.325 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.325 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.326 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.326 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.326 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.326 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.326 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.327 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.327 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.327 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:22.327 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T20:05:22.327 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T20:05:22.328 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T20:05:22.328 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T20:05:22.328 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.6-3.el8.x86_64 2023-10-16T20:05:22.328 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T20:05:22.328 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T20:05:22.329 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T20:05:22.329 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.329 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.329 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.329 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T20:05:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T20:05:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T20:05:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T20:05:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T20:05:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T20:05:22.331 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.331 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.331 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T20:05:22.331 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.331 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T20:05:22.331 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T20:05:22.332 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T20:05:22.332 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T20:05:22.332 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T20:05:22.332 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T20:05:22.332 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T20:05:22.333 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T20:05:22.333 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T20:05:22.333 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T20:05:22.333 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T20:05:22.333 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T20:05:22.334 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T20:05:22.334 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T20:05:22.334 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T20:05:22.334 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T20:05:22.334 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T20:05:22.335 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T20:05:22.335 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T20:05:22.335 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T20:05:22.335 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T20:05:22.335 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T20:05:22.335 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.336 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.336 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.336 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T20:05:22.336 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T20:05:22.336 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T20:05:22.336 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T20:05:22.337 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T20:05:22.337 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T20:05:22.337 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T20:05:22.337 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T20:05:22.337 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T20:05:22.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T20:05:22.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T20:05:22.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T20:05:22.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T20:05:22.338 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T20:05:22.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T20:05:22.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T20:05:22.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T20:05:22.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T20:05:22.339 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T20:05:22.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T20:05:22.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T20:05:22.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T20:05:22.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T20:05:22.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T20:05:22.340 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T20:05:22.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T20:05:22.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T20:05:22.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T20:05:22.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T20:05:22.341 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T20:05:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T20:05:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T20:05:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T20:05:22.343 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T20:05:22.343 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T20:05:22.343 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T20:05:22.343 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T20:05:22.343 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T20:05:22.344 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T20:05:22.344 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T20:05:22.344 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T20:05:22.344 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T20:05:22.344 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T20:05:22.344 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T20:05:22.345 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.345 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.345 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:22.345 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T20:05:22.345 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T20:05:22.345 INFO:teuthology.orchestra.run.smithi163.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T20:05:22.346 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T20:05:22.346 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T20:05:22.346 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-16T20:05:22.347 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T20:05:22.347 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:22.347 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-10-16T20:05:22.546 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T20:05:22.572 DEBUG:teuthology.parallel:result is None 2023-10-16T20:05:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T20:05:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-16T20:05:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-16T20:05:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-16T20:05:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-16T20:05:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-16T20:05:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-16T20:05:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-16T20:05:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-16T20:05:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-16T20:05:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-16T20:05:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-16T20:05:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-16T20:05:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-16T20:05:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-16T20:05:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-16T20:05:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-16T20:05:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-16T20:05:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-16T20:05:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-16T20:05:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-16T20:05:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-16T20:05:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-16T20:05:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-16T20:05:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-16T20:05:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-16T20:05:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-16T20:05:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-16T20:05:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-16T20:05:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-16T20:05:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-16T20:05:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-16T20:05:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-16T20:05:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-16T20:05:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-16T20:05:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-16T20:05:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-16T20:05:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-16T20:05:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-16T20:05:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-16T20:05:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-16T20:05:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-16T20:05:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-16T20:05:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-16T20:05:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-16T20:05:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-16T20:05:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-16T20:05:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-16T20:05:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-16T20:05:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-16T20:05:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-16T20:05:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-16T20:05:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-16T20:05:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-16T20:05:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-16T20:05:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-16T20:05:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-16T20:05:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-16T20:05:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-16T20:05:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-16T20:05:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-16T20:05:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-16T20:05:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-16T20:05:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-16T20:05:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-16T20:05:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-16T20:05:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-16T20:05:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-16T20:05:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-16T20:05:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-16T20:05:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-16T20:05:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-16T20:05:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-16T20:05:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-16T20:05:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-16T20:05:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-16T20:05:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-16T20:05:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-16T20:05:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-16T20:05:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-16T20:05:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-16T20:05:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-16T20:05:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-16T20:05:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-16T20:05:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-16T20:05:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-16T20:05:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-16T20:05:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-16T20:05:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-16T20:05:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-16T20:05:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-16T20:05:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-16T20:05:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-16T20:05:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-16T20:05:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-16T20:05:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-16T20:05:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-16T20:05:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-16T20:05:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-16T20:05:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-16T20:05:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-16T20:05:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-16T20:05:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-16T20:05:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-16T20:05:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-16T20:05:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-16T20:05:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-16T20:05:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-16T20:05:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-16T20:05:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-16T20:05:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-16T20:05:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-16T20:05:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-16T20:05:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-16T20:05:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-16T20:05:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-16T20:05:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-16T20:05:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-16T20:05:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-16T20:05:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-16T20:05:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-16T20:05:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-16T20:05:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-16T20:05:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-16T20:05:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-16T20:05:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-16T20:05:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-16T20:05:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-16T20:05:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-16T20:05:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-16T20:05:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-16T20:05:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-16T20:05:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-16T20:05:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-16T20:05:25.755 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-16T20:05:25.756 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Oct 2023 08:03:13 PM UTC. 2023-10-16T20:05:28.371 INFO:teuthology.orchestra.run.smithi152.stdout:Installed products updated. 2023-10-16T20:05:28.594 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-10-16T20:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-16T20:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-10-16T20:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-16T20:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.1-7.el8.noarch 2023-10-16T20:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.0.4-10.el8.x86_64 2023-10-16T20:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-16T20:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-16T20:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.1-9.el8.x86_64 2023-10-16T20:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-16T20:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-16T20:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-3.el8.x86_64 2023-10-16T20:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-16T20:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-16T20:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-16T20:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-16T20:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-16T20:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-16T20:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: libpq-13.5-1.el8.x86_64 2023-10-16T20:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-16T20:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-16T20:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-16T20:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-16T20:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-16T20:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-16T20:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-16T20:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-16T20:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-16T20:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-16T20:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-16T20:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-16T20:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-16T20:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-16T20:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-16T20:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-16T20:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-16T20:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T20:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T20:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-16T20:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-16T20:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-16T20:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-16T20:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-16T20:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-16T20:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-16T20:05:28.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-16T20:05:28.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-16T20:05:28.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-16T20:05:28.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-16T20:05:28.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-16T20:05:28.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-16T20:05:28.727 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-16T20:05:28.727 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-16T20:05:28.727 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-16T20:05:28.727 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-16T20:05:28.728 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-16T20:05:28.728 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-16T20:05:28.728 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-16T20:05:28.728 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-16T20:05:28.728 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-16T20:05:28.729 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-16T20:05:28.729 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-16T20:05:28.729 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-16T20:05:28.729 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-16T20:05:28.729 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-16T20:05:28.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-16T20:05:28.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2023-10-16T20:05:28.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-16T20:05:28.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-16T20:05:28.730 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-16T20:05:28.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-16T20:05:28.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-16T20:05:28.731 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-16T20:05:28.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.732 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-16T20:05:28.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-16T20:05:28.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.733 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-16T20:05:28.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-16T20:05:28.734 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-16T20:05:28.735 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-16T20:05:28.735 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-16T20:05:28.735 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-16T20:05:28.736 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-16T20:05:28.736 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-16T20:05:28.736 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-16T20:05:28.737 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-16T20:05:28.737 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-16T20:05:28.737 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-16T20:05:28.737 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-16T20:05:28.738 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.738 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.739 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-16T20:05:28.739 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-16T20:05:28.739 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-16T20:05:28.739 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-16T20:05:28.739 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-16T20:05:28.740 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-16T20:05:28.740 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-16T20:05:28.740 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:28.741 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-10-16T20:05:28.781 DEBUG:teuthology.parallel:result is None 2023-10-16T20:05:28.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T20:05:28.926 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T20:05:28.950 INFO:teuthology.orchestra.run.smithi152.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T20:05:28.951 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T20:05:28.951 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T20:05:28.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T20:05:29.238 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T20:05:29.266 INFO:teuthology.orchestra.run.smithi163.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-16T20:05:29.266 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-16T20:05:29.267 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T20:05:29.267 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T20:05:29.268 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:29.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T20:05:29.310 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:29.311 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T20:05:29.357 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T20:05:29.357 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:29.358 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T20:05:29.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T20:05:29.455 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:29.456 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T20:05:29.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T20:05:29.554 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T20:05:29.555 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:29.555 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T20:05:29.583 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T20:05:29.649 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:29.650 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T20:05:29.677 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T20:05:29.745 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T20:05:29.745 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:29.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T20:05:29.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T20:05:29.840 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:29.841 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T20:05:29.868 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T20:05:29.934 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T20:05:29.998 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T20:05:29.999 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2023-10-16T20:05:30.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2023-10-16T20:05:30.028 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T20:05:30.028 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T20:05:30.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T20:05:30.094 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T20:05:30.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T20:05:30.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T20:05:30.167 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T20:05:30.167 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T20:05:30.168 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T20:05:30.168 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:30.168 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T20:05:30.215 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:30.368 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:30.395 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:30.395 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T20:05:30.413 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:30.567 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T20:05:30.600 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T20:05:30.601 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T20:05:30.601 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}', 'email': None, 'first_in_suite': False, 'job_id': '7430097', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-qa2', 'sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-qa2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '19fd96fe3581520b6d9f50ffdabf29051aee5d4d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'client session with non-allowable root'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_sessionmap']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_18:49:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T20:05:30.602 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T20:05:30.604 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T20:05:30.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T20:05:30.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T20:05:30.717 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:30.718 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T20:05:30.743 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T20:05:30.743 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-10-16T20:05:30.799 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T20:05:30.800 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:30.800 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 391716 Links: 1 2023-10-16T20:05:30.800 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:30.800 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:30.801 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 20:05:22.742216650 +0000 2023-10-16T20:05:30.801 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 20:02:26.435181697 +0000 2023-10-16T20:05:30.801 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 20:02:26.435181697 +0000 2023-10-16T20:05:30.801 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T20:05:30.802 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T20:05:30.864 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T20:05:30.864 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T20:05:30.864 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000328479 s, 1.6 MB/s 2023-10-16T20:05:30.866 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T20:05:30.923 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-10-16T20:05:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T20:05:30.980 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:30.980 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 387060 Links: 1 2023-10-16T20:05:30.981 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:30.981 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:30.981 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 20:05:22.742216650 +0000 2023-10-16T20:05:30.981 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 20:02:26.940175791 +0000 2023-10-16T20:05:30.981 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 20:02:26.940175791 +0000 2023-10-16T20:05:30.982 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T20:05:30.982 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T20:05:31.045 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T20:05:31.046 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T20:05:31.046 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000211739 s, 2.4 MB/s 2023-10-16T20:05:31.047 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T20:05:31.105 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-10-16T20:05:31.162 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T20:05:31.163 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:31.163 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 392428 Links: 1 2023-10-16T20:05:31.163 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:31.163 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:31.163 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 20:05:22.742216650 +0000 2023-10-16T20:05:31.164 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 20:02:27.447169862 +0000 2023-10-16T20:05:31.164 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 20:02:27.447169862 +0000 2023-10-16T20:05:31.164 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T20:05:31.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T20:05:31.227 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T20:05:31.228 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T20:05:31.228 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000205579 s, 2.5 MB/s 2023-10-16T20:05:31.229 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T20:05:31.286 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-10-16T20:05:31.343 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T20:05:31.344 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 394429 Links: 1 2023-10-16T20:05:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-10-16 20:05:22.742216650 +0000 2023-10-16T20:05:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-10-16 20:02:27.935164155 +0000 2023-10-16T20:05:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-10-16 20:02:27.935164155 +0000 2023-10-16T20:05:31.345 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-10-16T20:05:31.345 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T20:05:31.408 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-10-16T20:05:31.409 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-10-16T20:05:31.409 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000194277 s, 2.6 MB/s 2023-10-16T20:05:31.410 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T20:05:31.468 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:31.468 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:31.468 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T20:05:31.489 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T20:05:31.489 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2023-10-16T20:05:31.549 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T20:05:31.550 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:31.550 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 394351 Links: 1 2023-10-16T20:05:31.550 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:31.550 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:31.550 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-16 20:05:16.667690532 +0000 2023-10-16T20:05:31.551 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-16 20:02:26.459820961 +0000 2023-10-16T20:05:31.551 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-16 20:02:26.459820961 +0000 2023-10-16T20:05:31.551 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-16T20:05:31.551 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T20:05:31.619 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-16T20:05:31.620 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-16T20:05:31.620 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000287357 s, 1.8 MB/s 2023-10-16T20:05:31.621 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T20:05:31.681 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2023-10-16T20:05:31.740 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T20:05:31.740 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:31.740 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 391428 Links: 1 2023-10-16T20:05:31.740 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:31.741 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:31.741 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-16 20:05:16.667690532 +0000 2023-10-16T20:05:31.741 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-16 20:02:26.977809107 +0000 2023-10-16T20:05:31.741 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-16 20:02:26.977809107 +0000 2023-10-16T20:05:31.741 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-16T20:05:31.742 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T20:05:31.808 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-16T20:05:31.808 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-16T20:05:31.809 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000239324 s, 2.1 MB/s 2023-10-16T20:05:31.810 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T20:05:31.869 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2023-10-16T20:05:31.927 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T20:05:31.927 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:31.928 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 393565 Links: 1 2023-10-16T20:05:31.928 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:31.928 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:31.928 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-16 20:05:16.667690532 +0000 2023-10-16T20:05:31.928 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-16 20:02:27.470797825 +0000 2023-10-16T20:05:31.929 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-16 20:02:27.470797825 +0000 2023-10-16T20:05:31.929 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-16T20:05:31.929 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T20:05:31.993 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-16T20:05:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-16T20:05:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000250594 s, 2.0 MB/s 2023-10-16T20:05:31.995 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T20:05:32.054 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2023-10-16T20:05:32.111 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T20:05:32.112 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T20:05:32.112 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 393615 Links: 1 2023-10-16T20:05:32.112 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T20:05:32.112 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T20:05:32.112 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-10-16 20:05:16.667690532 +0000 2023-10-16T20:05:32.113 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-10-16 20:02:27.984786065 +0000 2023-10-16T20:05:32.113 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-10-16 20:02:27.984786065 +0000 2023-10-16T20:05:32.113 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-10-16T20:05:32.113 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T20:05:32.178 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-10-16T20:05:32.178 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-10-16T20:05:32.178 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000241479 s, 2.1 MB/s 2023-10-16T20:05:32.180 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T20:05:32.238 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:32.239 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T20:05:32.239 INFO:tasks.ceph:Generating config... 2023-10-16T20:05:32.240 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T20:05:32.241 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T20:05:32.241 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T20:05:32.241 INFO:tasks.ceph:[client] pid file = 2023-10-16T20:05:32.241 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T20:05:32.242 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T20:05:32.242 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-16T20:05:32.242 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T20:05:32.242 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T20:05:32.243 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T20:05:32.243 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T20:05:32.243 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T20:05:32.243 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T20:05:32.244 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T20:05:32.244 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T20:05:32.244 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T20:05:32.244 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T20:05:32.245 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T20:05:32.245 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T20:05:32.245 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T20:05:32.245 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T20:05:32.246 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T20:05:32.246 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T20:05:32.246 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T20:05:32.246 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T20:05:32.247 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-16T20:05:32.247 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-16T20:05:32.247 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T20:05:32.247 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T20:05:32.248 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-16T20:05:32.248 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T20:05:32.248 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T20:05:32.248 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T20:05:32.249 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T20:05:32.249 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T20:05:32.249 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T20:05:32.249 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T20:05:32.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T20:05:32.309 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T20:05:32.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T20:05:32.360 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T20:05:32.387 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.152'), ('mon.b', '172.21.15.163'), ('mon.c', '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]')] 2023-10-16T20:05:32.388 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.152,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T20:05:32.389 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:32.390 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T20:05:32.444 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.152 --add b 172.21.15.163 --addv c '[v2:172.21.15.163:3301,v1:172.21.15.163:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:32.532 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:32.533 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: generated fsid e602e5ee-bf17-44e1-9fbf-0f448134fb28 2023-10-16T20:05:32.533 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = pacific 2023-10-16T20:05:32.533 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 0 2023-10-16T20:05:32.533 INFO:teuthology.orchestra.run.smithi152.stdout:fsid e602e5ee-bf17-44e1-9fbf-0f448134fb28 2023-10-16T20:05:32.534 INFO:teuthology.orchestra.run.smithi152.stdout:last_changed 2023-10-16T20:05:32.531711+0000 2023-10-16T20:05:32.534 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-10-16T20:05:32.531711+0000 2023-10-16T20:05:32.534 INFO:teuthology.orchestra.run.smithi152.stdout:min_mon_release 16 (pacific) 2023-10-16T20:05:32.534 INFO:teuthology.orchestra.run.smithi152.stdout:election_strategy: 1 2023-10-16T20:05:32.534 INFO:teuthology.orchestra.run.smithi152.stdout:0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2023-10-16T20:05:32.535 INFO:teuthology.orchestra.run.smithi152.stdout:1: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2023-10-16T20:05:32.535 INFO:teuthology.orchestra.run.smithi152.stdout:2: [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] mon.c 2023-10-16T20:05:32.535 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T20:05:32.536 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T20:05:32.552 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e602e5ee-bf17-44e1-9fbf-0f448134fb28... 2023-10-16T20:05:32.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T20:05:32.595 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T20:05:32.638 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2023-10-16T20:05:32.638 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2023-10-16T20:05:32.639 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T20:05:32.639 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2023-10-16T20:05:32.639 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.639 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2023-10-16T20:05:32.639 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.640 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2023-10-16T20:05:32.640 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.640 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2023-10-16T20:05:32.640 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2023-10-16T20:05:32.641 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.641 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2023-10-16T20:05:32.641 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2023-10-16T20:05:32.641 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.641 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T20:05:32.642 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2023-10-16T20:05:32.642 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.642 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T20:05:32.642 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T20:05:32.642 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2023-10-16T20:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2023-10-16T20:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2023-10-16T20:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2023-10-16T20:05:32.644 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2023-10-16T20:05:32.644 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2023-10-16T20:05:32.644 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2023-10-16T20:05:32.644 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2023-10-16T20:05:32.644 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T20:05:32.645 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T20:05:32.645 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2023-10-16T20:05:32.645 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.645 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T20:05:32.645 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.646 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2023-10-16T20:05:32.646 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.646 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2023-10-16T20:05:32.646 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.646 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2023-10-16T20:05:32.647 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2023-10-16T20:05:32.647 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2023-10-16T20:05:32.647 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.152,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2023-10-16T20:05:32.647 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on skipped message = False 2023-10-16T20:05:32.647 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = e602e5ee-bf17-44e1-9fbf-0f448134fb28 2023-10-16T20:05:32.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.648 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2023-10-16T20:05:32.648 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2023-10-16T20:05:32.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.648 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2023-10-16T20:05:32.649 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2023-10-16T20:05:32.649 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2023-10-16T20:05:32.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.649 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2023-10-16T20:05:32.649 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2023-10-16T20:05:32.650 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.650 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2023-10-16T20:05:32.650 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2023-10-16T20:05:32.650 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2023-10-16T20:05:32.650 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.651 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2023-10-16T20:05:32.651 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2023-10-16T20:05:32.651 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.651 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2023-10-16T20:05:32.651 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.652 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2023-10-16T20:05:32.652 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.652 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2023-10-16T20:05:32.652 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.652 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2023-10-16T20:05:32.653 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2023-10-16T20:05:32.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.653 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2023-10-16T20:05:32.653 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2023-10-16T20:05:32.653 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2023-10-16T20:05:32.653 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2023-10-16T20:05:32.654 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2023-10-16T20:05:32.654 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2023-10-16T20:05:32.654 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-10-16T20:05:32.654 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2023-10-16T20:05:32.654 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2023-10-16T20:05:32.655 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T20:05:32.655 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2023-10-16T20:05:32.655 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2023-10-16T20:05:32.655 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2023-10-16T20:05:32.655 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2023-10-16T20:05:32.656 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2023-10-16T20:05:32.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.656 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2023-10-16T20:05:32.656 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-10-16T20:05:32.656 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2023-10-16T20:05:32.657 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2023-10-16T20:05:32.657 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2023-10-16T20:05:32.657 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2023-10-16T20:05:32.657 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2023-10-16T20:05:32.658 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2023-10-16T20:05:32.658 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.658 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2023-10-16T20:05:32.658 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-10-16T20:05:32.659 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2023-10-16T20:05:32.659 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2023-10-16T20:05:32.659 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2023-10-16T20:05:32.659 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2023-10-16T20:05:32.659 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2023-10-16T20:05:32.660 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2023-10-16T20:05:32.660 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2023-10-16T20:05:32.660 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2023-10-16T20:05:32.660 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2023-10-16T20:05:32.660 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.661 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T20:05:32.661 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T20:05:32.661 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T20:05:32.661 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.661 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T20:05:32.662 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T20:05:32.662 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T20:05:32.662 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.662 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2023-10-16T20:05:32.662 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2023-10-16T20:05:32.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.663 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2023-10-16T20:05:32.663 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2023-10-16T20:05:32.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:05:32.663 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2023-10-16T20:05:32.664 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2023-10-16T20:05:32.664 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2023-10-16T20:05:32.664 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2023-10-16T20:05:32.664 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T20:05:32.664 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T20:05:32.665 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2023-10-16T20:05:32.665 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2023-10-16T20:05:32.665 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-10-16T20:05:32.665 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = "" 2023-10-16T20:05:32.665 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2023-10-16T20:05:32.666 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2023-10-16T20:05:32.666 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2023-10-16T20:05:32.666 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2023-10-16T20:05:32.666 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2023-10-16T20:05:32.667 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2023-10-16T20:05:32.667 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2023-10-16T20:05:32.667 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2023-10-16T20:05:32.667 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2023-10-16T20:05:32.667 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2023-10-16T20:05:32.667 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2023-10-16T20:05:32.668 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2023-10-16T20:05:32.668 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-10-16T20:05:32.668 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2023-10-16T20:05:32.668 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2023-10-16T20:05:32.668 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2023-10-16T20:05:32.669 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2023-10-16T20:05:32.669 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2023-10-16T20:05:32.669 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2023-10-16T20:05:32.669 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2023-10-16T20:05:32.671 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2023-10-16T20:05:32.671 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2023-10-16T20:05:32.671 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T20:05:32.672 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2023-10-16T20:05:32.672 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.672 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2023-10-16T20:05:32.672 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.672 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2023-10-16T20:05:32.673 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.673 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2023-10-16T20:05:32.673 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2023-10-16T20:05:32.673 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.673 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2023-10-16T20:05:32.674 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2023-10-16T20:05:32.674 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.674 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T20:05:32.674 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2023-10-16T20:05:32.674 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.675 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T20:05:32.675 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T20:05:32.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.675 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2023-10-16T20:05:32.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2023-10-16T20:05:32.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2023-10-16T20:05:32.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2023-10-16T20:05:32.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2023-10-16T20:05:32.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2023-10-16T20:05:32.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2023-10-16T20:05:32.677 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2023-10-16T20:05:32.677 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T20:05:32.677 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T20:05:32.677 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2023-10-16T20:05:32.677 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T20:05:32.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2023-10-16T20:05:32.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.678 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2023-10-16T20:05:32.679 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.679 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2023-10-16T20:05:32.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2023-10-16T20:05:32.679 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2023-10-16T20:05:32.679 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.152,172.21.15.163,[v2:172.21.15.163:3301,v1:172.21.15.163:6790]" 2023-10-16T20:05:32.680 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on skipped message = False 2023-10-16T20:05:32.680 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = e602e5ee-bf17-44e1-9fbf-0f448134fb28 2023-10-16T20:05:32.680 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.680 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2023-10-16T20:05:32.681 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2023-10-16T20:05:32.681 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.681 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2023-10-16T20:05:32.681 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2023-10-16T20:05:32.681 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2023-10-16T20:05:32.682 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.682 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2023-10-16T20:05:32.682 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2023-10-16T20:05:32.682 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.682 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2023-10-16T20:05:32.683 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2023-10-16T20:05:32.683 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2023-10-16T20:05:32.683 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.683 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2023-10-16T20:05:32.684 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2023-10-16T20:05:32.684 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.684 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2023-10-16T20:05:32.684 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.685 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2023-10-16T20:05:32.685 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.685 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2023-10-16T20:05:32.686 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.686 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2023-10-16T20:05:32.686 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2023-10-16T20:05:32.687 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.687 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2023-10-16T20:05:32.687 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2023-10-16T20:05:32.688 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2023-10-16T20:05:32.688 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2023-10-16T20:05:32.689 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 20 2023-10-16T20:05:32.689 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 20 2023-10-16T20:05:32.689 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-16T20:05:32.690 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2023-10-16T20:05:32.690 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 10 2023-10-16T20:05:32.690 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T20:05:32.691 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2023-10-16T20:05:32.691 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2023-10-16T20:05:32.691 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2023-10-16T20:05:32.692 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2023-10-16T20:05:32.692 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2023-10-16T20:05:32.693 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.693 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2023-10-16T20:05:32.693 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-16T20:05:32.694 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2023-10-16T20:05:32.694 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-10-16T20:05:32.694 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-10-16T20:05:32.694 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-10-16T20:05:32.695 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-10-16T20:05:32.695 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2023-10-16T20:05:32.695 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.695 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2023-10-16T20:05:32.696 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-16T20:05:32.696 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-10-16T20:05:32.696 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2023-10-16T20:05:32.696 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-10-16T20:05:32.697 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2023-10-16T20:05:32.697 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2023-10-16T20:05:32.697 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-10-16T20:05:32.697 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2023-10-16T20:05:32.698 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2023-10-16T20:05:32.698 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-10-16T20:05:32.698 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.698 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T20:05:32.699 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T20:05:32.699 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T20:05:32.699 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.699 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T20:05:32.699 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T20:05:32.700 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T20:05:32.700 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.700 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2023-10-16T20:05:32.700 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2023-10-16T20:05:32.700 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.700 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2023-10-16T20:05:32.701 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2023-10-16T20:05:32.701 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-10-16T20:05:32.701 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2023-10-16T20:05:32.701 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2023-10-16T20:05:32.701 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2023-10-16T20:05:32.702 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2023-10-16T20:05:32.702 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T20:05:32.702 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T20:05:32.702 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2023-10-16T20:05:32.702 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2023-10-16T20:05:32.703 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-16T20:05:32.703 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = "" 2023-10-16T20:05:32.703 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2023-10-16T20:05:32.703 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2023-10-16T20:05:32.703 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2023-10-16T20:05:32.704 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2023-10-16T20:05:32.704 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2023-10-16T20:05:32.704 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2023-10-16T20:05:32.704 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2023-10-16T20:05:32.704 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2023-10-16T20:05:32.704 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2023-10-16T20:05:32.705 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2023-10-16T20:05:32.705 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2023-10-16T20:05:32.705 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds balancer = 20 2023-10-16T20:05:32.705 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-10-16T20:05:32.705 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2023-10-16T20:05:32.705 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2023-10-16T20:05:32.706 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2023-10-16T20:05:32.706 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2023-10-16T20:05:32.706 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2023-10-16T20:05:32.707 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2023-10-16T20:05:32.707 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2023-10-16T20:05:32.708 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T20:05:32.708 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T20:05:32.769 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T20:05:32.770 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:32.770 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T20:05:32.787 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:32.788 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T20:05:32.845 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:05:32.845 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:32.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T20:05:32.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T20:05:32.921 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:05:32.921 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:32.978 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:05:32.979 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:32.980 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T20:05:32.980 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T20:05:33.023 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:05:33.024 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:33.083 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T20:05:33.083 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T20:05:33.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T20:05:33.137 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T20:05:33.140 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T20:05:33.207 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T20:05:33.210 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T20:05:33.210 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T20:05:33.264 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T20:05:33.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T20:05:33.293 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T20:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T20:05:33.390 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T20:05:33.416 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T20:05:33.478 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T20:05:33.480 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T20:05:33.509 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T20:05:33.608 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T20:05:33.610 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T20:05:33.637 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T20:05:33.638 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T20:05:33.681 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T20:05:33.694 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T20:05:33.777 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T20:05:33.790 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T20:05:33.833 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T20:05:33.846 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-16T20:05:33.929 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-16T20:05:33.942 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T20:05:33.942 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T20:05:33.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T20:05:33.970 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:33.971 INFO:tasks.ceph:role: osd.0 2023-10-16T20:05:33.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:05:33.971 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T20:05:34.044 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:34.044 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:34.045 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:34.045 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:34.046 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:34.046 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:34.046 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:34.046 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:34.475 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-10-16T20:05:34.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-10-16T20:05:34.478 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T20:05:34.647 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T20:05:34.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T20:05:34.748 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:34.749 INFO:tasks.ceph:role: osd.1 2023-10-16T20:05:34.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:05:34.749 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T20:05:34.822 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:34.822 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:34.822 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:34.823 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:34.823 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:34.823 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:34.824 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:34.824 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:35.237 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-10-16T20:05:35.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-10-16T20:05:35.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T20:05:35.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T20:05:35.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T20:05:35.454 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:35.455 INFO:tasks.ceph:role: osd.2 2023-10-16T20:05:35.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:05:35.455 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T20:05:35.528 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:35.529 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:35.529 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:35.529 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:35.529 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:35.529 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:35.530 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:35.530 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:35.530 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:35.530 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:35.977 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-10-16T20:05:35.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-10-16T20:05:35.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T20:05:36.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T20:05:36.158 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T20:05:36.226 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:36.226 INFO:tasks.ceph:role: osd.3 2023-10-16T20:05:36.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:05:36.227 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T20:05:36.301 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:36.301 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:36.302 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:36.302 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:36.302 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:36.303 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:36.303 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:36.303 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:36.744 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-10-16T20:05:36.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-10-16T20:05:36.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T20:05:36.920 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T20:05:36.952 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:37.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:37.055+0000 7f756b3fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T20:05:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:37.055+0000 7f756b3fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T20:05:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:37.055+0000 7f756b3fa640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T20:05:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:37.055+0000 7f756b3fa640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T20:05:37.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:37.055+0000 7f756b3fa640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T20:05:37.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:37.056+0000 7f756b3fa640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T20:05:39.931 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T20:05:39.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:40.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:40.051+0000 7ff23398c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T20:05:40.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:40.051+0000 7ff23398c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T20:05:40.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:40.051+0000 7ff23398c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T20:05:40.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:40.051+0000 7ff23398c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T20:05:40.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:40.051+0000 7ff23398c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T20:05:40.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:40.052+0000 7ff23398c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T20:05:42.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T20:05:42.946 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:43.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:43.035+0000 7f0ee446e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T20:05:43.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:43.035+0000 7f0ee446e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T20:05:43.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:43.035+0000 7f0ee446e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T20:05:43.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:43.035+0000 7f0ee446e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T20:05:43.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:43.035+0000 7f0ee446e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T20:05:43.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:43.036+0000 7f0ee446e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T20:05:45.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T20:05:45.946 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:46.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:46.035+0000 7fb71b97c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T20:05:46.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:46.035+0000 7fb71b97c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T20:05:46.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:46.035+0000 7fb71b97c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T20:05:46.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:46.035+0000 7fb71b97c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T20:05:46.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:46.035+0000 7fb71b97c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T20:05:46.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:05:46.035+0000 7fb71b97c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T20:05:48.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T20:05:48.938 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T20:05:48.971 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:48.971 INFO:tasks.ceph:role: osd.4 2023-10-16T20:05:48.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:05:48.971 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T20:05:49.049 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:49.050 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:49.050 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:49.050 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:49.050 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:49.051 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:49.051 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:49.051 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:49.051 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:49.051 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:49.482 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-10-16T20:05:49.484 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-10-16T20:05:49.485 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T20:05:49.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T20:05:49.709 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T20:05:49.779 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:49.779 INFO:tasks.ceph:role: osd.5 2023-10-16T20:05:49.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:05:49.780 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T20:05:49.853 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:49.854 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:49.854 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:49.854 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:49.854 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:49.855 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:49.855 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:49.855 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:49.855 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:49.855 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:50.278 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-10-16T20:05:50.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-10-16T20:05:50.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T20:05:50.385 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T20:05:50.419 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T20:05:50.487 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:50.488 INFO:tasks.ceph:role: osd.6 2023-10-16T20:05:50.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:05:50.488 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T20:05:50.563 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:50.564 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:50.564 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:50.564 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:50.565 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:50.565 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:50.565 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:50.565 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:50.565 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:50.566 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:51.013 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-10-16T20:05:51.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-10-16T20:05:51.015 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T20:05:51.180 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T20:05:51.217 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T20:05:51.287 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T20:05:51.288 INFO:tasks.ceph:role: osd.7 2023-10-16T20:05:51.288 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:05:51.289 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T20:05:51.365 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T20:05:51.365 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T20:05:51.366 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T20:05:51.366 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T20:05:51.366 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T20:05:51.366 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-10-16T20:05:51.366 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T20:05:51.367 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T20:05:51.367 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T20:05:51.367 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T20:05:51.807 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-10-16T20:05:51.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-10-16T20:05:51.810 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T20:05:51.992 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T20:05:52.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:52.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:52.138+0000 7f7c6ab11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T20:05:52.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:52.138+0000 7f7c6ab11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T20:05:52.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:52.138+0000 7f7c6ab11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T20:05:52.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:52.138+0000 7f7c6ab11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T20:05:52.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:52.138+0000 7f7c6ab11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T20:05:52.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:52.139+0000 7f7c6ab11640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T20:05:55.012 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T20:05:55.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:55.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:55.133+0000 7f2e874a0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T20:05:55.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:55.133+0000 7f2e874a0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T20:05:55.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:55.133+0000 7f2e874a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T20:05:55.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:55.133+0000 7f2e874a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T20:05:55.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:55.133+0000 7f2e874a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T20:05:55.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:55.134+0000 7f2e874a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T20:05:58.004 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T20:05:58.036 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:05:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:58.124+0000 7fecbe49a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T20:05:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:58.125+0000 7fecbe49a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T20:05:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:58.125+0000 7fecbe49a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T20:05:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:58.125+0000 7fecbe49a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T20:05:58.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:58.125+0000 7fecbe49a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T20:05:58.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:05:58.125+0000 7fecbe49a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T20:06:00.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:00.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:00.990 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T20:06:01.023 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:06:01.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:01.113+0000 7f9d38bc7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T20:06:01.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:01.113+0000 7f9d38bc7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T20:06:01.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:01.113+0000 7f9d38bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T20:06:01.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:01.113+0000 7f9d38bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T20:06:01.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:01.113+0000 7f9d38bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T20:06:01.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:01.113+0000 7f9d38bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T20:06:03.975 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T20:06:04.007 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T20:06:04.008 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T20:06:04.040 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T20:06:04.111 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.112 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T20:06:04.181 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T20:06:04.250 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T20:06:04.319 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T20:06:04.387 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T20:06:04.455 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.455 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T20:06:04.487 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T20:06:04.558 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T20:06:04.627 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.628 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T20:06:04.697 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.697 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T20:06:04.766 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.767 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T20:06:04.836 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.836 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T20:06:04.905 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.905 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T20:06:04.924 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:04.924 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T20:06:04.982 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:04.982 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T20:06:05.000 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:05.001 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-16T20:06:05.058 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T20:06:05.058 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T20:06:05.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T20:06:05.101 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2023-10-16T20:06:05.101 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1l8HkhCBAANzzamcAe5KQ7A6AGgF025g== 2023-10-16T20:06:05.101 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2023-10-16T20:06:05.102 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lYhS0DxAALmh4JVgtqSdl6/9mRnGABQ== 2023-10-16T20:06:05.102 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2023-10-16T20:06:05.102 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lyL4CFxAA9M83IQ0W0bnwJqsYnN0kQA== 2023-10-16T20:06:05.102 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2023-10-16T20:06:05.102 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCRly1llgZcAxAAeElqp2kC0e3tTx7JE18Qrw== 2023-10-16T20:06:05.103 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2023-10-16T20:06:05.103 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCUly1lO9gYAxAAdzacKZqwpqIMdkHVcHhPhA== 2023-10-16T20:06:05.103 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2023-10-16T20:06:05.103 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCXly1l0/s4AhAAdgzHcaW1Gh5jYuRJQHY9yA== 2023-10-16T20:06:05.103 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2023-10-16T20:06:05.104 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCaly1lD5ovAhAAxssq/bQrp6mLdpAsBN5H1Q== 2023-10-16T20:06:05.104 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2023-10-16T20:06:05.104 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1luLpLDBAAVHIkAFHQYA1M7olQ9X0agA== 2023-10-16T20:06:05.104 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2023-10-16T20:06:05.104 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lGE1wHBAAiXxwwNN8MRHu/2PBVnzN1g== 2023-10-16T20:06:05.105 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2023-10-16T20:06:05.105 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lsUQyJBAAJXUKRdtfd/1Tm+F+Ip02TA== 2023-10-16T20:06:05.105 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2023-10-16T20:06:05.105 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCgly1lsYhRCBAA/rufsoEpNoAEKhGrroyZRA== 2023-10-16T20:06:05.105 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2023-10-16T20:06:05.105 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCjly1lQgUCCBAAEYklY1QlikhxLs26Y1Edbw== 2023-10-16T20:06:05.106 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2023-10-16T20:06:05.106 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCmly1l8XaABxAAO9CPbSlvRMSYpdZVJsBE8Q== 2023-10-16T20:06:05.106 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2023-10-16T20:06:05.106 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCply1l/rjNBhAAmik/hiT6QI8FQ9c9PN1DrA== 2023-10-16T20:06:05.106 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2023-10-16T20:06:05.107 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1l2A6OKBAA5O34FFHdeoZfbqU4ugN4Rw== 2023-10-16T20:06:05.107 INFO:teuthology.orchestra.run.smithi152.stdout:[client.2] 2023-10-16T20:06:05.107 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lGQ9DLhAAoF9qKXQRnaOZdE10MqXm+A== 2023-10-16T20:06:05.107 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2023-10-16T20:06:05.107 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lOkehMRAA+lpyHduc1jI4/58OYnQswA== 2023-10-16T20:06:05.108 INFO:teuthology.orchestra.run.smithi152.stdout:[client.3] 2023-10-16T20:06:05.108 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1lEgdWNxAAh9FWiZWSibKhBye/y/65/Q== 2023-10-16T20:06:05.124 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.y] 2023-10-16T20:06:05.124 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1l8HkhCBAANzzamcAe5KQ7A6AGgF025g== 2023-10-16T20:06:05.124 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2023-10-16T20:06:05.125 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lYhS0DxAALmh4JVgtqSdl6/9mRnGABQ== 2023-10-16T20:06:05.125 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2023-10-16T20:06:05.125 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lyL4CFxAA9M83IQ0W0bnwJqsYnN0kQA== 2023-10-16T20:06:05.125 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2023-10-16T20:06:05.126 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCRly1llgZcAxAAeElqp2kC0e3tTx7JE18Qrw== 2023-10-16T20:06:05.126 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2023-10-16T20:06:05.126 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCUly1lO9gYAxAAdzacKZqwpqIMdkHVcHhPhA== 2023-10-16T20:06:05.126 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2023-10-16T20:06:05.126 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCXly1l0/s4AhAAdgzHcaW1Gh5jYuRJQHY9yA== 2023-10-16T20:06:05.127 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.3] 2023-10-16T20:06:05.127 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCaly1lD5ovAhAAxssq/bQrp6mLdpAsBN5H1Q== 2023-10-16T20:06:05.127 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2023-10-16T20:06:05.127 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1luLpLDBAAVHIkAFHQYA1M7olQ9X0agA== 2023-10-16T20:06:05.128 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2023-10-16T20:06:05.128 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lGE1wHBAAiXxwwNN8MRHu/2PBVnzN1g== 2023-10-16T20:06:05.128 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2023-10-16T20:06:05.128 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lsUQyJBAAJXUKRdtfd/1Tm+F+Ip02TA== 2023-10-16T20:06:05.128 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.4] 2023-10-16T20:06:05.129 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCgly1lsYhRCBAA/rufsoEpNoAEKhGrroyZRA== 2023-10-16T20:06:05.129 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.5] 2023-10-16T20:06:05.129 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCjly1lQgUCCBAAEYklY1QlikhxLs26Y1Edbw== 2023-10-16T20:06:05.129 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.6] 2023-10-16T20:06:05.130 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCmly1l8XaABxAAO9CPbSlvRMSYpdZVJsBE8Q== 2023-10-16T20:06:05.130 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.7] 2023-10-16T20:06:05.130 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCply1l/rjNBhAAmik/hiT6QI8FQ9c9PN1DrA== 2023-10-16T20:06:05.130 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2023-10-16T20:06:05.130 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1l2A6OKBAA5O34FFHdeoZfbqU4ugN4Rw== 2023-10-16T20:06:05.131 INFO:teuthology.orchestra.run.smithi163.stdout:[client.2] 2023-10-16T20:06:05.131 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lGQ9DLhAAoF9qKXQRnaOZdE10MqXm+A== 2023-10-16T20:06:05.131 INFO:teuthology.orchestra.run.smithi163.stdout:[client.1] 2023-10-16T20:06:05.131 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lOkehMRAA+lpyHduc1jI4/58OYnQswA== 2023-10-16T20:06:05.131 INFO:teuthology.orchestra.run.smithi163.stdout:[client.3] 2023-10-16T20:06:05.132 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCNly1lEgdWNxAAh9FWiZWSibKhBye/y/65/Q== 2023-10-16T20:06:05.133 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T20:06:05.151 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T20:06:05.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.229 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.349 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.405 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.407 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.463 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.516 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T20:06:05.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T20:06:05.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.630 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.686 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.689 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T20:06:05.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.747 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.800 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.858 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.911 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.913 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T20:06:05.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:05.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.028 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.086 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.142 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.145 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T20:06:06.200 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T20:06:06.201 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T20:06:06.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T20:06:06.325 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T20:06:06.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T20:06:06.379 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T20:06:06.477 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T20:06:06.503 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T20:06:06.571 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T20:06:06.669 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T20:06:06.696 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:06:06.698 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T20:06:06.752 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T20:06:06.753 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T20:06:06.753 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T20:06:06.755 INFO:tasks.ceph.mon.a:Started 2023-10-16T20:06:06.756 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T20:06:06.756 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T20:06:06.794 INFO:tasks.ceph.mon.b:Started 2023-10-16T20:06:06.794 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T20:06:06.795 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T20:06:06.797 INFO:tasks.ceph.mon.c:Started 2023-10-16T20:06:06.797 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T20:06:06.798 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T20:06:06.798 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T20:06:06.800 INFO:tasks.ceph.mgr.y:Started 2023-10-16T20:06:06.801 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T20:06:06.801 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T20:06:06.803 INFO:tasks.ceph.mgr.x:Started 2023-10-16T20:06:06.803 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T20:06:06.804 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T20:06:06.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.923+0000 7f043583e700 1 Processor -- start 2023-10-16T20:06:06.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.923+0000 7f043583e700 1 -- start start 2023-10-16T20:06:06.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f043583e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:06.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f043583e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0430070620 con 0x7f04300b33f0 2023-10-16T20:06:06.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f043583e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0430070900 con 0x7f04300cd770 2023-10-16T20:06:06.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f043583e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0430070be0 con 0x7f043015b4e0 2023-10-16T20:06:06.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f042f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f04300b33f0 0x7f04300b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37840/0 (socket says 172.21.15.152:37840) 2023-10-16T20:06:06.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f042f7fe700 1 -- 172.21.15.152:0/2187992599 learned_addr learned my addr 172.21.15.152:0/2187992599 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:06.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.924+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:06.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.925+0000 7f042effd700 1 -- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 msgr2=0x7f043006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T20:06:06.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.925+0000 7f042effd700 1 -- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 msgr2=0x7f043006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T20:06:06.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.925+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T20:06:06.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:06.925+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T20:06:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.126+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.126+0000 7f042effd700 1 -- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 msgr2=0x7f043006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T20:06:07.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.126+0000 7f042effd700 1 -- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 msgr2=0x7f043006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T20:06:07.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.126+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T20:06:07.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.126+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T20:06:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.132+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857261458 0 0) 0x7f0430070620 con 0x7f04300b33f0 2023-10-16T20:06:07.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.132+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f041c0035b0 con 0x7f04300b33f0 2023-10-16T20:06:07.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061201516 0 0) 0x7f041c0035b0 con 0x7f04300b33f0 2023-10-16T20:06:07.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 msgr2=0x7f043006f280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:07.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 --2- 172.21.15.152:0/2187992599 >> v2:172.21.15.163:3300/0 conn(0x7f043015b4e0 0x7f043006f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 >> v1:172.21.15.163:6789/0 conn(0x7f04300cd770 legacy=0x7f04300b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430070ec0 con 0x7f04300b33f0 2023-10-16T20:06:07.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f0420001670 con 0x7f04300b33f0 2023-10-16T20:06:07.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 >> v1:172.21.15.152:6789/0 conn(0x7f04300b33f0 legacy=0x7f04300b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c003a00 0x7f041c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f041c004850 0x7f041c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f041c005210 0x7f041c00fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430070be0 con 0x7f041c004850 2023-10-16T20:06:07.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c010570 con 0x7f041c003a00 2023-10-16T20:06:07.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c007a70 con 0x7f041c005210 2023-10-16T20:06:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c003a00 0x7f041c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042e7fc700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f041c004850 0x7f041c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042f7fe700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f041c005210 0x7f041c00fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042e7fc700 1 -- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f041c005210 msgr2=0x7f041c00fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042e7fc700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f041c005210 0x7f041c00fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042e7fc700 1 -- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c003a00 msgr2=0x7f041c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042e7fc700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c003a00 0x7f041c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042e7fc700 1 -- 172.21.15.152:0/2187992599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0035b0 con 0x7f041c004850 2023-10-16T20:06:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042f7fe700 1 -- 172.21.15.152:0/2187992599 reap_dead start 2023-10-16T20:06:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.133+0000 7f042effd700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c003a00 0x7f041c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:07.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.134+0000 7f042e7fc700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f041c004850 0x7f041c004cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f04300cdbe0 tx=0x7f041c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddd0b2f3ea0f7b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.134+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180052d0 con 0x7f041c004850 2023-10-16T20:06:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.134+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0418005450 con 0x7f041c004850 2023-10-16T20:06:07.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.134+0000 7f042dffb700 1 -- 172.21.15.152:0/2187992599 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180038c0 con 0x7f041c004850 2023-10-16T20:06:07.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 -- 172.21.15.152:0/2187992599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f041c004850 msgr2=0x7f041c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f041c004850 0x7f041c004cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f04300cdbe0 tx=0x7f041c005880 comp rx=0 tx=0).stop 2023-10-16T20:06:07.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 -- 172.21.15.152:0/2187992599 shutdown_connections 2023-10-16T20:06:07.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 --2- 172.21.15.152:0/2187992599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f041c004850 0x7f041c004cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 -- 172.21.15.152:0/2187992599 >> 172.21.15.152:0/2187992599 conn(0x7f04300cdce0 msgr2=0x7f04300ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:07.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 -- 172.21.15.152:0/2187992599 shutdown_connections 2023-10-16T20:06:07.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.135+0000 7f043583e700 1 -- 172.21.15.152:0/2187992599 wait complete. 2023-10-16T20:06:07.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.137+0000 7f043583e700 1 Processor -- start 2023-10-16T20:06:07.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.137+0000 7f043583e700 1 -- start start 2023-10-16T20:06:07.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f043583e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 0x7f04300c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f043583e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04301517a0 0x7f0430153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f043583e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0430153d80 0x7f0430152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f043583e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430151eb0 con 0x7f0430153d80 2023-10-16T20:06:07.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f043583e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430152750 con 0x7f041c004850 2023-10-16T20:06:07.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f043583e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04300c7880 con 0x7f04301517a0 2023-10-16T20:06:07.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f042effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 0x7f04300c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0430153d80 0x7f0430152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f042e7fc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04301517a0 0x7f0430153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f042e7fc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04301517a0 0x7f0430153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:46326/0 (socket says 172.21.15.152:46326) 2023-10-16T20:06:07.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f042effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 0x7f04300c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:58672/0 (socket says 172.21.15.152:58672) 2023-10-16T20:06:07.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.138+0000 7f042e7fc700 1 -- 172.21.15.152:0/416850644 learned_addr learned my addr 172.21.15.152:0/416850644 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:07.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042effd700 1 -- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04301517a0 msgr2=0x7f0430153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042effd700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04301517a0 0x7f0430153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042effd700 1 -- 172.21.15.152:0/416850644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0430153d80 msgr2=0x7f0430152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042effd700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0430153d80 0x7f0430152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042effd700 1 -- 172.21.15.152:0/416850644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430154220 con 0x7f041c004850 2023-10-16T20:06:07.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042f7fe700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0430153d80 0x7f0430152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:07.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f042effd700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 0x7f04300c7340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0428009610 tx=0x7f0428007610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:07.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428009e80 con 0x7f041c004850 2023-10-16T20:06:07.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042800f040 con 0x7f041c004850 2023-10-16T20:06:07.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0430152100 con 0x7f041c004850 2023-10-16T20:06:07.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428016660 con 0x7f041c004850 2023-10-16T20:06:07.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0430153120 con 0x7f041c004850 2023-10-16T20:06:07.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0428016ac0 con 0x7f041c004850 2023-10-16T20:06:07.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.139+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f042801fc40 con 0x7f041c004850 2023-10-16T20:06:07.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.140+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043004ebb0 con 0x7f041c004850 2023-10-16T20:06:07.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.142+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f042803db40 con 0x7f041c004850 2023-10-16T20:06:07.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.219+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f04300d0bf0 con 0x7f041c004850 2023-10-16T20:06:07.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.228+0000 7f0427fff700 1 -- 172.21.15.152:0/416850644 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f042802c020 con 0x7f041c004850 2023-10-16T20:06:07.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.228+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 msgr2=0x7f04300c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.228+0000 7f043583e700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 0x7f04300c7340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0428009610 tx=0x7f0428007610 comp rx=0 tx=0).stop 2023-10-16T20:06:07.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.228+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 shutdown_connections 2023-10-16T20:06:07.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.229+0000 7f043583e700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0430153d80 0x7f0430152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.229+0000 7f043583e700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f041c004850 0x7f04300c7340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.229+0000 7f043583e700 1 --2- 172.21.15.152:0/416850644 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f04301517a0 0x7f0430153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.229+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 >> 172.21.15.152:0/416850644 conn(0x7f04300cdce0 msgr2=0x7f043006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:07.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.229+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 shutdown_connections 2023-10-16T20:06:07.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:07.229+0000 7f043583e700 1 -- 172.21.15.152:0/416850644 wait complete. 2023-10-16T20:06:07.234 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2023-10-16T20:06:07.243 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T20:06:07.244 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T20:06:07.244 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:07.244 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T20:06:07.256 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:07.254+0000 7f8fdb386200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T20:06:07.258 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:07.255+0000 7fc286656200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T20:06:07.271 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:07.271 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T20:06:07.322 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:07.320+0000 7f8fdb386200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T20:06:07.326 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:07.324+0000 7fc286656200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T20:06:07.337 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:07.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T20:06:07.399 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:07.397+0000 7f8fdb386200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T20:06:07.405 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:07.406 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T20:06:07.407 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:07.404+0000 7fc286656200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T20:06:07.432 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:07.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T20:06:07.460 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:07.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T20:06:07.481 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:07.479+0000 7f8fdb386200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T20:06:07.491 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:07.488+0000 7fc286656200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T20:06:07.510 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:07.510 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T20:06:07.576 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:06:07.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T20:06:07.634 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:07.632+0000 7fc286656200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T20:06:07.638 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:07.636+0000 7f8fdb386200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T20:06:07.643 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new a7ce383b-acb4-41b6-99c9-7e61339ea9a2 0 2023-10-16T20:06:07.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.803+0000 7f240569a700 1 Processor -- start 2023-10-16T20:06:07.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.803+0000 7f240569a700 1 -- start start 2023-10-16T20:06:07.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f240569a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f240015da20 0x7f24000caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f240569a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24000ce820 0x7f240006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f240569a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240015de00 con 0x7f24000cb1e0 2023-10-16T20:06:07.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f240569a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24000cc1e0 con 0x7f24000ce820 2023-10-16T20:06:07.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f240569a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24000cb660 con 0x7f240015da20 2023-10-16T20:06:07.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23fe7fc700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f24000cb1e0 0x7f24000ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:47858/0 (socket says 172.21.15.163:47858) 2023-10-16T20:06:07.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23fe7fc700 1 -- 172.21.15.163:0/1754231380 learned_addr learned my addr 172.21.15.163:0/1754231380 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-10-16T20:06:07.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23feffd700 1 --2- 172.21.15.163:0/1754231380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f240015da20 0x7f24000caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23ff7fe700 1 --2- 172.21.15.163:0/1754231380 >> v2:172.21.15.152:3300/0 conn(0x7f24000ce820 0x7f240006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23fdffb700 1 -- 172.21.15.163:0/1754231380 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605060023 0 0) 0x7f240015de00 con 0x7f24000cb1e0 2023-10-16T20:06:07.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23fdffb700 1 -- 172.21.15.163:0/1754231380 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e80035b0 con 0x7f24000cb1e0 2023-10-16T20:06:07.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23feffd700 1 -- 172.21.15.163:0/1754231380 >> v2:172.21.15.152:3300/0 conn(0x7f24000ce820 msgr2=0x7f240006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:07.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23feffd700 1 --2- 172.21.15.163:0/1754231380 >> v2:172.21.15.152:3300/0 conn(0x7f24000ce820 0x7f240006cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23feffd700 1 -- 172.21.15.163:0/1754231380 >> v1:172.21.15.163:6789/0 conn(0x7f24000cb1e0 legacy=0x7f24000ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.804+0000 7f23feffd700 1 -- 172.21.15.163:0/1754231380 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24000cb940 con 0x7f240015da20 2023-10-16T20:06:07.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f23feffd700 1 --2- 172.21.15.163:0/1754231380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f240015da20 0x7f24000caca0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009840 tx=0x7f23f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1af3290a3b0294 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:07.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f23fdffb700 1 -- 172.21.15.163:0/1754231380 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011830 con 0x7f240015da20 2023-10-16T20:06:07.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f23fdffb700 1 -- 172.21.15.163:0/1754231380 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f0011990 con 0x7f240015da20 2023-10-16T20:06:07.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f23fdffb700 1 -- 172.21.15.163:0/1754231380 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011d20 con 0x7f240015da20 2023-10-16T20:06:07.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 -- 172.21.15.163:0/1754231380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f240015da20 msgr2=0x7f24000caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 --2- 172.21.15.163:0/1754231380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f240015da20 0x7f24000caca0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009840 tx=0x7f23f0009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:07.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 -- 172.21.15.163:0/1754231380 shutdown_connections 2023-10-16T20:06:07.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 --2- 172.21.15.163:0/1754231380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f240015da20 0x7f24000caca0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 --2- 172.21.15.163:0/1754231380 >> v2:172.21.15.152:3300/0 conn(0x7f24000ce820 0x7f240006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 -- 172.21.15.163:0/1754231380 >> 172.21.15.163:0/1754231380 conn(0x7f24000b13e0 msgr2=0x7f24000b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:07.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 -- 172.21.15.163:0/1754231380 shutdown_connections 2023-10-16T20:06:07.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.805+0000 7f240569a700 1 -- 172.21.15.163:0/1754231380 wait complete. 2023-10-16T20:06:07.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.807+0000 7f240569a700 1 Processor -- start 2023-10-16T20:06:07.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.807+0000 7f240569a700 1 -- start start 2023-10-16T20:06:07.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f240569a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24000cb1e0 0x7f240006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f240569a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 0x7f24000c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f240569a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f240015da20 0x7f24000afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:07.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f240569a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240006d9d0 con 0x7f240015da20 2023-10-16T20:06:07.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f240569a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24000ae390 con 0x7f24000cb1e0 2023-10-16T20:06:07.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f240569a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24000aca60 con 0x7f24000ce820 2023-10-16T20:06:07.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23fe7fc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 0x7f24000c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23fe7fc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 0x7f24000c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44574/0 (socket says 172.21.15.163:44574) 2023-10-16T20:06:07.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23fe7fc700 1 -- 172.21.15.163:0/3293132995 learned_addr learned my addr 172.21.15.163:0/3293132995 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:07.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23feffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24000cb1e0 0x7f240006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23ff7fe700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f240015da20 0x7f24000afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:07.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23feffd700 1 -- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 msgr2=0x7f24000c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23feffd700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 0x7f24000c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23feffd700 1 -- 172.21.15.163:0/3293132995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f240015da20 msgr2=0x7f24000afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23feffd700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f240015da20 0x7f24000afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23feffd700 1 -- 172.21.15.163:0/3293132995 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00094a0 con 0x7f24000cb1e0 2023-10-16T20:06:07.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.808+0000 7f23fe7fc700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 0x7f24000c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:07.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f23feffd700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24000cb1e0 0x7f240006d490 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23f0016000 tx=0x7f23f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:07.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0004590 con 0x7f24000cb1e0 2023-10-16T20:06:07.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f001e070 con 0x7f24000cb1e0 2023-10-16T20:06:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24001f3c10 con 0x7f24000cb1e0 2023-10-16T20:06:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00038e0 con 0x7f24000cb1e0 2023-10-16T20:06:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24000addd0 con 0x7f24000cb1e0 2023-10-16T20:06:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f23f0003d40 con 0x7f24000cb1e0 2023-10-16T20:06:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.809+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f23f001ad80 con 0x7f24000cb1e0 2023-10-16T20:06:07.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.810+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24000ac8c0 con 0x7f24000cb1e0 2023-10-16T20:06:07.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.814+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f24000ac8c0 con 0x7f24000cb1e0 2023-10-16T20:06:07.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.897+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7ce383b-acb4-41b6-99c9-7e61339ea9a2", "id": 0} v 0) v1 -- 0x7f240004ebb0 con 0x7f24000cb1e0 2023-10-16T20:06:07.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.900+0000 7f23e77fe700 1 -- 172.21.15.163:0/3293132995 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ce383b-acb4-41b6-99c9-7e61339ea9a2", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f23f0020070 con 0x7f24000cb1e0 2023-10-16T20:06:07.902 INFO:teuthology.orchestra.run.smithi163.stdout:0 2023-10-16T20:06:07.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24000cb1e0 msgr2=0x7f240006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:07.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24000cb1e0 0x7f240006d490 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23f0016000 tx=0x7f23f0004750 comp rx=0 tx=0).stop 2023-10-16T20:06:07.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 shutdown_connections 2023-10-16T20:06:07.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f240015da20 0x7f24000afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f24000cb1e0 0x7f240006d490 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 --2- 172.21.15.163:0/3293132995 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f24000ce820 0x7f24000c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:07.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 >> 172.21.15.163:0/3293132995 conn(0x7f24000b13e0 msgr2=0x7f24000cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:07.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 shutdown_connections 2023-10-16T20:06:07.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:07.901+0000 7f240569a700 1 -- 172.21.15.163:0/3293132995 wait complete. 2023-10-16T20:06:07.915 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new e4c825dd-51d9-4873-9de3-79aa63c86211 1 2023-10-16T20:06:08.029 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:08.027+0000 7fc286656200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T20:06:08.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.034+0000 7fa33dd43700 1 Processor -- start 2023-10-16T20:06:08.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.034+0000 7fa33dd43700 1 -- start start 2023-10-16T20:06:08.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa33dd43700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33806dcc0 0x7fa3380cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa33dd43700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380cba90 con 0x7fa33815a250 2023-10-16T20:06:08.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa33dd43700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33815ee40 con 0x7fa33815dec0 2023-10-16T20:06:08.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa33dd43700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cb510 con 0x7fa33806dcc0 2023-10-16T20:06:08.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa337fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33806dcc0 0x7fa3380cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa336ffd700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fa33815dec0 0x7fa33806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:47870/0 (socket says 172.21.15.163:47870) 2023-10-16T20:06:08.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa336ffd700 1 -- 172.21.15.163:0/4242327073 learned_addr learned my addr 172.21.15.163:0/4242327073 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-10-16T20:06:08.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa3367fc700 1 -- 172.21.15.163:0/4242327073 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50980681 0 0) 0x7fa33815ee40 con 0x7fa33815dec0 2023-10-16T20:06:08.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa3367fc700 1 -- 172.21.15.163:0/4242327073 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3200035b0 con 0x7fa33815dec0 2023-10-16T20:06:08.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa337fff700 1 -- 172.21.15.163:0/4242327073 >> v1:172.21.15.163:6789/0 conn(0x7fa33815dec0 legacy=0x7fa33806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa337fff700 1 -- 172.21.15.163:0/4242327073 >> v1:172.21.15.152:6789/0 conn(0x7fa33815a250 legacy=0x7fa3380717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.035+0000 7fa337fff700 1 -- 172.21.15.163:0/4242327073 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33815e880 con 0x7fa33806dcc0 2023-10-16T20:06:08.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa337fff700 1 --2- 172.21.15.163:0/4242327073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33806dcc0 0x7fa3380cbf20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa330009dc0 tx=0x7fa33000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40135f7c6f785cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa3367fc700 1 -- 172.21.15.163:0/4242327073 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000e070 con 0x7fa33806dcc0 2023-10-16T20:06:08.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa3367fc700 1 -- 172.21.15.163:0/4242327073 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000bb20 con 0x7fa33806dcc0 2023-10-16T20:06:08.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa3367fc700 1 -- 172.21.15.163:0/4242327073 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330012430 con 0x7fa33806dcc0 2023-10-16T20:06:08.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa33dd43700 1 -- 172.21.15.163:0/4242327073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33806dcc0 msgr2=0x7fa3380cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa33dd43700 1 --2- 172.21.15.163:0/4242327073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33806dcc0 0x7fa3380cbf20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa330009dc0 tx=0x7fa33000b330 comp rx=0 tx=0).stop 2023-10-16T20:06:08.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa33dd43700 1 -- 172.21.15.163:0/4242327073 shutdown_connections 2023-10-16T20:06:08.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa33dd43700 1 --2- 172.21.15.163:0/4242327073 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33806dcc0 0x7fa3380cbf20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa33dd43700 1 -- 172.21.15.163:0/4242327073 >> 172.21.15.163:0/4242327073 conn(0x7fa3380ccbe0 msgr2=0x7fa3380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.036+0000 7fa33dd43700 1 -- 172.21.15.163:0/4242327073 shutdown_connections 2023-10-16T20:06:08.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.037+0000 7fa33dd43700 1 -- 172.21.15.163:0/4242327073 wait complete. 2023-10-16T20:06:08.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.038+0000 7fa33dd43700 1 Processor -- start 2023-10-16T20:06:08.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.038+0000 7fa33dd43700 1 -- start start 2023-10-16T20:06:08.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa33dd43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa33806dcc0 0x7fa3380c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa33dd43700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa33815a250 0x7fa33814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa33dd43700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33815dec0 0x7fa338158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa33dd43700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c9810 con 0x7fa33806dcc0 2023-10-16T20:06:08.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa33dd43700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c8b90 con 0x7fa33815a250 2023-10-16T20:06:08.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa33dd43700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c8e70 con 0x7fa33815dec0 2023-10-16T20:06:08.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa33815a250 0x7fa33814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa336ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa33815a250 0x7fa33814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46210/0 (socket says 172.21.15.163:46210) 2023-10-16T20:06:08.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa3377fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa33806dcc0 0x7fa3380c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa336ffd700 1 -- 172.21.15.163:0/1206112709 learned_addr learned my addr 172.21.15.163:0/1206112709 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:08.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33815dec0 0x7fa338158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 -- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa33815a250 msgr2=0x7fa33814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa33815a250 0x7fa33814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 -- 172.21.15.163:0/1206112709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa33806dcc0 msgr2=0x7fa3380c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa33806dcc0 0x7fa3380c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 -- 172.21.15.163:0/1206112709 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009a70 con 0x7fa33815dec0 2023-10-16T20:06:08.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa3377fe700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa33806dcc0 0x7fa3380c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:08.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa337fff700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33815dec0 0x7fa338158060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa330016000 tx=0x7fa330004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.039+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330012430 con 0x7fa33815dec0 2023-10-16T20:06:08.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.040+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330020070 con 0x7fa33815dec0 2023-10-16T20:06:08.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.040+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3380c9150 con 0x7fa33815dec0 2023-10-16T20:06:08.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.040+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330004280 con 0x7fa33815dec0 2023-10-16T20:06:08.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.040+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33814fac0 con 0x7fa33815dec0 2023-10-16T20:06:08.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.040+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa3300046e0 con 0x7fa33815dec0 2023-10-16T20:06:08.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.040+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa330022070 con 0x7fa33815dec0 2023-10-16T20:06:08.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.041+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33814fc50 con 0x7fa33815dec0 2023-10-16T20:06:08.050 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:08.042+0000 7f8fdb386200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T20:06:08.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.044+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa330046b40 con 0x7fa33815dec0 2023-10-16T20:06:08.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.128+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e4c825dd-51d9-4873-9de3-79aa63c86211", "id": 1} v 0) v1 -- 0x7fa3380c8fb0 con 0x7fa33815dec0 2023-10-16T20:06:08.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.139+0000 7fa31ffff700 1 -- 172.21.15.163:0/1206112709 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4c825dd-51d9-4873-9de3-79aa63c86211", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3380c8fb0 con 0x7fa33815dec0 2023-10-16T20:06:08.141 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-10-16T20:06:08.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33815dec0 msgr2=0x7fa338158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33815dec0 0x7fa338158060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa330016000 tx=0x7fa330004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 shutdown_connections 2023-10-16T20:06:08.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa33815dec0 0x7fa338158060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa33806dcc0 0x7fa3380c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 --2- 172.21.15.163:0/1206112709 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa33815a250 0x7fa33814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 >> 172.21.15.163:0/1206112709 conn(0x7fa3380ccbe0 msgr2=0x7fa33806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 shutdown_connections 2023-10-16T20:06:08.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.140+0000 7fa33dd43700 1 -- 172.21.15.163:0/1206112709 wait complete. 2023-10-16T20:06:08.148 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:08.146+0000 7fc286656200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T20:06:08.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 13f9db58-f545-4780-9174-8784d4a7df2e 2 2023-10-16T20:06:08.171 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:08.169+0000 7f8fdb386200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T20:06:08.240 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:08.238+0000 7fc286656200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T20:06:08.266 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:08.264+0000 7f8fdb386200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T20:06:08.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.274+0000 7f5c3e298700 1 Processor -- start 2023-10-16T20:06:08.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.274+0000 7f5c3e298700 1 -- start start 2023-10-16T20:06:08.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c3e298700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5c380cd2d0 0x7f5c3815e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c3e298700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3815eb30 con 0x7f5c380d0d60 2023-10-16T20:06:08.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c3e298700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c380d1200 con 0x7f5c380ce380 2023-10-16T20:06:08.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c3e298700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c380d1e80 con 0x7f5c380cd2d0 2023-10-16T20:06:08.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c3c835700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5c380ce380 0x7f5c380cb8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:47886/0 (socket says 172.21.15.163:47886) 2023-10-16T20:06:08.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c3c835700 1 -- 172.21.15.163:0/1245769827 learned_addr learned my addr 172.21.15.163:0/1245769827 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-10-16T20:06:08.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.275+0000 7f5c37fff700 1 --2- 172.21.15.163:0/1245769827 >> v2:172.21.15.152:3300/0 conn(0x7f5c380cd2d0 0x7f5c3815e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c36ffd700 1 -- 172.21.15.163:0/1245769827 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456813960 0 0) 0x7f5c380d1200 con 0x7f5c380ce380 2023-10-16T20:06:08.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c36ffd700 1 -- 172.21.15.163:0/1245769827 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c240035b0 con 0x7f5c380ce380 2023-10-16T20:06:08.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c37fff700 1 -- 172.21.15.163:0/1245769827 >> v1:172.21.15.163:6789/0 conn(0x7f5c380ce380 legacy=0x7f5c380cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c37fff700 1 -- 172.21.15.163:0/1245769827 >> v1:172.21.15.152:6789/0 conn(0x7f5c380d0d60 legacy=0x7f5c380cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c37fff700 1 -- 172.21.15.163:0/1245769827 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380d14e0 con 0x7f5c380cd2d0 2023-10-16T20:06:08.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c37fff700 1 --2- 172.21.15.163:0/1245769827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380cd2d0 0x7f5c3815e5f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009840 tx=0x7f5c20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9242ab96e5164038 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c36ffd700 1 -- 172.21.15.163:0/1245769827 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c20011830 con 0x7f5c380cd2d0 2023-10-16T20:06:08.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c36ffd700 1 -- 172.21.15.163:0/1245769827 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20011990 con 0x7f5c380cd2d0 2023-10-16T20:06:08.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.276+0000 7f5c36ffd700 1 -- 172.21.15.163:0/1245769827 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c20011d20 con 0x7f5c380cd2d0 2023-10-16T20:06:08.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 -- 172.21.15.163:0/1245769827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380cd2d0 msgr2=0x7f5c3815e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 --2- 172.21.15.163:0/1245769827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380cd2d0 0x7f5c3815e5f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009840 tx=0x7f5c20009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:08.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 -- 172.21.15.163:0/1245769827 shutdown_connections 2023-10-16T20:06:08.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 --2- 172.21.15.163:0/1245769827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380cd2d0 0x7f5c3815e5f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 -- 172.21.15.163:0/1245769827 >> 172.21.15.163:0/1245769827 conn(0x7f5c3806a820 msgr2=0x7f5c3806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 -- 172.21.15.163:0/1245769827 shutdown_connections 2023-10-16T20:06:08.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.277+0000 7f5c3e298700 1 -- 172.21.15.163:0/1245769827 wait complete. 2023-10-16T20:06:08.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.278+0000 7f5c3e298700 1 Processor -- start 2023-10-16T20:06:08.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.278+0000 7f5c3e298700 1 -- start start 2023-10-16T20:06:08.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3e298700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 0x7f5c38153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3e298700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380ce380 0x7f5c3815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3e298700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 0x7f5c3815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3e298700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38154db0 con 0x7f5c380ce380 2023-10-16T20:06:08.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3e298700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c381527b0 con 0x7f5c380d0d60 2023-10-16T20:06:08.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3e298700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38152a90 con 0x7f5c380cd2d0 2023-10-16T20:06:08.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 0x7f5c3815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c37fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 0x7f5c38153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 0x7f5c3815c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46224/0 (socket says 172.21.15.163:46224) 2023-10-16T20:06:08.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c37fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 0x7f5c38153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44598/0 (socket says 172.21.15.163:44598) 2023-10-16T20:06:08.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 -- 172.21.15.163:0/476630883 learned_addr learned my addr 172.21.15.163:0/476630883 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:08.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c377fe700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380ce380 0x7f5c3815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 -- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 msgr2=0x7f5c38153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 0x7f5c38153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 -- 172.21.15.163:0/476630883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380ce380 msgr2=0x7f5c3815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380ce380 0x7f5c3815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c3c835700 1 -- 172.21.15.163:0/476630883 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200094a0 con 0x7f5c380d0d60 2023-10-16T20:06:08.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c37fff700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 0x7f5c38153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:08.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.279+0000 7f5c377fe700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380ce380 0x7f5c3815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:08.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.280+0000 7f5c3c835700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 0x7f5c3815c020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000cbb0 tx=0x7f5c3000cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.280+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000a9e0 con 0x7f5c380d0d60 2023-10-16T20:06:08.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.280+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000ab40 con 0x7f5c380d0d60 2023-10-16T20:06:08.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.280+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c38152d70 con 0x7f5c380d0d60 2023-10-16T20:06:08.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.280+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30012400 con 0x7f5c380d0d60 2023-10-16T20:06:08.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.280+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c381552e0 con 0x7f5c380d0d60 2023-10-16T20:06:08.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.281+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5c30012560 con 0x7f5c380d0d60 2023-10-16T20:06:08.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.281+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5c3001ca40 con 0x7f5c380d0d60 2023-10-16T20:06:08.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.281+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c380d1a50 con 0x7f5c380d0d60 2023-10-16T20:06:08.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.283+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5c30021060 con 0x7f5c380d0d60 2023-10-16T20:06:08.322 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:08.319+0000 7fc286656200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T20:06:08.353 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:08.351+0000 7f8fdb386200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T20:06:08.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.366+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "13f9db58-f545-4780-9174-8784d4a7df2e", "id": 2} v 0) v1 -- 0x7f5c380cf070 con 0x7f5c380d0d60 2023-10-16T20:06:08.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.372+0000 7f5c34ff9700 1 -- 172.21.15.163:0/476630883 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13f9db58-f545-4780-9174-8784d4a7df2e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5c30017070 con 0x7f5c380d0d60 2023-10-16T20:06:08.374 INFO:teuthology.orchestra.run.smithi163.stdout:2 2023-10-16T20:06:08.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 msgr2=0x7f5c3815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 0x7f5c3815c020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000cbb0 tx=0x7f5c3000cec0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 shutdown_connections 2023-10-16T20:06:08.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5c380cd2d0 0x7f5c38153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c380d0d60 0x7f5c3815c020 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 --2- 172.21.15.163:0/476630883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c380ce380 0x7f5c3815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 >> 172.21.15.163:0/476630883 conn(0x7f5c3806a820 msgr2=0x7f5c3806c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 shutdown_connections 2023-10-16T20:06:08.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.373+0000 7f5c3e298700 1 -- 172.21.15.163:0/476630883 wait complete. 2023-10-16T20:06:08.387 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 04a7fc4a-a60f-4072-8699-30abcad52642 3 2023-10-16T20:06:08.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.548+0000 7fb8974eb700 1 Processor -- start 2023-10-16T20:06:08.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.548+0000 7fb8974eb700 1 -- start start 2023-10-16T20:06:08.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb8974eb700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb8900cd2d0 0x7fb89015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb8974eb700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb8900ce380 0x7fb8900cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb8974eb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89015eb30 con 0x7fb8900d0d60 2023-10-16T20:06:08.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb8974eb700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900d1e80 con 0x7fb8900cd2d0 2023-10-16T20:06:08.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb8974eb700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900d1200 con 0x7fb8900ce380 2023-10-16T20:06:08.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb8900ce380 0x7fb8900cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb8900ce380 0x7fb8900cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46228/0 (socket says 172.21.15.163:46228) 2023-10-16T20:06:08.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 -- 172.21.15.163:0/4232356023 learned_addr learned my addr 172.21.15.163:0/4232356023 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:08.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895287700 1 --2- 172.21.15.163:0/4232356023 >> v2:172.21.15.152:3300/0 conn(0x7fb8900cd2d0 0x7fb89015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 -- 172.21.15.163:0/4232356023 >> v2:172.21.15.152:3300/0 conn(0x7fb8900cd2d0 msgr2=0x7fb89015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:08.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 --2- 172.21.15.163:0/4232356023 >> v2:172.21.15.152:3300/0 conn(0x7fb8900cd2d0 0x7fb89015e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 -- 172.21.15.163:0/4232356023 >> v1:172.21.15.152:6789/0 conn(0x7fb8900d0d60 legacy=0x7fb8900cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.549+0000 7fb895a88700 1 -- 172.21.15.163:0/4232356023 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900d14e0 con 0x7fb8900ce380 2023-10-16T20:06:08.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb895a88700 1 --2- 172.21.15.163:0/4232356023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900ce380 0x7fb8900cb8d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb8900d05c0 tx=0x7fb88800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff1386abb992c980 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb887fff700 1 -- 172.21.15.163:0/4232356023 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800e070 con 0x7fb8900ce380 2023-10-16T20:06:08.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb887fff700 1 -- 172.21.15.163:0/4232356023 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88800b910 con 0x7fb8900ce380 2023-10-16T20:06:08.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb887fff700 1 -- 172.21.15.163:0/4232356023 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800bcc0 con 0x7fb8900ce380 2023-10-16T20:06:08.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 -- 172.21.15.163:0/4232356023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900ce380 msgr2=0x7fb8900cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 --2- 172.21.15.163:0/4232356023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900ce380 0x7fb8900cb8d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb8900d05c0 tx=0x7fb88800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:08.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 -- 172.21.15.163:0/4232356023 shutdown_connections 2023-10-16T20:06:08.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 --2- 172.21.15.163:0/4232356023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900ce380 0x7fb8900cb8d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 --2- 172.21.15.163:0/4232356023 >> v2:172.21.15.152:3300/0 conn(0x7fb8900cd2d0 0x7fb89015e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 -- 172.21.15.163:0/4232356023 >> 172.21.15.163:0/4232356023 conn(0x7fb89006a820 msgr2=0x7fb89006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 -- 172.21.15.163:0/4232356023 shutdown_connections 2023-10-16T20:06:08.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.550+0000 7fb8974eb700 1 -- 172.21.15.163:0/4232356023 wait complete. 2023-10-16T20:06:08.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 Processor -- start 2023-10-16T20:06:08.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 -- start start 2023-10-16T20:06:08.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 0x7fb890158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8900ce380 0x7fb89006c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8900d0d60 0x7fb89006cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8901f3e60 con 0x7fb8900ce380 2023-10-16T20:06:08.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900c7af0 con 0x7fb8900cd2d0 2023-10-16T20:06:08.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb8974eb700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8901f31e0 con 0x7fb8900d0d60 2023-10-16T20:06:08.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb895287700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 0x7fb890158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb895287700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 0x7fb890158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46230/0 (socket says 172.21.15.163:46230) 2023-10-16T20:06:08.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb895287700 1 -- 172.21.15.163:0/2391796869 learned_addr learned my addr 172.21.15.163:0/2391796869 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:08.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb894a86700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8900ce380 0x7fb89006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.552+0000 7fb895a88700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8900d0d60 0x7fb89006cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb895287700 1 -- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8900d0d60 msgr2=0x7fb89006cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb895287700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8900d0d60 0x7fb89006cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb895287700 1 -- 172.21.15.163:0/2391796869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8900ce380 msgr2=0x7fb89006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb895287700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8900ce380 0x7fb89006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb895287700 1 -- 172.21.15.163:0/2391796869 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888009b30 con 0x7fb8900cd2d0 2023-10-16T20:06:08.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb894a86700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8900ce380 0x7fb89006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:08.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb895287700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 0x7fb890158bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb88000e9b0 tx=0x7fb88000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880009710 con 0x7fb8900cd2d0 2023-10-16T20:06:08.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88000ee50 con 0x7fb8900cd2d0 2023-10-16T20:06:08.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8901f34c0 con 0x7fb8900cd2d0 2023-10-16T20:06:08.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000ca50 con 0x7fb8900cd2d0 2023-10-16T20:06:08.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.553+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8901f3a80 con 0x7fb8900cd2d0 2023-10-16T20:06:08.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.554+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb880005a20 con 0x7fb8900cd2d0 2023-10-16T20:06:08.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.554+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb880005cd0 con 0x7fb8900cd2d0 2023-10-16T20:06:08.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.554+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89004ebb0 con 0x7fb8900cd2d0 2023-10-16T20:06:08.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.556+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb880021060 con 0x7fb8900cd2d0 2023-10-16T20:06:08.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.638+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04a7fc4a-a60f-4072-8699-30abcad52642", "id": 3} v 0) v1 -- 0x7fb8900b36e0 con 0x7fb8900cd2d0 2023-10-16T20:06:08.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.644+0000 7fb885ffb700 1 -- 172.21.15.163:0/2391796869 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04a7fc4a-a60f-4072-8699-30abcad52642", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb880029020 con 0x7fb8900cd2d0 2023-10-16T20:06:08.646 INFO:teuthology.orchestra.run.smithi163.stdout:3 2023-10-16T20:06:08.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 msgr2=0x7fb890158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 0x7fb890158bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb88000e9b0 tx=0x7fb88000ecc0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 shutdown_connections 2023-10-16T20:06:08.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb8900d0d60 0x7fb89006cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8900cd2d0 0x7fb890158bb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 --2- 172.21.15.163:0/2391796869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8900ce380 0x7fb89006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 >> 172.21.15.163:0/2391796869 conn(0x7fb89006a820 msgr2=0x7fb89015b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 shutdown_connections 2023-10-16T20:06:08.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.645+0000 7fb8974eb700 1 -- 172.21.15.163:0/2391796869 wait complete. 2023-10-16T20:06:08.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 3c1c90aa-09ab-4ea3-8709-5134d14820b6 4 2023-10-16T20:06:08.762 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:08.759+0000 7fc286656200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T20:06:08.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.778+0000 7f38cb9df700 1 Processor -- start 2023-10-16T20:06:08.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.778+0000 7f38cb9df700 1 -- start start 2023-10-16T20:06:08.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38cb9df700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 0x7f38c40caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38cb9df700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38c40cb1e0 0x7f38c40ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38cb9df700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c40ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38cb9df700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c40cc1e0 con 0x7f38c40cb1e0 2023-10-16T20:06:08.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38cb9df700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c415de00 con 0x7f38c415da20 2023-10-16T20:06:08.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38cb9df700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40cb660 con 0x7f38c4066940 2023-10-16T20:06:08.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c977b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 0x7f38c40caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c40ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c40ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44618/0 (socket says 172.21.15.163:44618) 2023-10-16T20:06:08.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c977b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 0x7f38c40caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46236/0 (socket says 172.21.15.163:46236) 2023-10-16T20:06:08.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 -- 172.21.15.163:0/1768441269 learned_addr learned my addr 172.21.15.163:0/1768441269 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:08.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c8f7a700 1 --2- 172.21.15.163:0/1768441269 >> v2:172.21.15.152:3300/0 conn(0x7f38c40cb1e0 0x7f38c40ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 -- 172.21.15.163:0/1768441269 >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 msgr2=0x7f38c40caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:08.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 --2- 172.21.15.163:0/1768441269 >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 0x7f38c40caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 -- 172.21.15.163:0/1768441269 >> v2:172.21.15.152:3300/0 conn(0x7f38c40cb1e0 msgr2=0x7f38c40ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:08.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 --2- 172.21.15.163:0/1768441269 >> v2:172.21.15.152:3300/0 conn(0x7f38c40cb1e0 0x7f38c40ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 -- 172.21.15.163:0/1768441269 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40cb940 con 0x7f38c4066940 2023-10-16T20:06:08.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c977b700 1 --2- 172.21.15.163:0/1768441269 >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 0x7f38c40caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:08.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38c9f7c700 1 --2- 172.21.15.163:0/1768441269 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c40ce650 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009e50 tx=0x7f38bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6870f54e7e2fc791 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38bbfff700 1 -- 172.21.15.163:0/1768441269 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00e070 con 0x7f38c4066940 2023-10-16T20:06:08.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38bbfff700 1 -- 172.21.15.163:0/1768441269 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00b8d0 con 0x7f38c4066940 2023-10-16T20:06:08.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.779+0000 7f38bbfff700 1 -- 172.21.15.163:0/1768441269 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00bc80 con 0x7f38c4066940 2023-10-16T20:06:08.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 -- 172.21.15.163:0/1768441269 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 msgr2=0x7f38c40ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1768441269 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c40ce650 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009e50 tx=0x7f38bc00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:08.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 -- 172.21.15.163:0/1768441269 shutdown_connections 2023-10-16T20:06:08.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1768441269 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c40ce650 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1768441269 >> v2:172.21.15.163:3300/0 conn(0x7f38c415da20 0x7f38c40caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1768441269 >> v2:172.21.15.152:3300/0 conn(0x7f38c40cb1e0 0x7f38c40ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 -- 172.21.15.163:0/1768441269 >> 172.21.15.163:0/1768441269 conn(0x7f38c40b13e0 msgr2=0x7f38c40b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 -- 172.21.15.163:0/1768441269 shutdown_connections 2023-10-16T20:06:08.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.780+0000 7f38cb9df700 1 -- 172.21.15.163:0/1768441269 wait complete. 2023-10-16T20:06:08.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.781+0000 7f38cb9df700 1 Processor -- start 2023-10-16T20:06:08.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.781+0000 7f38cb9df700 1 -- start start 2023-10-16T20:06:08.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38cb9df700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38cb9df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 0x7f38c4071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38cb9df700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38c415da20 0x7f38c40719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:08.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38cb9df700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c414f5e0 con 0x7f38c415da20 2023-10-16T20:06:08.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38cb9df700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c8700 con 0x7f38c40cb1e0 2023-10-16T20:06:08.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38cb9df700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c8950 con 0x7f38c4066940 2023-10-16T20:06:08.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c8f7a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 0x7f38c4071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c977b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c8f7a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 0x7f38c4071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46242/0 (socket says 172.21.15.163:46242) 2023-10-16T20:06:08.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c8f7a700 1 -- 172.21.15.163:0/1195077165 learned_addr learned my addr 172.21.15.163:0/1195077165 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:08.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c9f7c700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38c415da20 0x7f38c40719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:08.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c977b700 1 -- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 msgr2=0x7f38c4071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c977b700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 0x7f38c4071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c977b700 1 -- 172.21.15.163:0/1195077165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38c415da20 msgr2=0x7f38c40719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.782+0000 7f38c977b700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38c415da20 0x7f38c40719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38c977b700 1 -- 172.21.15.163:0/1195077165 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00094a0 con 0x7f38c4066940 2023-10-16T20:06:08.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38c8f7a700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 0x7f38c4071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:08.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38c977b700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c414f0a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f38c000e900 tx=0x7f38c000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:08.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0013680 con 0x7f38c4066940 2023-10-16T20:06:08.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00137e0 con 0x7f38c4066940 2023-10-16T20:06:08.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc009b30 con 0x7f38c4066940 2023-10-16T20:06:08.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0013b70 con 0x7f38c4066940 2023-10-16T20:06:08.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c40c8f10 con 0x7f38c4066940 2023-10-16T20:06:08.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f38c0005a20 con 0x7f38c4066940 2023-10-16T20:06:08.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.783+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f38c00067a0 con 0x7f38c4066940 2023-10-16T20:06:08.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.784+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c404ebb0 con 0x7f38c4066940 2023-10-16T20:06:08.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.786+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f38c0021060 con 0x7f38c4066940 2023-10-16T20:06:08.838 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:08.836+0000 7f8fdb386200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T20:06:08.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.872+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3c1c90aa-09ab-4ea3-8709-5134d14820b6", "id": 4} v 0) v1 -- 0x7f38c406c140 con 0x7f38c4066940 2023-10-16T20:06:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.878+0000 7f38b9ffb700 1 -- 172.21.15.163:0/1195077165 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c1c90aa-09ab-4ea3-8709-5134d14820b6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f38c0017070 con 0x7f38c4066940 2023-10-16T20:06:08.880 INFO:teuthology.orchestra.run.smithi163.stdout:4 2023-10-16T20:06:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 msgr2=0x7f38c414f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c414f0a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f38c000e900 tx=0x7f38c000ec10 comp rx=0 tx=0).stop 2023-10-16T20:06:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 shutdown_connections 2023-10-16T20:06:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f38c4066940 0x7f38c414f0a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38c415da20 0x7f38c40719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 --2- 172.21.15.163:0/1195077165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38c40cb1e0 0x7f38c4071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 >> 172.21.15.163:0/1195077165 conn(0x7f38c40b13e0 msgr2=0x7f38c415ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 shutdown_connections 2023-10-16T20:06:08.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:08.879+0000 7f38cb9df700 1 -- 172.21.15.163:0/1195077165 wait complete. 2023-10-16T20:06:08.894 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 618eed1e-d3d2-43e9-b08d-5d9bc04029e2 5 2023-10-16T20:06:09.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.014+0000 7fc82359e700 1 Processor -- start 2023-10-16T20:06:09.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.014+0000 7fc82359e700 1 -- start start 2023-10-16T20:06:09.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82359e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 0x7fc82415b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82359e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc824071720 0x7fc824071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82359e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc8240ca6f0 0x7fc8240cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82359e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8240720c0 con 0x7fc824071720 2023-10-16T20:06:09.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82359e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82415b670 con 0x7fc8240ca6f0 2023-10-16T20:06:09.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82359e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82415e000 con 0x7fc824157c20 2023-10-16T20:06:09.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82259c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 0x7fc82415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc8240ca6f0 0x7fc8240cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82259c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 0x7fc82415b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44626/0 (socket says 172.21.15.163:44626) 2023-10-16T20:06:09.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc8240ca6f0 0x7fc8240cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:46252/0 (socket says 172.21.15.163:46252) 2023-10-16T20:06:09.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82259c700 1 -- 172.21.15.163:0/2078281727 learned_addr learned my addr 172.21.15.163:0/2078281727 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:09.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc821d9b700 1 --2- 172.21.15.163:0/2078281727 >> v2:172.21.15.152:3300/0 conn(0x7fc824071720 0x7fc824071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 -- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 msgr2=0x7fc82415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:09.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 --2- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 0x7fc82415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 -- 172.21.15.163:0/2078281727 >> v2:172.21.15.152:3300/0 conn(0x7fc824071720 msgr2=0x7fc824071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:09.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 --2- 172.21.15.163:0/2078281727 >> v2:172.21.15.152:3300/0 conn(0x7fc824071720 0x7fc824071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc822d9d700 1 -- 172.21.15.163:0/2078281727 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82415e2e0 con 0x7fc8240ca6f0 2023-10-16T20:06:09.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.015+0000 7fc82259c700 1 --2- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 0x7fc82415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:09.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc822d9d700 1 --2- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8240ca6f0 0x7fc8240cab80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc824072a30 tx=0x7fc81c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37cc5e15b56af0c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82159a700 1 -- 172.21.15.163:0/2078281727 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00e070 con 0x7fc8240ca6f0 2023-10-16T20:06:09.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82159a700 1 -- 172.21.15.163:0/2078281727 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00bb20 con 0x7fc8240ca6f0 2023-10-16T20:06:09.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82159a700 1 -- 172.21.15.163:0/2078281727 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012430 con 0x7fc8240ca6f0 2023-10-16T20:06:09.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 -- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8240ca6f0 msgr2=0x7fc8240cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 --2- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8240ca6f0 0x7fc8240cab80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc824072a30 tx=0x7fc81c00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:09.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 -- 172.21.15.163:0/2078281727 shutdown_connections 2023-10-16T20:06:09.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 --2- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824157c20 0x7fc82415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 --2- 172.21.15.163:0/2078281727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8240ca6f0 0x7fc8240cab80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 --2- 172.21.15.163:0/2078281727 >> v2:172.21.15.152:3300/0 conn(0x7fc824071720 0x7fc824071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 -- 172.21.15.163:0/2078281727 >> 172.21.15.163:0/2078281727 conn(0x7fc8240d00a0 msgr2=0x7fc8240d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 -- 172.21.15.163:0/2078281727 shutdown_connections 2023-10-16T20:06:09.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.016+0000 7fc82359e700 1 -- 172.21.15.163:0/2078281727 wait complete. 2023-10-16T20:06:09.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.018+0000 7fc82359e700 1 Processor -- start 2023-10-16T20:06:09.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.018+0000 7fc82359e700 1 -- start start 2023-10-16T20:06:09.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.018+0000 7fc82359e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824071720 0x7fc824150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8240ca6f0 0x7fc8240b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc824157c20 0x7fc8240b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824150ca0 con 0x7fc8240ca6f0 2023-10-16T20:06:09.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c8f40 con 0x7fc824157c20 2023-10-16T20:06:09.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c9220 con 0x7fc824071720 2023-10-16T20:06:09.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82259c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824071720 0x7fc824150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82259c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824071720 0x7fc824150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44632/0 (socket says 172.21.15.163:44632) 2023-10-16T20:06:09.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82259c700 1 -- 172.21.15.163:0/3863840057 learned_addr learned my addr 172.21.15.163:0/3863840057 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:09.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc824157c20 0x7fc8240b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc821d9b700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8240ca6f0 0x7fc8240b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 -- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824071720 msgr2=0x7fc824150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824071720 0x7fc824150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 -- 172.21.15.163:0/3863840057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8240ca6f0 msgr2=0x7fc8240b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8240ca6f0 0x7fc8240b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 -- 172.21.15.163:0/3863840057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814009550 con 0x7fc824157c20 2023-10-16T20:06:09.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc822d9d700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc824157c20 0x7fc8240b0dd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc81c016000 tx=0x7fc81c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c004800 con 0x7fc824157c20 2023-10-16T20:06:09.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c020070 con 0x7fc824157c20 2023-10-16T20:06:09.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c009a70 con 0x7fc824157c20 2023-10-16T20:06:09.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0276c0 con 0x7fc824157c20 2023-10-16T20:06:09.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8240c97e0 con 0x7fc824157c20 2023-10-16T20:06:09.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.019+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc81c027b20 con 0x7fc824157c20 2023-10-16T20:06:09.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.020+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc81c022070 con 0x7fc824157c20 2023-10-16T20:06:09.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.021+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82404ebb0 con 0x7fc824157c20 2023-10-16T20:06:09.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.023+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc81c003e30 con 0x7fc824157c20 2023-10-16T20:06:09.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.106+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "618eed1e-d3d2-43e9-b08d-5d9bc04029e2", "id": 5} v 0) v1 -- 0x7fc8240b6020 con 0x7fc824157c20 2023-10-16T20:06:09.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.115+0000 7fc812ffd700 1 -- 172.21.15.163:0/3863840057 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "618eed1e-d3d2-43e9-b08d-5d9bc04029e2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc81c012c80 con 0x7fc824157c20 2023-10-16T20:06:09.117 INFO:teuthology.orchestra.run.smithi163.stdout:5 2023-10-16T20:06:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc824157c20 msgr2=0x7fc8240b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc824157c20 0x7fc8240b0dd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc81c016000 tx=0x7fc81c004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 shutdown_connections 2023-10-16T20:06:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc824071720 0x7fc824150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc824157c20 0x7fc8240b0dd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 --2- 172.21.15.163:0/3863840057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8240ca6f0 0x7fc8240b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 >> 172.21.15.163:0/3863840057 conn(0x7fc8240d00a0 msgr2=0x7fc82406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 shutdown_connections 2023-10-16T20:06:09.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.117+0000 7fc82359e700 1 -- 172.21.15.163:0/3863840057 wait complete. 2023-10-16T20:06:09.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new f422d86a-0a3f-4f59-91d8-7c13f445e05f 6 2023-10-16T20:06:09.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.269+0000 7f4ee5d93700 1 Processor -- start 2023-10-16T20:06:09.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.269+0000 7f4ee5d93700 1 -- start start 2023-10-16T20:06:09.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4ee5d93700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00cec00 0x7f4ee00cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4ee5d93700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee00cefe0 con 0x7f4ee0165550 2023-10-16T20:06:09.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4ee5d93700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee0165a30 con 0x7f4ee00d04d0 2023-10-16T20:06:09.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4ee5d93700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0165d10 con 0x7f4ee00cec00 2023-10-16T20:06:09.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4edf7fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00cec00 0x7f4ee00cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4edffff700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f4ee00d04d0 0x7f4ee00d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:47932/0 (socket says 172.21.15.163:47932) 2023-10-16T20:06:09.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4edffff700 1 -- 172.21.15.163:0/2724638177 learned_addr learned my addr 172.21.15.163:0/2724638177 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-10-16T20:06:09.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4edf7fe700 1 -- 172.21.15.163:0/2724638177 >> v1:172.21.15.163:6789/0 conn(0x7f4ee00d04d0 legacy=0x7f4ee00d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4edf7fe700 1 -- 172.21.15.163:0/2724638177 >> v1:172.21.15.152:6789/0 conn(0x7f4ee0165550 legacy=0x7f4ee00cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.270+0000 7f4edf7fe700 1 -- 172.21.15.163:0/2724638177 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0165ff0 con 0x7f4ee00cec00 2023-10-16T20:06:09.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.271+0000 7f4edf7fe700 1 --2- 172.21.15.163:0/2724638177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00cec00 0x7f4ee00cf8f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009dc0 tx=0x7f4ed800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ff6eca3f891021 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.271+0000 7f4ede7fc700 1 -- 172.21.15.163:0/2724638177 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800e070 con 0x7f4ee00cec00 2023-10-16T20:06:09.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.271+0000 7f4ede7fc700 1 -- 172.21.15.163:0/2724638177 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800bbd0 con 0x7f4ee00cec00 2023-10-16T20:06:09.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.271+0000 7f4ede7fc700 1 -- 172.21.15.163:0/2724638177 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8012430 con 0x7f4ee00cec00 2023-10-16T20:06:09.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 -- 172.21.15.163:0/2724638177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00cec00 msgr2=0x7f4ee00cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 --2- 172.21.15.163:0/2724638177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00cec00 0x7f4ee00cf8f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009dc0 tx=0x7f4ed800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:09.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 -- 172.21.15.163:0/2724638177 shutdown_connections 2023-10-16T20:06:09.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 --2- 172.21.15.163:0/2724638177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00cec00 0x7f4ee00cf8f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 -- 172.21.15.163:0/2724638177 >> 172.21.15.163:0/2724638177 conn(0x7f4ee0072340 msgr2=0x7f4ee0072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 -- 172.21.15.163:0/2724638177 shutdown_connections 2023-10-16T20:06:09.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.272+0000 7f4ee5d93700 1 -- 172.21.15.163:0/2724638177 wait complete. 2023-10-16T20:06:09.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.273+0000 7f4ee5d93700 1 Processor -- start 2023-10-16T20:06:09.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.274+0000 7f4ee5d93700 1 -- start start 2023-10-16T20:06:09.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.275+0000 7f4ee5d93700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ee00d04d0 0x7f4ee015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.275+0000 7f4ee5d93700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ee0165550 0x7f4ee00c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.275+0000 7f4ee5d93700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 0x7f4ee01eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.275+0000 7f4ee5d93700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee015f000 con 0x7f4ee00d04d0 2023-10-16T20:06:09.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.275+0000 7f4ee5d93700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00cc220 con 0x7f4ee0165550 2023-10-16T20:06:09.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.275+0000 7f4ee5d93700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee00cc500 con 0x7f4ee00ccd00 2023-10-16T20:06:09.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 0x7f4ee01eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ee00d04d0 0x7f4ee015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 0x7f4ee01eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44648/0 (socket says 172.21.15.163:44648) 2023-10-16T20:06:09.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 -- 172.21.15.163:0/709006768 learned_addr learned my addr 172.21.15.163:0/709006768 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:09.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edeffd700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ee0165550 0x7f4ee00c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 -- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ee0165550 msgr2=0x7f4ee00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ee0165550 0x7f4ee00c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 -- 172.21.15.163:0/709006768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ee00d04d0 msgr2=0x7f4ee015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ee00d04d0 0x7f4ee015c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 -- 172.21.15.163:0/709006768 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009a70 con 0x7f4ee00ccd00 2023-10-16T20:06:09.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edeffd700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ee0165550 0x7f4ee00c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:09.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4edffff700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 0x7f4ee01eb300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c500 tx=0x7f4ed000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.276+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005d70 con 0x7f4ee00ccd00 2023-10-16T20:06:09.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.277+0000 7f4ee5d93700 1 -- 172.21.15.163:0/709006768 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00cc7e0 con 0x7f4ee00ccd00 2023-10-16T20:06:09.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.277+0000 7f4ee5d93700 1 -- 172.21.15.163:0/709006768 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee01eb840 con 0x7f4ee00ccd00 2023-10-16T20:06:09.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.278+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00070d0 con 0x7f4ee00ccd00 2023-10-16T20:06:09.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.278+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0007460 con 0x7f4ee00ccd00 2023-10-16T20:06:09.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.278+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec00052f0 con 0x7f4ee00ccd00 2023-10-16T20:06:09.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.282+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ed001c440 con 0x7f4ee00ccd00 2023-10-16T20:06:09.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.282+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4ed001b9a0 con 0x7f4ee00ccd00 2023-10-16T20:06:09.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.282+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f4ed0017070 con 0x7f4ee00ccd00 2023-10-16T20:06:09.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.384+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f422d86a-0a3f-4f59-91d8-7c13f445e05f", "id": 6} v 0) v1 -- 0x7f4ec0005910 con 0x7f4ee00ccd00 2023-10-16T20:06:09.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.392+0000 7f4ec7fff700 1 -- 172.21.15.163:0/709006768 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f422d86a-0a3f-4f59-91d8-7c13f445e05f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ed001bc80 con 0x7f4ee00ccd00 2023-10-16T20:06:09.394 INFO:teuthology.orchestra.run.smithi163.stdout:6 2023-10-16T20:06:09.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 msgr2=0x7f4ee01eb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 0x7f4ee01eb300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c500 tx=0x7f4ed000c810 comp rx=0 tx=0).stop 2023-10-16T20:06:09.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 shutdown_connections 2023-10-16T20:06:09.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4ee00ccd00 0x7f4ee01eb300 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ee00d04d0 0x7f4ee015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 --2- 172.21.15.163:0/709006768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ee0165550 0x7f4ee00c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 >> 172.21.15.163:0/709006768 conn(0x7f4ee0072340 msgr2=0x7f4ee01623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 shutdown_connections 2023-10-16T20:06:09.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.393+0000 7f4ec5ffb700 1 -- 172.21.15.163:0/709006768 wait complete. 2023-10-16T20:06:09.398 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:09.394+0000 7fc286656200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T20:06:09.407 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new c8c2cce4-4ee2-4f49-a749-43e4b532c528 7 2023-10-16T20:06:09.466 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:09.464+0000 7fc286656200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T20:06:09.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.530+0000 7f89f41e0700 1 Processor -- start 2023-10-16T20:06:09.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.530+0000 7f89f41e0700 1 -- start start 2023-10-16T20:06:09.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f41e0700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f89ec15ed30 0x7f89ec15f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f41e0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec15fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f41e0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec0cad30 con 0x7f89ec06a820 2023-10-16T20:06:09.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f41e0700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0ca7b0 con 0x7f89ec15ed30 2023-10-16T20:06:09.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f41e0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0cb1c0 con 0x7f89ec15f6f0 2023-10-16T20:06:09.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f277d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec15fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f277d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec15fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44654/0 (socket says 172.21.15.163:44654) 2023-10-16T20:06:09.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f277d700 1 -- 172.21.15.163:0/3266129533 learned_addr learned my addr 172.21.15.163:0/3266129533 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f177b700 1 --2- 172.21.15.163:0/3266129533 >> v2:172.21.15.152:3300/0 conn(0x7f89ec15ed30 0x7f89ec15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f277d700 1 -- 172.21.15.163:0/3266129533 >> v2:172.21.15.152:3300/0 conn(0x7f89ec15ed30 msgr2=0x7f89ec15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.531+0000 7f89f277d700 1 --2- 172.21.15.163:0/3266129533 >> v2:172.21.15.152:3300/0 conn(0x7f89ec15ed30 0x7f89ec15f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f277d700 1 -- 172.21.15.163:0/3266129533 >> v1:172.21.15.152:6789/0 conn(0x7f89ec06a820 legacy=0x7f89ec06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f277d700 1 -- 172.21.15.163:0/3266129533 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec06df70 con 0x7f89ec15f6f0 2023-10-16T20:06:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f277d700 1 --2- 172.21.15.163:0/3266129533 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec15fb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009e50 tx=0x7f89e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df58bc93f829b45e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f0f7a700 1 -- 172.21.15.163:0/3266129533 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e400e070 con 0x7f89ec15f6f0 2023-10-16T20:06:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f0f7a700 1 -- 172.21.15.163:0/3266129533 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e400b910 con 0x7f89ec15f6f0 2023-10-16T20:06:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f0f7a700 1 -- 172.21.15.163:0/3266129533 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e400bcc0 con 0x7f89ec15f6f0 2023-10-16T20:06:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f41e0700 1 -- 172.21.15.163:0/3266129533 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 msgr2=0x7f89ec15fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3266129533 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec15fb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009e50 tx=0x7f89e400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f41e0700 1 -- 172.21.15.163:0/3266129533 shutdown_connections 2023-10-16T20:06:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3266129533 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec15fb80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3266129533 >> v2:172.21.15.152:3300/0 conn(0x7f89ec15ed30 0x7f89ec15f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.532+0000 7f89f41e0700 1 -- 172.21.15.163:0/3266129533 >> 172.21.15.163:0/3266129533 conn(0x7f89ec0ccbe0 msgr2=0x7f89ec0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.533+0000 7f89f41e0700 1 -- 172.21.15.163:0/3266129533 shutdown_connections 2023-10-16T20:06:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.533+0000 7f89f41e0700 1 -- 172.21.15.163:0/3266129533 wait complete. 2023-10-16T20:06:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.534+0000 7f89f41e0700 1 Processor -- start 2023-10-16T20:06:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.534+0000 7f89f41e0700 1 -- start start 2023-10-16T20:06:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.534+0000 7f89f41e0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ec06a820 0x7f89ec0a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.534+0000 7f89f41e0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec15ed30 0x7f89ec1e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f41e0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec1e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f41e0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec1f0560 con 0x7f89ec06a820 2023-10-16T20:06:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f41e0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec14c550 con 0x7f89ec15ed30 2023-10-16T20:06:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f41e0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec14c830 con 0x7f89ec15f6f0 2023-10-16T20:06:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec1e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f177b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec15ed30 0x7f89ec1e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec1e6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.163:44660/0 (socket says 172.21.15.163:44660) 2023-10-16T20:06:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 -- 172.21.15.163:0/3868734453 learned_addr learned my addr 172.21.15.163:0/3868734453 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-10-16T20:06:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f1f7c700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ec06a820 0x7f89ec0a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 -- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec15ed30 msgr2=0x7f89ec1e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec15ed30 0x7f89ec1e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 -- 172.21.15.163:0/3868734453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ec06a820 msgr2=0x7f89ec0a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ec06a820 0x7f89ec0a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 -- 172.21.15.163:0/3868734453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009b30 con 0x7f89ec15f6f0 2023-10-16T20:06:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f177b700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec15ed30 0x7f89ec1e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f277d700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec1e6f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0ca8f0 tx=0x7f89e4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4004800 con 0x7f89ec15f6f0 2023-10-16T20:06:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e4004960 con 0x7f89ec15f6f0 2023-10-16T20:06:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e401c680 con 0x7f89ec15f6f0 2023-10-16T20:06:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec14cb10 con 0x7f89ec15f6f0 2023-10-16T20:06:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.535+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec14d0d0 con 0x7f89ec15f6f0 2023-10-16T20:06:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.536+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f89e401cae0 con 0x7f89ec15f6f0 2023-10-16T20:06:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.536+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f89e40123f0 con 0x7f89ec15f6f0 2023-10-16T20:06:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.536+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec0b47f0 con 0x7f89ec15f6f0 2023-10-16T20:06:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.539+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f89e4044b40 con 0x7f89ec15f6f0 2023-10-16T20:06:09.560 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:09.558+0000 7f8fdb386200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T20:06:09.636 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:09.634+0000 7f8fdb386200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T20:06:09.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.635+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c8c2cce4-4ee2-4f49-a749-43e4b532c528", "id": 7} v 0) v1 -- 0x7f89ec0ca970 con 0x7f89ec15f6f0 2023-10-16T20:06:09.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.641+0000 7f89e27fc700 1 -- 172.21.15.163:0/3868734453 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8c2cce4-4ee2-4f49-a749-43e4b532c528", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89e4033070 con 0x7f89ec15f6f0 2023-10-16T20:06:09.643 INFO:teuthology.orchestra.run.smithi163.stdout:7 2023-10-16T20:06:09.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 msgr2=0x7f89ec1e6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec1e6f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0ca8f0 tx=0x7f89e4004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 shutdown_connections 2023-10-16T20:06:09.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f89ec15f6f0 0x7f89ec1e6f20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ec06a820 0x7f89ec0a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 --2- 172.21.15.163:0/3868734453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89ec15ed30 0x7f89ec1e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 >> 172.21.15.163:0/3868734453 conn(0x7f89ec0ccbe0 msgr2=0x7f89ec0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 shutdown_connections 2023-10-16T20:06:09.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-10-16T20:06:09.642+0000 7f89f41e0700 1 -- 172.21.15.163:0/3868734453 wait complete. 2023-10-16T20:06:09.656 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T20:06:09.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T20:06:09.658 INFO:tasks.ceph.osd.0:Started 2023-10-16T20:06:09.659 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T20:06:09.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T20:06:09.661 INFO:tasks.ceph.osd.1:Started 2023-10-16T20:06:09.661 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T20:06:09.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T20:06:09.664 INFO:tasks.ceph.osd.2:Started 2023-10-16T20:06:09.664 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T20:06:09.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T20:06:09.666 INFO:tasks.ceph.osd.3:Started 2023-10-16T20:06:09.667 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T20:06:09.667 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T20:06:09.669 INFO:tasks.ceph.osd.4:Started 2023-10-16T20:06:09.669 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T20:06:09.670 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T20:06:09.672 INFO:tasks.ceph.osd.5:Started 2023-10-16T20:06:09.672 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T20:06:09.672 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T20:06:09.674 INFO:tasks.ceph.osd.6:Started 2023-10-16T20:06:09.675 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T20:06:09.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T20:06:09.677 INFO:tasks.ceph.osd.7:Started 2023-10-16T20:06:09.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:09.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 Processor -- start 2023-10-16T20:06:09.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 -- start start 2023-10-16T20:06:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd940152470 0x7fd9400cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 0x7fd9400b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd9400b3240 0x7fd9400b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9400b36d0 con 0x7fd9400cb8d0 2023-10-16T20:06:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd940071200 con 0x7fd9400b3240 2023-10-16T20:06:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd94617f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd940070d70 con 0x7fd940152470 2023-10-16T20:06:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93effd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 0x7fd9400b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93effd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 0x7fd9400b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57704/0 (socket says 172.21.15.152:57704) 2023-10-16T20:06:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93effd700 1 -- 172.21.15.152:0/3650536409 learned_addr learned my addr 172.21.15.152:0/3650536409 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 --2- 172.21.15.152:0/3650536409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd940152470 0x7fd9400cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93ffff700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.163:3300/0 conn(0x7fd9400b3240 0x7fd9400b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 -- 172.21.15.152:0/3650536409 >> v2:172.21.15.163:3300/0 conn(0x7fd9400b3240 msgr2=0x7fd9400b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.163:3300/0 conn(0x7fd9400b3240 0x7fd9400b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 -- 172.21.15.152:0/3650536409 >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 msgr2=0x7fd9400b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 0x7fd9400b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 -- 172.21.15.152:0/3650536409 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940070440 con 0x7fd940152470 2023-10-16T20:06:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93ffff700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.163:3300/0 conn(0x7fd9400b3240 0x7fd9400b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93effd700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 0x7fd9400b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.815+0000 7fd93f7fe700 1 --2- 172.21.15.152:0/3650536409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd940152470 0x7fd9400cd570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd9400cb860 tx=0x7fd930009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a3ddb2f5d0b58dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd93e7fc700 1 -- 172.21.15.152:0/3650536409 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930011830 con 0x7fd940152470 2023-10-16T20:06:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd93e7fc700 1 -- 172.21.15.152:0/3650536409 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd930011990 con 0x7fd940152470 2023-10-16T20:06:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd93e7fc700 1 -- 172.21.15.152:0/3650536409 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930011d20 con 0x7fd940152470 2023-10-16T20:06:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 -- 172.21.15.152:0/3650536409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd940152470 msgr2=0x7fd9400cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 --2- 172.21.15.152:0/3650536409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd940152470 0x7fd9400cd570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd9400cb860 tx=0x7fd930009b20 comp rx=0 tx=0).stop 2023-10-16T20:06:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 -- 172.21.15.152:0/3650536409 shutdown_connections 2023-10-16T20:06:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 --2- 172.21.15.152:0/3650536409 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd940152470 0x7fd9400cd570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.163:3300/0 conn(0x7fd9400b3240 0x7fd9400b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 --2- 172.21.15.152:0/3650536409 >> v2:172.21.15.152:3300/0 conn(0x7fd9400cb8d0 0x7fd9400b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 -- 172.21.15.152:0/3650536409 >> 172.21.15.152:0/3650536409 conn(0x7fd9400cdd00 msgr2=0x7fd9400ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 -- 172.21.15.152:0/3650536409 shutdown_connections 2023-10-16T20:06:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.816+0000 7fd94617f700 1 -- 172.21.15.152:0/3650536409 wait complete. 2023-10-16T20:06:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.818+0000 7fd94617f700 1 Processor -- start 2023-10-16T20:06:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.818+0000 7fd94617f700 1 -- start start 2023-10-16T20:06:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd94617f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9400b3240 0x7fd9400a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd94617f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9400cb8d0 0x7fd9400caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd94617f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 0x7fd94015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:09.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd94617f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400caaf0 con 0x7fd940152470 2023-10-16T20:06:09.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd94617f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400c9f00 con 0x7fd9400b3240 2023-10-16T20:06:09.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd94617f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400ca150 con 0x7fd9400cb8d0 2023-10-16T20:06:09.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 0x7fd94015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 0x7fd94015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57712/0 (socket says 172.21.15.152:57712) 2023-10-16T20:06:09.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9400b3240 0x7fd9400a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 -- 172.21.15.152:0/896487323 learned_addr learned my addr 172.21.15.152:0/896487323 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:09.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93effd700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9400cb8d0 0x7fd9400caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:09.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 -- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9400cb8d0 msgr2=0x7fd9400caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9400cb8d0 0x7fd9400caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 -- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9400b3240 msgr2=0x7fd9400a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9400b3240 0x7fd9400a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 -- 172.21.15.152:0/896487323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938009a70 con 0x7fd940152470 2023-10-16T20:06:09.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93f7fe700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9400b3240 0x7fd9400a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:09.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.819+0000 7fd93ffff700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 0x7fd94015d290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd93800ef00 tx=0x7fd93800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:09.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938010040 con 0x7fd940152470 2023-10-16T20:06:09.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93800ba80 con 0x7fd940152470 2023-10-16T20:06:09.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd934009550 con 0x7fd940152470 2023-10-16T20:06:09.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93800be10 con 0x7fd940152470 2023-10-16T20:06:09.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9300094a0 con 0x7fd940152470 2023-10-16T20:06:09.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd938003d20 con 0x7fd940152470 2023-10-16T20:06:09.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.820+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd93801d410 con 0x7fd940152470 2023-10-16T20:06:09.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.821+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94004ebb0 con 0x7fd940152470 2023-10-16T20:06:09.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.825+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd938018030 con 0x7fd940152470 2023-10-16T20:06:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.894+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94006f630 con 0x7fd940152470 2023-10-16T20:06:09.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.895+0000 7fd927fff700 1 -- 172.21.15.152:0/896487323 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd938003fd0 con 0x7fd940152470 2023-10-16T20:06:09.898 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:09.898 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":10,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:09.637796+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:09.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 msgr2=0x7fd94015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:09.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 0x7fd94015d290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd93800ef00 tx=0x7fd93800b390 comp rx=0 tx=0).stop 2023-10-16T20:06:09.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 shutdown_connections 2023-10-16T20:06:09.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd940152470 0x7fd94015d290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9400b3240 0x7fd9400a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 --2- 172.21.15.152:0/896487323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9400cb8d0 0x7fd9400caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:09.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 >> 172.21.15.152:0/896487323 conn(0x7fd9400cdd00 msgr2=0x7fd94015f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:09.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 shutdown_connections 2023-10-16T20:06:09.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:09.896+0000 7fd94617f700 1 -- 172.21.15.152:0/896487323 wait complete. 2023-10-16T20:06:09.911 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T20:06:09.911 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T20:06:10.222 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:10.219+0000 7fc286656200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T20:06:10.280 INFO:tasks.ceph.osd.2.smithi152.stderr:2023-10-16T20:06:10.277+0000 7fa30839b640 -1 Falling back to public interface 2023-10-16T20:06:10.289 INFO:tasks.ceph.osd.0.smithi152.stderr:2023-10-16T20:06:10.286+0000 7f5299b60640 -1 Falling back to public interface 2023-10-16T20:06:10.290 INFO:tasks.ceph.osd.6.smithi163.stderr:2023-10-16T20:06:10.288+0000 7f8e290df640 -1 Falling back to public interface 2023-10-16T20:06:10.294 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-10-16T20:06:10.292+0000 7f31bc775640 -1 Falling back to public interface 2023-10-16T20:06:10.297 INFO:tasks.ceph.osd.1.smithi152.stderr:2023-10-16T20:06:10.294+0000 7f7d5021f640 -1 Falling back to public interface 2023-10-16T20:06:10.297 INFO:tasks.ceph.osd.3.smithi152.stderr:2023-10-16T20:06:10.294+0000 7fc5a4580640 -1 Falling back to public interface 2023-10-16T20:06:10.301 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:10.298+0000 7fc286656200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T20:06:10.302 INFO:tasks.ceph.osd.4.smithi163.stderr:2023-10-16T20:06:10.300+0000 7f98608e5640 -1 Falling back to public interface 2023-10-16T20:06:10.306 INFO:tasks.ceph.osd.7.smithi163.stderr:2023-10-16T20:06:10.304+0000 7fee6a548640 -1 Falling back to public interface 2023-10-16T20:06:10.379 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:10.377+0000 7f8fdb386200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T20:06:10.443 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:10.440+0000 7fc286656200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T20:06:10.458 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:10.455+0000 7f8fdb386200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T20:06:10.602 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:10.599+0000 7f8fdb386200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T20:06:10.680 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:10.677+0000 7fc286656200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T20:06:10.716 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:10.834 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.831+0000 7fe2b6267700 1 Processor -- start 2023-10-16T20:06:10.835 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.831+0000 7fe2b6267700 1 -- start start 2023-10-16T20:06:10.837 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2b6267700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe2b00cfdb0 0x7fe2b015c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:10.837 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2b6267700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cb9d0 0x7fe2b00cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:10.837 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2b6267700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b00d0240 con 0x7fe2b015c130 2023-10-16T20:06:10.838 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2b6267700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00ce470 con 0x7fe2b00cfdb0 2023-10-16T20:06:10.838 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2b6267700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00cc330 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.838 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2affff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe2b015c130 0x7fe2b00cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37912/0 (socket says 172.21.15.152:37912) 2023-10-16T20:06:10.838 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2affff700 1 -- 172.21.15.152:0/504452380 learned_addr learned my addr 172.21.15.152:0/504452380 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:10.838 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.832+0000 7fe2af7fe700 1 --2- 172.21.15.152:0/504452380 >> v2:172.21.15.163:3300/0 conn(0x7fe2b00cfdb0 0x7fe2b015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:10.839 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2b4804700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cb9d0 0x7fe2b00cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:10.839 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2aeffd700 1 -- 172.21.15.152:0/504452380 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843151079 0 0) 0x7fe2b00d0240 con 0x7fe2b015c130 2023-10-16T20:06:10.839 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2aeffd700 1 -- 172.21.15.152:0/504452380 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2980035b0 con 0x7fe2b015c130 2023-10-16T20:06:10.839 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2af7fe700 1 -- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cb9d0 msgr2=0x7fe2b00cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:10.839 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2af7fe700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cb9d0 0x7fe2b00cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.840 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2af7fe700 1 -- 172.21.15.152:0/504452380 >> v1:172.21.15.152:6789/0 conn(0x7fe2b015c130 legacy=0x7fe2b00cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:10.840 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2af7fe700 1 -- 172.21.15.152:0/504452380 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00ce690 con 0x7fe2b00cfdb0 2023-10-16T20:06:10.840 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2b4804700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cb9d0 0x7fe2b00cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:10.840 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2af7fe700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b00cfdb0 0x7fe2b015c510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009840 tx=0x7fe2a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862095ae7205e511 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:10.840 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2aeffd700 1 -- 172.21.15.152:0/504452380 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4011830 con 0x7fe2b00cfdb0 2023-10-16T20:06:10.841 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2aeffd700 1 -- 172.21.15.152:0/504452380 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4011990 con 0x7fe2b00cfdb0 2023-10-16T20:06:10.841 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.833+0000 7fe2aeffd700 1 -- 172.21.15.152:0/504452380 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4011d00 con 0x7fe2b00cfdb0 2023-10-16T20:06:10.841 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 -- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b00cfdb0 msgr2=0x7fe2b015c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:10.841 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b00cfdb0 0x7fe2b015c510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009840 tx=0x7fe2a4009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:10.842 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 -- 172.21.15.152:0/504452380 shutdown_connections 2023-10-16T20:06:10.842 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cb9d0 0x7fe2b00cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.843 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 --2- 172.21.15.152:0/504452380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b00cfdb0 0x7fe2b015c510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.843 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 -- 172.21.15.152:0/504452380 >> 172.21.15.152:0/504452380 conn(0x7fe2b006a820 msgr2=0x7fe2b006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:10.843 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 -- 172.21.15.152:0/504452380 shutdown_connections 2023-10-16T20:06:10.843 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.834+0000 7fe2b6267700 1 -- 172.21.15.152:0/504452380 wait complete. 2023-10-16T20:06:10.844 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:10.838+0000 7f8fdb386200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T20:06:10.846 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.835+0000 7fe2b6267700 1 Processor -- start 2023-10-16T20:06:10.847 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.835+0000 7fe2b6267700 1 -- start start 2023-10-16T20:06:10.847 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b6267700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 0x7fe2b0152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:10.847 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b6267700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cfdb0 0x7fe2b01476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:10.847 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b6267700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b015c130 0x7fe2b006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:10.847 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b6267700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b006ccc0 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.847 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b6267700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b006c0b0 con 0x7fe2b015c130 2023-10-16T20:06:10.848 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b6267700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b006c390 con 0x7fe2b00cfdb0 2023-10-16T20:06:10.848 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 0x7fe2b0152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:10.848 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 0x7fe2b0152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57720/0 (socket says 172.21.15.152:57720) 2023-10-16T20:06:10.848 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 -- 172.21.15.152:0/3362740599 learned_addr learned my addr 172.21.15.152:0/3362740599 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:10.848 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2af7fe700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cfdb0 0x7fe2b01476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:10.849 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2b4804700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b015c130 0x7fe2b006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:10.849 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 -- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cfdb0 msgr2=0x7fe2b01476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:10.849 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cfdb0 0x7fe2b01476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.849 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 -- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b015c130 msgr2=0x7fe2b006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:10.849 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b015c130 0x7fe2b006d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.850 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.836+0000 7fe2affff700 1 -- 172.21.15.152:0/3362740599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8009a70 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.850 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2affff700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 0x7fe2b0152af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c4d0 tx=0x7fe2a000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:10.850 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0005d70 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.850 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a00070d0 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.850 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a40094a0 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0007440 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b006c950 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe2a001c440 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.837+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe2a0012ad0 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.838+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b00b7390 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.843+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe2a0021060 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.902 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:10.899+0000 7fc286656200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T20:06:10.915 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.913+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2b006cfa0 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.916 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.914+0000 7fe2acff9700 1 -- 172.21.15.152:0/3362740599 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe2a0017070 con 0x7fe2b00cb9d0 2023-10-16T20:06:10.917 INFO:teuthology.misc.health.smithi152.stdout: 2023-10-16T20:06:10.917 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":10,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:09.637796+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:10.918 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 msgr2=0x7fe2b0152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:10.918 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 0x7fe2b0152af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c4d0 tx=0x7fe2a000c7e0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.918 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 shutdown_connections 2023-10-16T20:06:10.918 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2b015c130 0x7fe2b006d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.919 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b00cb9d0 0x7fe2b0152af0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.919 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 --2- 172.21.15.152:0/3362740599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe2b00cfdb0 0x7fe2b01476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:10.919 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 >> 172.21.15.152:0/3362740599 conn(0x7fe2b006a820 msgr2=0x7fe2b015cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:10.919 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 shutdown_connections 2023-10-16T20:06:10.919 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:10.915+0000 7fe2b6267700 1 -- 172.21.15.152:0/3362740599 wait complete. 2023-10-16T20:06:10.928 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T20:06:11.037 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:11.034+0000 7fc286656200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T20:06:11.054 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:11.053+0000 7f8fdb386200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T20:06:11.192 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:11.190+0000 7f8fdb386200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T20:06:11.257 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:11.256+0000 7fc286656200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T20:06:11.414 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:11.412+0000 7f8fdb386200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T20:06:11.415 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:11.413+0000 7fc286656200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T20:06:11.529 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:11.527+0000 7fc286656200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T20:06:11.572 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:11.570+0000 7f8fdb386200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T20:06:11.690 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:11.688+0000 7f8fdb386200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T20:06:11.856 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:11.854+0000 7fc286656200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T20:06:11.957 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:11.955+0000 7fc286656200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T20:06:12.018 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:12.016+0000 7f8fdb386200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T20:06:12.117 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:12.115+0000 7f8fdb386200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T20:06:12.143 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:12.141+0000 7fc286656200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T20:06:12.307 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:12.305+0000 7f8fdb386200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T20:06:12.739 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:12.738+0000 7fc286656200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T20:06:12.927 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-10-16T20:06:12.925+0000 7f8fdb386200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T20:06:13.552 INFO:tasks.ceph.osd.3.smithi152.stderr:2023-10-16T20:06:13.550+0000 7fc5a4580640 -1 osd.3 0 log_to_monitors true 2023-10-16T20:06:13.764 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:13.762+0000 7fc23e5e4700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T20:06:13.765 INFO:tasks.ceph.mgr.y.smithi152.stderr:2023-10-16T20:06:13.763+0000 7fc23e5e4700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T20:06:13.826 INFO:tasks.ceph.osd.2.smithi152.stderr:2023-10-16T20:06:13.825+0000 7fa30839b640 -1 osd.2 0 log_to_monitors true 2023-10-16T20:06:13.830 INFO:tasks.ceph.osd.0.smithi152.stderr:2023-10-16T20:06:13.829+0000 7f5299b60640 -1 osd.0 0 log_to_monitors true 2023-10-16T20:06:13.842 INFO:tasks.ceph.osd.1.smithi152.stderr:2023-10-16T20:06:13.840+0000 7f7d5021f640 -1 osd.1 0 log_to_monitors true 2023-10-16T20:06:13.843 INFO:tasks.ceph.osd.4.smithi163.stderr:2023-10-16T20:06:13.841+0000 7f98608e5640 -1 osd.4 0 log_to_monitors true 2023-10-16T20:06:13.850 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-10-16T20:06:13.848+0000 7f31bc775640 -1 osd.5 0 log_to_monitors true 2023-10-16T20:06:13.851 INFO:tasks.ceph.osd.6.smithi163.stderr:2023-10-16T20:06:13.848+0000 7f8e290df640 -1 osd.6 0 log_to_monitors true 2023-10-16T20:06:13.887 INFO:tasks.ceph.osd.7.smithi163.stderr:2023-10-16T20:06:13.885+0000 7fee6a548640 -1 osd.7 0 log_to_monitors true 2023-10-16T20:06:16.725 INFO:tasks.ceph.osd.0.smithi152.stderr:2023-10-16T20:06:16.722+0000 7f528df18700 -1 osd.0 0 waiting for initial osdmap 2023-10-16T20:06:16.734 INFO:tasks.ceph.osd.0.smithi152.stderr:2023-10-16T20:06:16.733+0000 7f5285af2700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:16.739 INFO:tasks.ceph.osd.3.smithi152.stderr:2023-10-16T20:06:16.738+0000 7fc598938700 -1 osd.3 0 waiting for initial osdmap 2023-10-16T20:06:16.759 INFO:tasks.ceph.osd.3.smithi152.stderr:2023-10-16T20:06:16.758+0000 7fc590512700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:16.880 INFO:tasks.ceph.osd.2.smithi152.stderr:2023-10-16T20:06:16.879+0000 7fa2fc753700 -1 osd.2 0 waiting for initial osdmap 2023-10-16T20:06:16.893 INFO:tasks.ceph.osd.2.smithi152.stderr:2023-10-16T20:06:16.892+0000 7fa2f432d700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:16.900 INFO:tasks.ceph.osd.1.smithi152.stderr:2023-10-16T20:06:16.899+0000 7f7d445d7700 -1 osd.1 0 waiting for initial osdmap 2023-10-16T20:06:16.917 INFO:tasks.ceph.osd.1.smithi152.stderr:2023-10-16T20:06:16.916+0000 7f7d3c1b1700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:17.735 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:17.850 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.848+0000 7f939f111700 1 Processor -- start 2023-10-16T20:06:17.851 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.848+0000 7f939f111700 1 -- start start 2023-10-16T20:06:17.854 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f939f111700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f93980717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.855 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f939f111700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f93980cee10 0x7f9398071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.855 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f939f111700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93980cb980 con 0x7f93980728f0 2023-10-16T20:06:17.855 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f939f111700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980cbc20 con 0x7f93980cee10 2023-10-16T20:06:17.855 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f939f111700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980cbec0 con 0x7f939815a800 2023-10-16T20:06:17.855 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f9397fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f93980728f0 0x7f939806ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38084/0 (socket says 172.21.15.152:38084) 2023-10-16T20:06:17.856 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f9397fff700 1 -- 172.21.15.152:0/889913491 learned_addr learned my addr 172.21.15.152:0/889913491 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:17.856 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f939cead700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f93980717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.856 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.849+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913348121 0 0) 0x7f93980cb980 con 0x7f93980728f0 2023-10-16T20:06:17.856 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93880035b0 con 0x7f93980728f0 2023-10-16T20:06:17.856 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909600726 0 0) 0x7f93880035b0 con 0x7f93980728f0 2023-10-16T20:06:17.857 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 msgr2=0x7f93980717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:17.857 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f93980717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:17.857 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 >> v2:172.21.15.163:3300/0 conn(0x7f93980cee10 msgr2=0x7f9398071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:17.857 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 --2- 172.21.15.152:0/889913491 >> v2:172.21.15.163:3300/0 conn(0x7f93980cee10 0x7f9398071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:17.858 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980cc1a0 con 0x7f93980728f0 2023-10-16T20:06:17.858 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f9384001670 con 0x7f93980728f0 2023-10-16T20:06:17.858 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 >> v1:172.21.15.152:6789/0 conn(0x7f93980728f0 legacy=0x7f939806ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:17.858 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9388003a00 0x7f9388003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.859 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f9388004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.859 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388004d90 0x7f9388005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.859 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980cbc20 con 0x7f9388003a00 2023-10-16T20:06:17.859 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980cbec0 con 0x7f9388004d90 2023-10-16T20:06:17.860 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938800bb80 con 0x7f939815a800 2023-10-16T20:06:17.860 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9388003a00 0x7f9388003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.860 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939d6ae700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388004d90 0x7f9388005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.860 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 -- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 msgr2=0x7f9388004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:17.860 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f9397fff700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f9388004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.861 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f9388004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:17.861 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 -- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388004d90 msgr2=0x7f9388005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:17.861 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388004d90 0x7f9388005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:17.861 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 -- 172.21.15.152:0/889913491 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93880035b0 con 0x7f9388003a00 2023-10-16T20:06:17.861 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f9397fff700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f939815a800 0x7f9388004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:17.862 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f939cead700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9388003a00 0x7f9388003e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f938c009b60 tx=0x7f9388005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeba46fc545a967 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:17.862 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.850+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00e660 con 0x7f9388003a00 2023-10-16T20:06:17.862 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c00e7c0 con 0x7f9388003a00 2023-10-16T20:06:17.862 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f93977fe700 1 -- 172.21.15.152:0/889913491 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00eb30 con 0x7f9388003a00 2023-10-16T20:06:17.862 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939f111700 1 -- 172.21.15.152:0/889913491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9388003a00 msgr2=0x7f9388003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:17.863 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939f111700 1 --2- 172.21.15.152:0/889913491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9388003a00 0x7f9388003e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f938c009b60 tx=0x7f9388005880 comp rx=0 tx=0).stop 2023-10-16T20:06:17.863 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939d6ae700 1 -- 172.21.15.152:0/889913491 reap_dead start 2023-10-16T20:06:17.863 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939f111700 1 -- 172.21.15.152:0/889913491 shutdown_connections 2023-10-16T20:06:17.863 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939f111700 1 -- 172.21.15.152:0/889913491 >> 172.21.15.152:0/889913491 conn(0x7f93980b1db0 msgr2=0x7f93980b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:17.863 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939f111700 1 -- 172.21.15.152:0/889913491 shutdown_connections 2023-10-16T20:06:17.864 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.851+0000 7f939f111700 1 -- 172.21.15.152:0/889913491 wait complete. 2023-10-16T20:06:17.864 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.852+0000 7f939f111700 1 Processor -- start 2023-10-16T20:06:17.864 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.852+0000 7f939f111700 1 -- start start 2023-10-16T20:06:17.866 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939f111700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93981f2ca0 0x7f93981f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.866 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939f111700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 0x7f93980c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.867 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939f111700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93980ae270 0x7f93980ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.867 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939f111700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c6ee0 con 0x7f93981f46f0 2023-10-16T20:06:17.867 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939f111700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c48a0 con 0x7f93980ae270 2023-10-16T20:06:17.867 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939f111700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980aec60 con 0x7f93981f2ca0 2023-10-16T20:06:17.867 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f9397fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 0x7f93980c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.868 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f9397fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 0x7f93980c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57900/0 (socket says 172.21.15.152:57900) 2023-10-16T20:06:17.868 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f9397fff700 1 -- 172.21.15.152:0/2727073632 learned_addr learned my addr 172.21.15.152:0/2727073632 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:17.868 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.853+0000 7f939cead700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93981f2ca0 0x7f93981f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.869 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f9397fff700 1 -- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93981f2ca0 msgr2=0x7f93981f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:17.869 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f9397fff700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93981f2ca0 0x7f93981f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:17.869 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f9397fff700 1 -- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93980ae270 msgr2=0x7f93980ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:17.869 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f9397fff700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93980ae270 0x7f93980ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:17.870 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f9397fff700 1 -- 172.21.15.152:0/2727073632 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980c6c80 con 0x7f93981f46f0 2023-10-16T20:06:17.870 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f9397fff700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 0x7f93980c6740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93840048d0 tx=0x7f938400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:17.870 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384004d40 con 0x7f93981f46f0 2023-10-16T20:06:17.870 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93840070d0 con 0x7f93981f46f0 2023-10-16T20:06:17.870 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384004ea0 con 0x7f93981f46f0 2023-10-16T20:06:17.871 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93981f4b70 con 0x7f93981f46f0 2023-10-16T20:06:17.871 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.854+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93980c3f00 con 0x7f93981f46f0 2023-10-16T20:06:17.871 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.855+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93980c49e0 con 0x7f93981f46f0 2023-10-16T20:06:17.871 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.855+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f9384007440 con 0x7f93981f46f0 2023-10-16T20:06:17.871 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.856+0000 7f93957fa700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f937c06ae70 0x7f937c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:17.872 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.856+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f9384088310 con 0x7f93981f46f0 2023-10-16T20:06:17.872 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.856+0000 7f939cead700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f937c06ae70 0x7f937c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:17.872 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.856+0000 7f939cead700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f937c06ae70 0x7f937c06d330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93980b2e00 tx=0x7f938c01f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:17.872 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:17.860+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93980c49e0 con 0x7f93981f46f0 2023-10-16T20:06:17.874 INFO:tasks.ceph.osd.4.smithi163.stderr:2023-10-16T20:06:17.872+0000 7f9854c9d700 -1 osd.4 0 waiting for initial osdmap 2023-10-16T20:06:17.897 INFO:tasks.ceph.osd.4.smithi163.stderr:2023-10-16T20:06:17.895+0000 7f984c877700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:17.932 INFO:tasks.ceph.osd.6.smithi163.stderr:2023-10-16T20:06:17.930+0000 7f8e1d497700 -1 osd.6 0 waiting for initial osdmap 2023-10-16T20:06:17.952 INFO:tasks.ceph.osd.6.smithi163.stderr:2023-10-16T20:06:17.950+0000 7f8e15071700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:17.992 INFO:tasks.ceph.osd.7.smithi163.stderr:2023-10-16T20:06:17.989+0000 7fee5e900700 -1 osd.7 0 waiting for initial osdmap 2023-10-16T20:06:18.007 INFO:tasks.ceph.osd.7.smithi163.stderr:2023-10-16T20:06:18.005+0000 7fee564da700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:18.013 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-10-16T20:06:18.011+0000 7f31b0b2d700 -1 osd.5 0 waiting for initial osdmap 2023-10-16T20:06:18.028 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-10-16T20:06:18.026+0000 7f31a8707700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T20:06:18.056 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.054+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93980c49e0 con 0x7f93981f46f0 2023-10-16T20:06:18.056 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.055+0000 7f93957fa700 1 -- 172.21.15.152:0/2727073632 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9012 (secure 0 0 0) 0x7f93980c49e0 con 0x7f93981f46f0 2023-10-16T20:06:18.057 INFO:teuthology.misc.health.smithi152.stdout: 2023-10-16T20:06:18.057 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":14,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:17.051874+0000","last_up_change":"2023-10-16T20:06:17.051874+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:18.059 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f937c06ae70 msgr2=0x7f937c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:18.059 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f937c06ae70 0x7f937c06d330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93980b2e00 tx=0x7f938c01f040 comp rx=0 tx=0).stop 2023-10-16T20:06:18.059 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 msgr2=0x7f93980c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:18.059 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 0x7f93980c6740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93840048d0 tx=0x7f938400ddc0 comp rx=0 tx=0).stop 2023-10-16T20:06:18.060 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 shutdown_connections 2023-10-16T20:06:18.060 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f937c06ae70 0x7f937c06d330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:18.060 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f93981f2ca0 0x7f93981f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:18.060 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f93980ae270 0x7f93980ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:18.060 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 --2- 172.21.15.152:0/2727073632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93981f46f0 0x7f93980c6740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:18.061 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 >> 172.21.15.152:0/2727073632 conn(0x7f93980b1db0 msgr2=0x7f939815e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:18.061 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 shutdown_connections 2023-10-16T20:06:18.061 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:18.057+0000 7f939f111700 1 -- 172.21.15.152:0/2727073632 wait complete. 2023-10-16T20:06:18.070 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-10-16T20:06:24.877 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:25.001 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:24.999+0000 7f0441a9d700 1 Processor -- start 2023-10-16T20:06:25.001 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:24.999+0000 7f0441a9d700 1 -- start start 2023-10-16T20:06:25.003 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f0441a9d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cfdb0 0x7f043c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.004 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f0441a9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f043c0cb9d0 0x7f043c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.004 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f0441a9d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0d0240 con 0x7f043c15c130 2023-10-16T20:06:25.004 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f0441a9d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0ce470 con 0x7f043c0cb9d0 2023-10-16T20:06:25.004 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f0441a9d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0cc340 con 0x7f043c0cfdb0 2023-10-16T20:06:25.004 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f043c0cb9d0 0x7f043c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.005 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f043c0cb9d0 0x7f043c0cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58044/0 (socket says 172.21.15.152:58044) 2023-10-16T20:06:25.005 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 -- 172.21.15.152:0/3006712925 learned_addr learned my addr 172.21.15.152:0/3006712925 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:25.005 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f0433fff700 1 --2- 172.21.15.152:0/3006712925 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cfdb0 0x7f043c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.005 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 -- 172.21.15.152:0/3006712925 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cfdb0 msgr2=0x7f043c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:25.005 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 --2- 172.21.15.152:0/3006712925 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cfdb0 0x7f043c15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.006 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 -- 172.21.15.152:0/3006712925 >> v1:172.21.15.163:6789/0 conn(0x7f043c15c130 legacy=0x7f043c0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.006 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 -- 172.21.15.152:0/3006712925 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0ce690 con 0x7f043c0cb9d0 2023-10-16T20:06:25.006 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043bfff700 1 --2- 172.21.15.152:0/3006712925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cb9d0 0x7f043c0cbe00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e50 tx=0x7f043400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a42145a87bed4e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.006 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.000+0000 7f043affd700 1 -- 172.21.15.152:0/3006712925 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400e070 con 0x7f043c0cb9d0 2023-10-16T20:06:25.006 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f043affd700 1 -- 172.21.15.152:0/3006712925 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400b9c0 con 0x7f043c0cb9d0 2023-10-16T20:06:25.007 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f043affd700 1 -- 172.21.15.152:0/3006712925 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400bd70 con 0x7f043c0cb9d0 2023-10-16T20:06:25.007 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 -- 172.21.15.152:0/3006712925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cb9d0 msgr2=0x7f043c0cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.007 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 --2- 172.21.15.152:0/3006712925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cb9d0 0x7f043c0cbe00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e50 tx=0x7f043400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:25.007 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 -- 172.21.15.152:0/3006712925 shutdown_connections 2023-10-16T20:06:25.007 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 --2- 172.21.15.152:0/3006712925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cb9d0 0x7f043c0cbe00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.008 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 --2- 172.21.15.152:0/3006712925 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cfdb0 0x7f043c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.008 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 -- 172.21.15.152:0/3006712925 >> 172.21.15.152:0/3006712925 conn(0x7f043c06a820 msgr2=0x7f043c06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:25.008 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 -- 172.21.15.152:0/3006712925 shutdown_connections 2023-10-16T20:06:25.008 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.001+0000 7f0441a9d700 1 -- 172.21.15.152:0/3006712925 wait complete. 2023-10-16T20:06:25.011 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.003+0000 7f0441a9d700 1 Processor -- start 2023-10-16T20:06:25.011 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.003+0000 7f0441a9d700 1 -- start start 2023-10-16T20:06:25.011 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0441a9d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cb9d0 0x7f043c0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.012 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0441a9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 0x7f043c1e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.012 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0441a9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f043c15c130 0x7f043c1e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.012 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0441a9d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1e74e0 con 0x7f043c0cfdb0 2023-10-16T20:06:25.012 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0441a9d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1e68d0 con 0x7f043c15c130 2023-10-16T20:06:25.012 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0441a9d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1e6bb0 con 0x7f043c0cb9d0 2023-10-16T20:06:25.013 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 0x7f043c1e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.013 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 0x7f043c1e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58048/0 (socket says 172.21.15.152:58048) 2023-10-16T20:06:25.013 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 -- 172.21.15.152:0/2953502790 learned_addr learned my addr 172.21.15.152:0/2953502790 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:25.013 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f043bfff700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f043c15c130 0x7f043c1e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.013 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f043b7fe700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cb9d0 0x7f043c0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.013 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 -- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cb9d0 msgr2=0x7f043c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.014 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cb9d0 0x7f043c0c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.014 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 -- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f043c15c130 msgr2=0x7f043c1e3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.014 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f043c15c130 0x7f043c1e3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.014 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 -- 172.21.15.152:0/2953502790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434009b30 con 0x7f043c0cfdb0 2023-10-16T20:06:25.014 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0433fff700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 0x7f043c1e3980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f042400e810 tx=0x7f042400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.015 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.004+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400c070 con 0x7f043c0cfdb0 2023-10-16T20:06:25.015 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.005+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424013610 con 0x7f043c0cfdb0 2023-10-16T20:06:25.015 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.005+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c1e6e90 con 0x7f043c0cfdb0 2023-10-16T20:06:25.015 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.005+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240139c0 con 0x7f043c0cfdb0 2023-10-16T20:06:25.015 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.005+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c0c4510 con 0x7f043c0cfdb0 2023-10-16T20:06:25.016 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.006+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c0b7390 con 0x7f043c0cfdb0 2023-10-16T20:06:25.016 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.006+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0424013b20 con 0x7f043c0cfdb0 2023-10-16T20:06:25.016 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.006+0000 7f0438ff9700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f041c06af00 0x7f041c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.016 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.006+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0424088fc0 con 0x7f043c0cfdb0 2023-10-16T20:06:25.016 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.006+0000 7f043b7fe700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f041c06af00 0x7f041c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.016 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.007+0000 7f043b7fe700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f041c06af00 0x7f041c06d3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f042c007fd0 tx=0x7f042c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.017 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.011+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04240543d0 con 0x7f043c0cfdb0 2023-10-16T20:06:25.202 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.200+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f043c04ebb0 con 0x7f043c0cfdb0 2023-10-16T20:06:25.203 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.201+0000 7f0438ff9700 1 -- 172.21.15.152:0/2953502790 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f04240579f0 con 0x7f043c0cfdb0 2023-10-16T20:06:25.203 INFO:teuthology.misc.health.smithi152.stdout: 2023-10-16T20:06:25.203 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":18,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:21.255602+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:25.205 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f041c06af00 msgr2=0x7f041c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.205 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f041c06af00 0x7f041c06d3c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f042c007fd0 tx=0x7f042c009040 comp rx=0 tx=0).stop 2023-10-16T20:06:25.205 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 msgr2=0x7f043c1e3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.206 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 0x7f043c1e3980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f042400e810 tx=0x7f042400eb20 comp rx=0 tx=0).stop 2023-10-16T20:06:25.206 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 shutdown_connections 2023-10-16T20:06:25.206 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f041c06af00 0x7f041c06d3c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.206 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f043c0cb9d0 0x7f043c0c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.206 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f043c15c130 0x7f043c1e3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.207 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 --2- 172.21.15.152:0/2953502790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f043c0cfdb0 0x7f043c1e3980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.207 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 >> 172.21.15.152:0/2953502790 conn(0x7f043c06a820 msgr2=0x7f043c0c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:25.207 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 shutdown_connections 2023-10-16T20:06:25.207 INFO:teuthology.misc.health.smithi152.stderr:2023-10-16T20:06:25.203+0000 7f0441a9d700 1 -- 172.21.15.152:0/2953502790 wait complete. 2023-10-16T20:06:25.216 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T20:06:25.216 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T20:06:25.217 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T20:06:25.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T20:06:25.219 INFO:tasks.ceph.mds.a:Started 2023-10-16T20:06:25.220 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T20:06:25.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T20:06:25.222 INFO:tasks.ceph.mds.c:Started 2023-10-16T20:06:25.222 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T20:06:25.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T20:06:25.225 INFO:tasks.ceph.mds.b:Started 2023-10-16T20:06:25.226 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T20:06:25.226 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T20:06:25.228 INFO:tasks.ceph.mds.d:Started 2023-10-16T20:06:25.229 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T20:06:25.229 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:25.300 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2023-10-16T20:06:25.300 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2023-10-16T20:06:25.315 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2023-10-16T20:06:25.317 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2023-10-16T20:06:25.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.359+0000 7f464ec8a700 1 Processor -- start 2023-10-16T20:06:25.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.359+0000 7f464ec8a700 1 -- start start 2023-10-16T20:06:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ec8a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 0x7f46480cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ec8a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f46480ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ec8a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46480b94b0 con 0x7f46480b9000 2023-10-16T20:06:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ec8a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46480d0010 con 0x7f4648160b50 2023-10-16T20:06:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ec8a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46480d02f0 con 0x7f46480b5700 2023-10-16T20:06:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ca26700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 0x7f46480cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464d227700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f46480ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ca26700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 0x7f46480cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59080/0 (socket says 172.21.15.152:59080) 2023-10-16T20:06:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f4647fff700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f46480b9000 0x7f46480b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:53458/0 (socket says 172.21.15.152:53458) 2023-10-16T20:06:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.360+0000 7f464ca26700 1 -- 172.21.15.152:0/4193704680 learned_addr learned my addr 172.21.15.152:0/4193704680 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464d227700 1 -- 172.21.15.152:0/4193704680 >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 msgr2=0x7f46480cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464d227700 1 --2- 172.21.15.152:0/4193704680 >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 0x7f46480cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464d227700 1 -- 172.21.15.152:0/4193704680 >> v1:172.21.15.163:6789/0 conn(0x7f46480b9000 legacy=0x7f46480b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464d227700 1 -- 172.21.15.152:0/4193704680 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480d05d0 con 0x7f46480b5700 2023-10-16T20:06:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464ca26700 1 --2- 172.21.15.152:0/4193704680 >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 0x7f46480cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464d227700 1 --2- 172.21.15.152:0/4193704680 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f46480ce680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4640009dc0 tx=0x7f464000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3032620db80e27 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f46477fe700 1 -- 172.21.15.152:0/4193704680 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464000e070 con 0x7f46480b5700 2023-10-16T20:06:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f46477fe700 1 -- 172.21.15.152:0/4193704680 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464000bae0 con 0x7f46480b5700 2023-10-16T20:06:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f46477fe700 1 -- 172.21.15.152:0/4193704680 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464000be90 con 0x7f46480b5700 2023-10-16T20:06:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464ec8a700 1 -- 172.21.15.152:0/4193704680 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 msgr2=0x7f46480ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.361+0000 7f464ec8a700 1 --2- 172.21.15.152:0/4193704680 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f46480ce680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4640009dc0 tx=0x7f464000b330 comp rx=0 tx=0).stop 2023-10-16T20:06:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.362+0000 7f464ec8a700 1 -- 172.21.15.152:0/4193704680 shutdown_connections 2023-10-16T20:06:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.362+0000 7f464ec8a700 1 --2- 172.21.15.152:0/4193704680 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f46480ce680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.362+0000 7f464ec8a700 1 --2- 172.21.15.152:0/4193704680 >> v2:172.21.15.163:3300/0 conn(0x7f4648160b50 0x7f46480cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.362+0000 7f464ec8a700 1 -- 172.21.15.152:0/4193704680 >> 172.21.15.152:0/4193704680 conn(0x7f464806bc70 msgr2=0x7f464806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.362+0000 7f464ec8a700 1 -- 172.21.15.152:0/4193704680 shutdown_connections 2023-10-16T20:06:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.362+0000 7f464ec8a700 1 -- 172.21.15.152:0/4193704680 wait complete. 2023-10-16T20:06:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.363+0000 7f464ec8a700 1 Processor -- start 2023-10-16T20:06:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.363+0000 7f464ec8a700 1 -- start start 2023-10-16T20:06:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f4648157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 0x7f464815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4648160b50 0x7f46480cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480ccc80 con 0x7f46480b9000 2023-10-16T20:06:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46480c9e60 con 0x7f4648160b50 2023-10-16T20:06:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46480caee0 con 0x7f46480b5700 2023-10-16T20:06:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 0x7f464815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 0x7f464815c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58086/0 (socket says 172.21.15.152:58086) 2023-10-16T20:06:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 -- 172.21.15.152:0/3889388000 learned_addr learned my addr 172.21.15.152:0/3889388000 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ca26700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f4648157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464d227700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4648160b50 0x7f46480cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 -- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 msgr2=0x7f4648157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f4648157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 -- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4648160b50 msgr2=0x7f46480cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4648160b50 0x7f46480cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 -- 172.21.15.152:0/3889388000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c009550 con 0x7f46480b9000 2023-10-16T20:06:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f4647fff700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 0x7f464815c5e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f463400c520 tx=0x7f463400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634005cb0 con 0x7f46480b9000 2023-10-16T20:06:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634005e10 con 0x7f46480b9000 2023-10-16T20:06:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640009a70 con 0x7f46480b9000 2023-10-16T20:06:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340072d0 con 0x7f46480b9000 2023-10-16T20:06:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.364+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46480cc8a0 con 0x7f46480b9000 2023-10-16T20:06:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.365+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46480ccdc0 con 0x7f46480b9000 2023-10-16T20:06:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.366+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4634007430 con 0x7f46480b9000 2023-10-16T20:06:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.366+0000 7f46457fa700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f462c06af00 0x7f462c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.366+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4634088530 con 0x7f46480b9000 2023-10-16T20:06:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.366+0000 7f464ca26700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f462c06af00 0x7f462c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.367+0000 7f464ca26700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f462c06af00 0x7f462c06d3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f463c006d30 tx=0x7f463c0092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.371+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46480ccdc0 con 0x7f46480b9000 2023-10-16T20:06:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.560+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46480ccdc0 con 0x7f46480b9000 2023-10-16T20:06:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.561+0000 7f46457fa700 1 -- 172.21.15.152:0/3889388000 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f46480ccdc0 con 0x7f46480b9000 2023-10-16T20:06:25.564 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:25.565 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:21.255602+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f462c06af00 msgr2=0x7f462c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f462c06af00 0x7f462c06d3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f463c006d30 tx=0x7f463c0092c0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 msgr2=0x7f464815c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 0x7f464815c5e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f463400c520 tx=0x7f463400c830 comp rx=0 tx=0).stop 2023-10-16T20:06:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 shutdown_connections 2023-10-16T20:06:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f462c06af00 0x7f462c06d3c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f46480b5700 0x7f4648157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4648160b50 0x7f46480cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 --2- 172.21.15.152:0/3889388000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46480b9000 0x7f464815c5e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 >> 172.21.15.152:0/3889388000 conn(0x7f464806bc70 msgr2=0x7f4648154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 shutdown_connections 2023-10-16T20:06:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.563+0000 7f464ec8a700 1 -- 172.21.15.152:0/3889388000 wait complete. 2023-10-16T20:06:25.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T20:06:25.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:06:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.699+0000 7f1b95078700 1 Processor -- start 2023-10-16T20:06:25.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.699+0000 7f1b95078700 1 -- start start 2023-10-16T20:06:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b95078700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b9015b210 0x7f1b900b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b95078700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1b90161f30 0x7f1b900cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b95078700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1b90143ae0 0x7f1b900cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b95078700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b90161240 con 0x7f1b90143ae0 2023-10-16T20:06:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b95078700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b900b3220 con 0x7f1b90161f30 2023-10-16T20:06:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b95078700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900b34f0 con 0x7f1b9015b210 2023-10-16T20:06:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1b90143ae0 0x7f1b900cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1b90143ae0 0x7f1b900cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58096/0 (socket says 172.21.15.152:58096) 2023-10-16T20:06:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 -- 172.21.15.152:0/1165882783 learned_addr learned my addr 172.21.15.152:0/1165882783 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8ed9d700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b9015b210 0x7f1b900b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8e59c700 1 --2- 172.21.15.152:0/1165882783 >> v2:172.21.15.163:3300/0 conn(0x7f1b90161f30 0x7f1b900cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 -- 172.21.15.152:0/1165882783 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b9015b210 msgr2=0x7f1b900b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b9015b210 0x7f1b900b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 -- 172.21.15.152:0/1165882783 >> v2:172.21.15.163:3300/0 conn(0x7f1b90161f30 msgr2=0x7f1b900cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 --2- 172.21.15.152:0/1165882783 >> v2:172.21.15.163:3300/0 conn(0x7f1b90161f30 0x7f1b900cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8f59e700 1 -- 172.21.15.152:0/1165882783 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90161450 con 0x7f1b90143ae0 2023-10-16T20:06:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8ed9d700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b9015b210 0x7f1b900b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.700+0000 7f1b8e59c700 1 --2- 172.21.15.152:0/1165882783 >> v2:172.21.15.163:3300/0 conn(0x7f1b90161f30 0x7f1b900cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b8f59e700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b900cf370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b900ced50 tx=0x7f1b8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92724d53d29eb80b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b8dd9b700 1 -- 172.21.15.152:0/1165882783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800e070 con 0x7f1b90143ae0 2023-10-16T20:06:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b8dd9b700 1 -- 172.21.15.152:0/1165882783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8800b9c0 con 0x7f1b90143ae0 2023-10-16T20:06:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b8dd9b700 1 -- 172.21.15.152:0/1165882783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800bd70 con 0x7f1b90143ae0 2023-10-16T20:06:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 -- 172.21.15.152:0/1165882783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 msgr2=0x7f1b900cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b900cf370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1b900ced50 tx=0x7f1b8800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 -- 172.21.15.152:0/1165882783 shutdown_connections 2023-10-16T20:06:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b9015b210 0x7f1b900b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 --2- 172.21.15.152:0/1165882783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b900cf370 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 --2- 172.21.15.152:0/1165882783 >> v2:172.21.15.163:3300/0 conn(0x7f1b90161f30 0x7f1b900cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 -- 172.21.15.152:0/1165882783 >> 172.21.15.152:0/1165882783 conn(0x7f1b900cdce0 msgr2=0x7f1b900ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 -- 172.21.15.152:0/1165882783 shutdown_connections 2023-10-16T20:06:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.701+0000 7f1b95078700 1 -- 172.21.15.152:0/1165882783 wait complete. 2023-10-16T20:06:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.703+0000 7f1b95078700 1 Processor -- start 2023-10-16T20:06:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.703+0000 7f1b95078700 1 -- start start 2023-10-16T20:06:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b90159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b9015b210 0x7f1b900c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b90161f30 0x7f1b900b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9015a3e0 con 0x7f1b90143ae0 2023-10-16T20:06:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900c6d00 con 0x7f1b9015b210 2023-10-16T20:06:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b901454d0 con 0x7f1b90161f30 2023-10-16T20:06:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b90159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b90159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58098/0 (socket says 172.21.15.152:58098) 2023-10-16T20:06:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 -- 172.21.15.152:0/3544242307 learned_addr learned my addr 172.21.15.152:0/3544242307 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8f59e700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b90161f30 0x7f1b900b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8e59c700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b9015b210 0x7f1b900c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 -- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b90161f30 msgr2=0x7f1b900b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b90161f30 0x7f1b900b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 -- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b9015b210 msgr2=0x7f1b900c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b9015b210 0x7f1b900c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 -- 172.21.15.152:0/3544242307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88009b30 con 0x7f1b90143ae0 2023-10-16T20:06:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b8ed9d700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b90159ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c750 tx=0x7f1b8400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84011800 con 0x7f1b90143ae0 2023-10-16T20:06:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b84011960 con 0x7f1b90143ae0 2023-10-16T20:06:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b901f31d0 con 0x7f1b90143ae0 2023-10-16T20:06:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84011cd0 con 0x7f1b90143ae0 2023-10-16T20:06:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.704+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b901f3a10 con 0x7f1b90143ae0 2023-10-16T20:06:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.705+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9004ebb0 con 0x7f1b90143ae0 2023-10-16T20:06:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.706+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1b84021350 con 0x7f1b90143ae0 2023-10-16T20:06:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.706+0000 7f1b777fe700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1b7c06af00 0x7f1b7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.706+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1b84089220 con 0x7f1b90143ae0 2023-10-16T20:06:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.706+0000 7f1b8e59c700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1b7c06af00 0x7f1b7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.707+0000 7f1b8e59c700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1b7c06af00 0x7f1b7c06d3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b80006fd0 tx=0x7f1b80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.711+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b84054620 con 0x7f1b90143ae0 2023-10-16T20:06:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.898+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b9006f770 con 0x7f1b90143ae0 2023-10-16T20:06:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.899+0000 7f1b777fe700 1 -- 172.21.15.152:0/3544242307 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b8405e0a0 con 0x7f1b90143ae0 2023-10-16T20:06:25.901 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:06:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1b7c06af00 msgr2=0x7f1b7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1b7c06af00 0x7f1b7c06d3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b80006fd0 tx=0x7f1b80008040 comp rx=0 tx=0).stop 2023-10-16T20:06:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 msgr2=0x7f1b90159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b90159ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c750 tx=0x7f1b8400cb10 comp rx=0 tx=0).stop 2023-10-16T20:06:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 shutdown_connections 2023-10-16T20:06:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1b7c06af00 0x7f1b7c06d3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1b90161f30 0x7f1b900b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b90143ae0 0x7f1b90159ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 --2- 172.21.15.152:0/3544242307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b9015b210 0x7f1b900c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 >> 172.21.15.152:0/3544242307 conn(0x7f1b900cdce0 msgr2=0x7f1b900702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 shutdown_connections 2023-10-16T20:06:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:25.901+0000 7f1b95078700 1 -- 172.21.15.152:0/3544242307 wait complete. 2023-10-16T20:06:25.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:06:26.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.033+0000 7f711a3db700 1 Processor -- start 2023-10-16T20:06:26.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.033+0000 7f711a3db700 1 -- start start 2023-10-16T20:06:26.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f711a3db700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f711415b300 0x7f71140b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:26.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f711a3db700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140cf6b0 0x7f711406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:26.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f711a3db700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7114161180 con 0x7f71140b3240 2023-10-16T20:06:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f711a3db700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71140b36c0 con 0x7f711415b300 2023-10-16T20:06:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f711a3db700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7114161460 con 0x7f71140cf6b0 2023-10-16T20:06:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f7113fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f711415b300 0x7f71140b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f7113fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f711415b300 0x7f71140b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58106/0 (socket says 172.21.15.152:58106) 2023-10-16T20:06:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.034+0000 7f7113fff700 1 -- 172.21.15.152:0/3811803816 learned_addr learned my addr 172.21.15.152:0/3811803816 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7113fff700 1 -- 172.21.15.152:0/3811803816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140cf6b0 msgr2=0x7f711406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7113fff700 1 --2- 172.21.15.152:0/3811803816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140cf6b0 0x7f711406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7113fff700 1 -- 172.21.15.152:0/3811803816 >> v1:172.21.15.163:6789/0 conn(0x7f71140b3240 legacy=0x7f71140cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:26.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7113fff700 1 -- 172.21.15.152:0/3811803816 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114161740 con 0x7f711415b300 2023-10-16T20:06:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7113fff700 1 --2- 172.21.15.152:0/3811803816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f71140b2d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71040098f0 tx=0x7f7104009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be26cded529adf64 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7112ffd700 1 -- 172.21.15.152:0/3811803816 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104004230 con 0x7f711415b300 2023-10-16T20:06:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7112ffd700 1 -- 172.21.15.152:0/3811803816 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7104004390 con 0x7f711415b300 2023-10-16T20:06:26.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f7112ffd700 1 -- 172.21.15.152:0/3811803816 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040036a0 con 0x7f711415b300 2023-10-16T20:06:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f711a3db700 1 -- 172.21.15.152:0/3811803816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 msgr2=0x7f71140b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.035+0000 7f711a3db700 1 --2- 172.21.15.152:0/3811803816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f71140b2d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71040098f0 tx=0x7f7104009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.036+0000 7f711a3db700 1 -- 172.21.15.152:0/3811803816 shutdown_connections 2023-10-16T20:06:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.036+0000 7f711a3db700 1 --2- 172.21.15.152:0/3811803816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140cf6b0 0x7f711406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.036+0000 7f711a3db700 1 --2- 172.21.15.152:0/3811803816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f71140b2d00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.036+0000 7f711a3db700 1 -- 172.21.15.152:0/3811803816 >> 172.21.15.152:0/3811803816 conn(0x7f71140cdd00 msgr2=0x7f71140ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.036+0000 7f711a3db700 1 -- 172.21.15.152:0/3811803816 shutdown_connections 2023-10-16T20:06:26.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.036+0000 7f711a3db700 1 -- 172.21.15.152:0/3811803816 wait complete. 2023-10-16T20:06:26.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.037+0000 7f711a3db700 1 Processor -- start 2023-10-16T20:06:26.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.037+0000 7f711a3db700 1 -- start start 2023-10-16T20:06:26.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140b3240 0x7f71140ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:26.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71140cf6b0 0x7f71140c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f711406c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711415fa80 con 0x7f711415b300 2023-10-16T20:06:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711415f170 con 0x7f71140cf6b0 2023-10-16T20:06:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71141f2b70 con 0x7f71140b3240 2023-10-16T20:06:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f711406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:26.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f711406c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58116/0 (socket says 172.21.15.152:58116) 2023-10-16T20:06:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 -- 172.21.15.152:0/1048175122 learned_addr learned my addr 172.21.15.152:0/1048175122 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7113fff700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140b3240 0x7f71140ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f71137fe700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71140cf6b0 0x7f71140c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 -- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140b3240 msgr2=0x7f71140ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140b3240 0x7f71140ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 -- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71140cf6b0 msgr2=0x7f71140c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71140cf6b0 0x7f71140c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 -- 172.21.15.152:0/1048175122 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104009550 con 0x7f711415b300 2023-10-16T20:06:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7113fff700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140b3240 0x7f71140ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f71137fe700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71140cf6b0 0x7f71140c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7118978700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f711406c200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f710c00ba10 tx=0x7f710c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00c9b0 con 0x7f711415b300 2023-10-16T20:06:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c00cb30 con 0x7f711415b300 2023-10-16T20:06:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c014440 con 0x7f711415b300 2023-10-16T20:06:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71140b4410 con 0x7f711415b300 2023-10-16T20:06:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.038+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711415f6a0 con 0x7f711415b300 2023-10-16T20:06:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.039+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711415fbc0 con 0x7f711415b300 2023-10-16T20:06:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.040+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f710c01d3b0 con 0x7f711415b300 2023-10-16T20:06:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.040+0000 7f7110ff9700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f710006af00 0x7f710006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.040+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f710c006e40 con 0x7f711415b300 2023-10-16T20:06:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.040+0000 7f7113fff700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f710006af00 0x7f710006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.041+0000 7f7113fff700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f710006af00 0x7f710006d3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7104009c40 tx=0x7f7104008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.045+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f711415fbc0 con 0x7f711415b300 2023-10-16T20:06:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.274+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f711415fbc0 con 0x7f711415b300 2023-10-16T20:06:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.275+0000 7f7110ff9700 1 -- 172.21.15.152:0/1048175122 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f710c019540 con 0x7f711415b300 2023-10-16T20:06:26.277 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:26.277 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T20:06:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f710006af00 msgr2=0x7f710006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f710006af00 0x7f710006d3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7104009c40 tx=0x7f7104008030 comp rx=0 tx=0).stop 2023-10-16T20:06:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 msgr2=0x7f711406c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f711406c200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f710c00ba10 tx=0x7f710c00bdd0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 shutdown_connections 2023-10-16T20:06:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f710006af00 0x7f710006d3c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71140b3240 0x7f71140ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f711415b300 0x7f711406c200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 --2- 172.21.15.152:0/1048175122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71140cf6b0 0x7f71140c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 >> 172.21.15.152:0/1048175122 conn(0x7f71140cdd00 msgr2=0x7f711415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 shutdown_connections 2023-10-16T20:06:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:26.277+0000 7f711a3db700 1 -- 172.21.15.152:0/1048175122 wait complete. 2023-10-16T20:06:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 2 2023-10-16T20:06:28.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:06:28.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.423+0000 7f41ba464700 1 Processor -- start 2023-10-16T20:06:28.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.423+0000 7f41ba464700 1 -- start start 2023-10-16T20:06:28.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41ba464700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41b4152470 0x7f41b40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41ba464700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b4070d70 con 0x7f41b40b3410 2023-10-16T20:06:28.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41ba464700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b415c990 con 0x7f41b40cb8d0 2023-10-16T20:06:28.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41ba464700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b4071200 con 0x7f41b4152470 2023-10-16T20:06:28.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41b3fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41b4152470 0x7f41b40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41b3fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41b4152470 0x7f41b40cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58122/0 (socket says 172.21.15.152:58122) 2023-10-16T20:06:28.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.424+0000 7f41b3fff700 1 -- 172.21.15.152:0/2281316920 learned_addr learned my addr 172.21.15.152:0/2281316920 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:28.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b3fff700 1 -- 172.21.15.152:0/2281316920 >> v1:172.21.15.163:6789/0 conn(0x7f41b40cb8d0 legacy=0x7f41b40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:28.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b3fff700 1 -- 172.21.15.152:0/2281316920 >> v1:172.21.15.152:6789/0 conn(0x7f41b40b3410 legacy=0x7f41b40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b3fff700 1 -- 172.21.15.152:0/2281316920 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40cbd80 con 0x7f41b4152470 2023-10-16T20:06:28.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b3fff700 1 --2- 172.21.15.152:0/2281316920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40cd570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f419c0098f0 tx=0x7f419c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a815b5e5b4de13 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:28.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b2ffd700 1 -- 172.21.15.152:0/2281316920 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c004230 con 0x7f41b4152470 2023-10-16T20:06:28.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b2ffd700 1 -- 172.21.15.152:0/2281316920 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c004390 con 0x7f41b4152470 2023-10-16T20:06:28.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.425+0000 7f41b2ffd700 1 -- 172.21.15.152:0/2281316920 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0036a0 con 0x7f41b4152470 2023-10-16T20:06:28.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 -- 172.21.15.152:0/2281316920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 msgr2=0x7f41b40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 --2- 172.21.15.152:0/2281316920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40cd570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f419c0098f0 tx=0x7f419c009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:28.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 -- 172.21.15.152:0/2281316920 shutdown_connections 2023-10-16T20:06:28.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 --2- 172.21.15.152:0/2281316920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40cd570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 -- 172.21.15.152:0/2281316920 >> 172.21.15.152:0/2281316920 conn(0x7f41b40cdd00 msgr2=0x7f41b40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:28.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 -- 172.21.15.152:0/2281316920 shutdown_connections 2023-10-16T20:06:28.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.426+0000 7f41ba464700 1 -- 172.21.15.152:0/2281316920 wait complete. 2023-10-16T20:06:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.427+0000 7f41ba464700 1 Processor -- start 2023-10-16T20:06:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.427+0000 7f41ba464700 1 -- start start 2023-10-16T20:06:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41b40b3410 0x7f41b40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41b40cb8d0 0x7f41b40b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40c7bc0 con 0x7f41b4152470 2023-10-16T20:06:28.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40c5e30 con 0x7f41b40b3410 2023-10-16T20:06:28.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40c83f0 con 0x7f41b40cb8d0 2023-10-16T20:06:28.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58132/0 (socket says 172.21.15.152:58132) 2023-10-16T20:06:28.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 -- 172.21.15.152:0/1690297975 learned_addr learned my addr 172.21.15.152:0/1690297975 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:28.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b3fff700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41b40b3410 0x7f41b40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b37fe700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41b40cb8d0 0x7f41b40b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 -- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41b40cb8d0 msgr2=0x7f41b40b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41b40cb8d0 0x7f41b40b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 -- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41b40b3410 msgr2=0x7f41b40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41b40b3410 0x7f41b40c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 -- 172.21.15.152:0/1690297975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009550 con 0x7f41b4152470 2023-10-16T20:06:28.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b3fff700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41b40b3410 0x7f41b40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:28.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b8a01700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40c38a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00caf0 tx=0x7f41ac00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:28.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac003c00 con 0x7f41b4152470 2023-10-16T20:06:28.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac003d60 con 0x7f41b4152470 2023-10-16T20:06:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b40c86d0 con 0x7f41b4152470 2023-10-16T20:06:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.428+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00ab10 con 0x7f41b4152470 2023-10-16T20:06:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.429+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b40c8c90 con 0x7f41b4152470 2023-10-16T20:06:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.429+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b404ebb0 con 0x7f41b4152470 2023-10-16T20:06:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.430+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f41ac00ac70 con 0x7f41b4152470 2023-10-16T20:06:28.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.430+0000 7f41b0ff9700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f419406af00 0x7f419406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.430+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41ac089230 con 0x7f41b4152470 2023-10-16T20:06:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.430+0000 7f41b3fff700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f419406af00 0x7f419406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.431+0000 7f41b3fff700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f419406af00 0x7f419406d3c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f419c009130 tx=0x7f419c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:28.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.435+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41ac0546c0 con 0x7f41b4152470 2023-10-16T20:06:28.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.668+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41b406f630 con 0x7f41b4152470 2023-10-16T20:06:28.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.669+0000 7f41b0ff9700 1 -- 172.21.15.152:0/1690297975 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f41ac057ce0 con 0x7f41b4152470 2023-10-16T20:06:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:28.672 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-16T20:06:28.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f419406af00 msgr2=0x7f419406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f419406af00 0x7f419406d3c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f419c009130 tx=0x7f419c008030 comp rx=0 tx=0).stop 2023-10-16T20:06:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 msgr2=0x7f41b40c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40c38a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00caf0 tx=0x7f41ac00ceb0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 shutdown_connections 2023-10-16T20:06:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f419406af00 0x7f419406d3c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41b4152470 0x7f41b40c38a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41b40b3410 0x7f41b40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 --2- 172.21.15.152:0/1690297975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41b40cb8d0 0x7f41b40b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.671+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 >> 172.21.15.152:0/1690297975 conn(0x7f41b40cdd00 msgr2=0x7f41b40cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.672+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 shutdown_connections 2023-10-16T20:06:28.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.672+0000 7f41ba464700 1 -- 172.21.15.152:0/1690297975 wait complete. 2023-10-16T20:06:28.677 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 3 2023-10-16T20:06:28.686 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.805+0000 7f596d48a700 1 Processor -- start 2023-10-16T20:06:28.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.805+0000 7f596d48a700 1 -- start start 2023-10-16T20:06:28.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f596d48a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5968152470 0x7f59680cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f596d48a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59680b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f596d48a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5968070d70 con 0x7f59680cb8d0 2023-10-16T20:06:28.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f596d48a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5968071200 con 0x7f5968152470 2023-10-16T20:06:28.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f596d48a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680cbd80 con 0x7f59680b3410 2023-10-16T20:06:28.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f59677fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59680b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f5966ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5968152470 0x7f59680cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f59677fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59680b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:46792/0 (socket says 172.21.15.152:46792) 2023-10-16T20:06:28.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f59677fe700 1 -- 172.21.15.152:0/3893335081 learned_addr learned my addr 172.21.15.152:0/3893335081 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:28.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f59667fc700 1 --1- 172.21.15.152:0/3893335081 >> v1:172.21.15.163:6789/0 conn(0x7f59680cb8d0 0x7f59680b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:53514/0 (socket says 172.21.15.152:53514) 2023-10-16T20:06:28.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f5966ffd700 1 -- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 msgr2=0x7f59680b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:28.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f5966ffd700 1 --2- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59680b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f5966ffd700 1 -- 172.21.15.152:0/3893335081 >> v1:172.21.15.163:6789/0 conn(0x7f59680cb8d0 legacy=0x7f59680b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f5966ffd700 1 -- 172.21.15.152:0/3893335081 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968070440 con 0x7f5968152470 2023-10-16T20:06:28.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.806+0000 7f59677fe700 1 --2- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59680b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:28.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f5966ffd700 1 --2- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5968152470 0x7f59680cd570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5958009840 tx=0x7f5958009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec09f4dc5331617e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:28.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f5965ffb700 1 -- 172.21.15.152:0/3893335081 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011830 con 0x7f5968152470 2023-10-16T20:06:28.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f5965ffb700 1 -- 172.21.15.152:0/3893335081 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958011990 con 0x7f5968152470 2023-10-16T20:06:28.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f5965ffb700 1 -- 172.21.15.152:0/3893335081 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011d20 con 0x7f5968152470 2023-10-16T20:06:28.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 -- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5968152470 msgr2=0x7f59680cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 --2- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5968152470 0x7f59680cd570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5958009840 tx=0x7f5958009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:28.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 -- 172.21.15.152:0/3893335081 shutdown_connections 2023-10-16T20:06:28.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 --2- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59680b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 --2- 172.21.15.152:0/3893335081 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5968152470 0x7f59680cd570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 -- 172.21.15.152:0/3893335081 >> 172.21.15.152:0/3893335081 conn(0x7f59680cdd00 msgr2=0x7f59680ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:28.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 -- 172.21.15.152:0/3893335081 shutdown_connections 2023-10-16T20:06:28.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.807+0000 7f596d48a700 1 -- 172.21.15.152:0/3893335081 wait complete. 2023-10-16T20:06:28.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 Processor -- start 2023-10-16T20:06:28.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 -- start start 2023-10-16T20:06:28.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59681f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59680cb8d0 0x7f596814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 0x7f5968158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596815e140 con 0x7f5968152470 2023-10-16T20:06:28.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596815e420 con 0x7f59680cb8d0 2023-10-16T20:06:28.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.809+0000 7f596d48a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59681f4080 con 0x7f59680b3410 2023-10-16T20:06:28.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 0x7f5968158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 0x7f5968158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58146/0 (socket says 172.21.15.152:58146) 2023-10-16T20:06:28.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 -- 172.21.15.152:0/2057613520 learned_addr learned my addr 172.21.15.152:0/2057613520 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:28.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59667fc700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59680cb8d0 0x7f596814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f5966ffd700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59681f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 -- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 msgr2=0x7f59681f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59681f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 -- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59680cb8d0 msgr2=0x7f596814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:28.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59680cb8d0 0x7f596814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:28.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 -- 172.21.15.152:0/2057613520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960009b30 con 0x7f5968152470 2023-10-16T20:06:28.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59667fc700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59680cb8d0 0x7f596814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:28.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f59677fe700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 0x7f5968158af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f596000efc0 tx=0x7f5960009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:28.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960018070 con 0x7f5968152470 2023-10-16T20:06:28.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000f040 con 0x7f5968152470 2023-10-16T20:06:28.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960003c40 con 0x7f5968152470 2023-10-16T20:06:28.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580094a0 con 0x7f5968152470 2023-10-16T20:06:28.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.810+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59681f4dc0 con 0x7f5968152470 2023-10-16T20:06:28.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.811+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59681f45a0 con 0x7f5968152470 2023-10-16T20:06:28.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.812+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f596000c9e0 con 0x7f5968152470 2023-10-16T20:06:28.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.812+0000 7f594f7fe700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f595406af30 0x7f595406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:28.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.812+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f59600894f0 con 0x7f5968152470 2023-10-16T20:06:28.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.812+0000 7f5966ffd700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f595406af30 0x7f595406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:28.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.813+0000 7f5966ffd700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f595406af30 0x7f595406d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5958000c00 tx=0x7f595801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:28.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:28.816+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59681f45a0 con 0x7f5968152470 2023-10-16T20:06:29.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.010+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59681f45a0 con 0x7f5968152470 2023-10-16T20:06:29.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.010+0000 7f594f7fe700 1 -- 172.21.15.152:0/2057613520 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f59681f45a0 con 0x7f5968152470 2023-10-16T20:06:29.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:29.013 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:21.255602+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:29.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f595406af30 msgr2=0x7f595406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f595406af30 0x7f595406d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5958000c00 tx=0x7f595801c040 comp rx=0 tx=0).stop 2023-10-16T20:06:29.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 msgr2=0x7f5968158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 0x7f5968158af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f596000efc0 tx=0x7f5960009f90 comp rx=0 tx=0).stop 2023-10-16T20:06:29.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 shutdown_connections 2023-10-16T20:06:29.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f595406af30 0x7f595406d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59680b3410 0x7f59681f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5968152470 0x7f5968158af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 --2- 172.21.15.152:0/2057613520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59680cb8d0 0x7f596814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 >> 172.21.15.152:0/2057613520 conn(0x7f59680cdd00 msgr2=0x7f59680cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:29.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 shutdown_connections 2023-10-16T20:06:29.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.013+0000 7f596d48a700 1 -- 172.21.15.152:0/2057613520 wait complete. 2023-10-16T20:06:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T20:06:29.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:06:29.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.148+0000 7efd89c1f700 1 Processor -- start 2023-10-16T20:06:29.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.148+0000 7efd89c1f700 1 -- start start 2023-10-16T20:06:29.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd89c1f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd840cd770 0x7efd8406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd89c1f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd84070620 con 0x7efd840b33f0 2023-10-16T20:06:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd89c1f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd84070900 con 0x7efd8415b4e0 2023-10-16T20:06:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd89c1f700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd84070be0 con 0x7efd840cd770 2023-10-16T20:06:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd82ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efd840b33f0 0x7efd840b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38348/0 (socket says 172.21.15.152:38348) 2023-10-16T20:06:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd82ffd700 1 -- 172.21.15.152:0/1393295705 learned_addr learned my addr 172.21.15.152:0/1393295705 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd83fff700 1 --2- 172.21.15.152:0/1393295705 >> v2:172.21.15.152:3300/0 conn(0x7efd840cd770 0x7efd8406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd827fc700 1 -- 172.21.15.152:0/1393295705 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752659328 0 0) 0x7efd84070620 con 0x7efd840b33f0 2023-10-16T20:06:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd827fc700 1 -- 172.21.15.152:0/1393295705 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd6c0035b0 con 0x7efd840b33f0 2023-10-16T20:06:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd83fff700 1 -- 172.21.15.152:0/1393295705 >> v1:172.21.15.163:6789/0 conn(0x7efd8415b4e0 legacy=0x7efd840b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:29.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd83fff700 1 -- 172.21.15.152:0/1393295705 >> v1:172.21.15.152:6789/0 conn(0x7efd840b33f0 legacy=0x7efd840b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd83fff700 1 -- 172.21.15.152:0/1393295705 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84070ec0 con 0x7efd840cd770 2023-10-16T20:06:29.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd83fff700 1 --2- 172.21.15.152:0/1393295705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd840cd770 0x7efd8406f280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009d90 tx=0x7efd7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afcfec243808fa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd827fc700 1 -- 172.21.15.152:0/1393295705 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00e070 con 0x7efd840cd770 2023-10-16T20:06:29.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd827fc700 1 -- 172.21.15.152:0/1393295705 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c00bae0 con 0x7efd840cd770 2023-10-16T20:06:29.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.150+0000 7efd827fc700 1 -- 172.21.15.152:0/1393295705 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00be90 con 0x7efd840cd770 2023-10-16T20:06:29.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 -- 172.21.15.152:0/1393295705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd840cd770 msgr2=0x7efd8406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 --2- 172.21.15.152:0/1393295705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd840cd770 0x7efd8406f280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009d90 tx=0x7efd7c00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:29.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 -- 172.21.15.152:0/1393295705 shutdown_connections 2023-10-16T20:06:29.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 --2- 172.21.15.152:0/1393295705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd840cd770 0x7efd8406f280 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 -- 172.21.15.152:0/1393295705 >> 172.21.15.152:0/1393295705 conn(0x7efd840cdce0 msgr2=0x7efd840ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:29.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 -- 172.21.15.152:0/1393295705 shutdown_connections 2023-10-16T20:06:29.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.151+0000 7efd89c1f700 1 -- 172.21.15.152:0/1393295705 wait complete. 2023-10-16T20:06:29.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.152+0000 7efd89c1f700 1 Processor -- start 2023-10-16T20:06:29.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.152+0000 7efd89c1f700 1 -- start start 2023-10-16T20:06:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd89c1f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd840b33f0 0x7efd84156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd89c1f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd840cd770 0x7efd840c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd89c1f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 0x7efd841e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd89c1f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840c3f90 con 0x7efd8415b4e0 2023-10-16T20:06:29.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd89c1f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd841445e0 con 0x7efd840b33f0 2023-10-16T20:06:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd89c1f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd841448c0 con 0x7efd840cd770 2023-10-16T20:06:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 0x7efd841e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 0x7efd841e5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58158/0 (socket says 172.21.15.152:58158) 2023-10-16T20:06:29.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 -- 172.21.15.152:0/620693793 learned_addr learned my addr 172.21.15.152:0/620693793 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:29.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd837fe700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd840b33f0 0x7efd84156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd82ffd700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd840cd770 0x7efd840c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 -- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd840cd770 msgr2=0x7efd840c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd840cd770 0x7efd840c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 -- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd840b33f0 msgr2=0x7efd84156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd840b33f0 0x7efd84156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 -- 172.21.15.152:0/620693793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c009a70 con 0x7efd8415b4e0 2023-10-16T20:06:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd837fe700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd840b33f0 0x7efd84156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:29.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.153+0000 7efd83fff700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 0x7efd841e5050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd7c004000 tx=0x7efd7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.154+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c004720 con 0x7efd8415b4e0 2023-10-16T20:06:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.154+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c0048a0 con 0x7efd8415b4e0 2023-10-16T20:06:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.154+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c012670 con 0x7efd8415b4e0 2023-10-16T20:06:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.154+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84144ba0 con 0x7efd8415b4e0 2023-10-16T20:06:29.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.154+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd84145160 con 0x7efd8415b4e0 2023-10-16T20:06:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.155+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8404ebb0 con 0x7efd8415b4e0 2023-10-16T20:06:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.155+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd7c0127d0 con 0x7efd8415b4e0 2023-10-16T20:06:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.155+0000 7efd6bfff700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7006af00 0x7efd7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.155+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd7c08b020 con 0x7efd8415b4e0 2023-10-16T20:06:29.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.155+0000 7efd837fe700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7006af00 0x7efd7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.156+0000 7efd837fe700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7006af00 0x7efd7006d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd78009930 tx=0x7efd78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.160+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd7c0564b0 con 0x7efd8415b4e0 2023-10-16T20:06:29.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.349+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd840d0bf0 con 0x7efd8415b4e0 2023-10-16T20:06:29.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.349+0000 7efd6bfff700 1 -- 172.21.15.152:0/620693793 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd7c059ad0 con 0x7efd8415b4e0 2023-10-16T20:06:29.352 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:06:29.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7006af00 msgr2=0x7efd7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7006af00 0x7efd7006d3c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd78009930 tx=0x7efd78008040 comp rx=0 tx=0).stop 2023-10-16T20:06:29.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 msgr2=0x7efd841e5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 0x7efd841e5050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd7c004000 tx=0x7efd7c004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 shutdown_connections 2023-10-16T20:06:29.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7006af00 0x7efd7006d3c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8415b4e0 0x7efd841e5050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd840b33f0 0x7efd84156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 --2- 172.21.15.152:0/620693793 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd840cd770 0x7efd840c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.351+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 >> 172.21.15.152:0/620693793 conn(0x7efd840cdce0 msgr2=0x7efd840cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:29.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.352+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 shutdown_connections 2023-10-16T20:06:29.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.352+0000 7efd89c1f700 1 -- 172.21.15.152:0/620693793 wait complete. 2023-10-16T20:06:29.365 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T20:06:29.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.483+0000 7f5489e07700 1 Processor -- start 2023-10-16T20:06:29.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.483+0000 7f5489e07700 1 -- start start 2023-10-16T20:06:29.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5489e07700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f54840ce960 0x7f548406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5489e07700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54840ced40 0x7f54840cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5489e07700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840cb3b0 con 0x7f548415dea0 2023-10-16T20:06:29.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5489e07700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54840cb690 con 0x7f54840ced40 2023-10-16T20:06:29.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5489e07700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840cb970 con 0x7f54840ce960 2023-10-16T20:06:29.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54840ced40 0x7f54840cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54840ced40 0x7f54840cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58164/0 (socket says 172.21.15.152:58164) 2023-10-16T20:06:29.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 -- 172.21.15.152:0/568621097 learned_addr learned my addr 172.21.15.152:0/568621097 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:29.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f54837fe700 1 --2- 172.21.15.152:0/568621097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f54840ce960 0x7f548406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 -- 172.21.15.152:0/568621097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f54840ce960 msgr2=0x7f548406e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:29.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 --2- 172.21.15.152:0/568621097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f54840ce960 0x7f548406e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 -- 172.21.15.152:0/568621097 >> v1:172.21.15.163:6789/0 conn(0x7f548415dea0 legacy=0x7f5484157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:29.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 -- 172.21.15.152:0/568621097 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840cbc50 con 0x7f54840ced40 2023-10-16T20:06:29.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f5482ffd700 1 --2- 172.21.15.152:0/568621097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ced40 0x7f54840cab60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f547c0098f0 tx=0x7f547c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a356165444522503 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f54827fc700 1 -- 172.21.15.152:0/568621097 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c004230 con 0x7f54840ced40 2023-10-16T20:06:29.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f54827fc700 1 -- 172.21.15.152:0/568621097 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c004390 con 0x7f54840ced40 2023-10-16T20:06:29.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.484+0000 7f54827fc700 1 -- 172.21.15.152:0/568621097 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0036a0 con 0x7f54840ced40 2023-10-16T20:06:29.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 -- 172.21.15.152:0/568621097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ced40 msgr2=0x7f54840cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 --2- 172.21.15.152:0/568621097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ced40 0x7f54840cab60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f547c0098f0 tx=0x7f547c009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:29.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 -- 172.21.15.152:0/568621097 shutdown_connections 2023-10-16T20:06:29.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 --2- 172.21.15.152:0/568621097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f54840ce960 0x7f548406e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 --2- 172.21.15.152:0/568621097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ced40 0x7f54840cab60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 -- 172.21.15.152:0/568621097 >> 172.21.15.152:0/568621097 conn(0x7f54840cfcd0 msgr2=0x7f54840d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:29.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 -- 172.21.15.152:0/568621097 shutdown_connections 2023-10-16T20:06:29.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.485+0000 7f5489e07700 1 -- 172.21.15.152:0/568621097 wait complete. 2023-10-16T20:06:29.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.486+0000 7f5489e07700 1 Processor -- start 2023-10-16T20:06:29.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.486+0000 7f5489e07700 1 -- start start 2023-10-16T20:06:29.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5489e07700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 0x7f5484155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5489e07700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840ced40 0x7f54840c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5489e07700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f548415dea0 0x7f54840c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5489e07700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54841e6910 con 0x7f54840ce960 2023-10-16T20:06:29.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5489e07700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54841e3900 con 0x7f54840ced40 2023-10-16T20:06:29.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5489e07700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840c9ca0 con 0x7f548415dea0 2023-10-16T20:06:29.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 0x7f5484155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 0x7f5484155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58168/0 (socket says 172.21.15.152:58168) 2023-10-16T20:06:29.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 -- 172.21.15.152:0/3554718370 learned_addr learned my addr 172.21.15.152:0/3554718370 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:29.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5483fff700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f548415dea0 0x7f54840c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5482ffd700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840ced40 0x7f54840c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 -- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f548415dea0 msgr2=0x7f54840c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f548415dea0 0x7f54840c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 -- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840ced40 msgr2=0x7f54840c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840ced40 0x7f54840c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f54837fe700 1 -- 172.21.15.152:0/3554718370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c009550 con 0x7f54840ce960 2023-10-16T20:06:29.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5483fff700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f548415dea0 0x7f54840c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:29.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.487+0000 7f5482ffd700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840ced40 0x7f54840c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:29.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.488+0000 7f54837fe700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 0x7f5484155e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f547400c7f0 tx=0x7f547400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.488+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474011800 con 0x7f54840ce960 2023-10-16T20:06:29.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.488+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474011960 con 0x7f54840ce960 2023-10-16T20:06:29.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.488+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54841e5d20 con 0x7f54840ce960 2023-10-16T20:06:29.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.488+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474011cf0 con 0x7f54840ce960 2023-10-16T20:06:29.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.488+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54841f4240 con 0x7f54840ce960 2023-10-16T20:06:29.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.489+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548404ebb0 con 0x7f54840ce960 2023-10-16T20:06:29.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.489+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5474018360 con 0x7f54840ce960 2023-10-16T20:06:29.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.489+0000 7f546bfff700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f547006af00 0x7f547006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.489+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5474089210 con 0x7f54840ce960 2023-10-16T20:06:29.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.489+0000 7f5482ffd700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f547006af00 0x7f547006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.490+0000 7f5482ffd700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f547006af00 0x7f547006d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54840c62e0 tx=0x7f547c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.494+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5474054620 con 0x7f54840ce960 2023-10-16T20:06:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.686+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54840b5860 con 0x7f54840ce960 2023-10-16T20:06:29.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.686+0000 7f546bfff700 1 -- 172.21.15.152:0/3554718370 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f547405e090 con 0x7f54840ce960 2023-10-16T20:06:29.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:29.689 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2023-10-16T20:06:29.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:06:29.689 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2023-10-16T20:06:29.689 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2023-10-16T20:06:29.689 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:06:29.690 INFO:teuthology.orchestra.run.smithi152.stdout:] 2023-10-16T20:06:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f547006af00 msgr2=0x7f547006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f547006af00 0x7f547006d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54840c62e0 tx=0x7f547c008030 comp rx=0 tx=0).stop 2023-10-16T20:06:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 msgr2=0x7f5484155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 0x7f5484155e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f547400c7f0 tx=0x7f547400cbb0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 shutdown_connections 2023-10-16T20:06:29.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f547006af00 0x7f547006d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f548415dea0 0x7f54840c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ce960 0x7f5484155e70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 --2- 172.21.15.152:0/3554718370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54840ced40 0x7f54840c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 >> 172.21.15.152:0/3554718370 conn(0x7f54840cfcd0 msgr2=0x7f54840af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:29.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 shutdown_connections 2023-10-16T20:06:29.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.688+0000 7f5489e07700 1 -- 172.21.15.152:0/3554718370 wait complete. 2023-10-16T20:06:29.702 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T20:06:29.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T20:06:29.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.825+0000 7fa86409a700 1 Processor -- start 2023-10-16T20:06:29.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa86409a700 1 -- start start 2023-10-16T20:06:29.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa86409a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15dec0 0x7fa85c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa86409a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa85c15e320 0x7fa85c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa86409a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c0cba90 con 0x7fa85c15a250 2023-10-16T20:06:29.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa86409a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c0cb510 con 0x7fa85c15e320 2023-10-16T20:06:29.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa86409a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c071ec0 con 0x7fa85c15dec0 2023-10-16T20:06:29.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa862637700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa85c15e320 0x7fa85c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa861e36700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa85c15a250 0x7fa85c0717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38374/0 (socket says 172.21.15.152:38374) 2023-10-16T20:06:29.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.826+0000 7fa861e36700 1 -- 172.21.15.152:0/2326838760 learned_addr learned my addr 172.21.15.152:0/2326838760 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:29.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa862637700 1 -- 172.21.15.152:0/2326838760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15dec0 msgr2=0x7fa85c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:29.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa862637700 1 --2- 172.21.15.152:0/2326838760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15dec0 0x7fa85c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa862637700 1 -- 172.21.15.152:0/2326838760 >> v1:172.21.15.152:6789/0 conn(0x7fa85c15a250 legacy=0x7fa85c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa862637700 1 -- 172.21.15.152:0/2326838760 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c15ee40 con 0x7fa85c15e320 2023-10-16T20:06:29.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa862637700 1 --2- 172.21.15.152:0/2326838760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15e320 0x7fa85c06daf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa854009d90 tx=0x7fa85400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d886dfa99e105c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa860e34700 1 -- 172.21.15.152:0/2326838760 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400e070 con 0x7fa85c15e320 2023-10-16T20:06:29.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa860e34700 1 -- 172.21.15.152:0/2326838760 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400bad0 con 0x7fa85c15e320 2023-10-16T20:06:29.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.827+0000 7fa860e34700 1 -- 172.21.15.152:0/2326838760 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400be80 con 0x7fa85c15e320 2023-10-16T20:06:29.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 -- 172.21.15.152:0/2326838760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15e320 msgr2=0x7fa85c06daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 --2- 172.21.15.152:0/2326838760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15e320 0x7fa85c06daf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa854009d90 tx=0x7fa85400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:29.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 -- 172.21.15.152:0/2326838760 shutdown_connections 2023-10-16T20:06:29.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 --2- 172.21.15.152:0/2326838760 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15e320 0x7fa85c06daf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 --2- 172.21.15.152:0/2326838760 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15dec0 0x7fa85c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 -- 172.21.15.152:0/2326838760 >> 172.21.15.152:0/2326838760 conn(0x7fa85c0ccbe0 msgr2=0x7fa85c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:29.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 -- 172.21.15.152:0/2326838760 shutdown_connections 2023-10-16T20:06:29.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.828+0000 7fa86409a700 1 -- 172.21.15.152:0/2326838760 wait complete. 2023-10-16T20:06:29.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.829+0000 7fa86409a700 1 Processor -- start 2023-10-16T20:06:29.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.829+0000 7fa86409a700 1 -- start start 2023-10-16T20:06:29.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 0x7fa85c0c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa85c15dec0 0x7fa85c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15e320 0x7fa85c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c155040 con 0x7fa85c15a250 2023-10-16T20:06:29.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c0c56c0 con 0x7fa85c15dec0 2023-10-16T20:06:29.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c0c5960 con 0x7fa85c15e320 2023-10-16T20:06:29.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 0x7fa85c0c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 0x7fa85c0c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58182/0 (socket says 172.21.15.152:58182) 2023-10-16T20:06:29.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 -- 172.21.15.152:0/1457874320 learned_addr learned my addr 172.21.15.152:0/1457874320 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:29.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa862637700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15e320 0x7fa85c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861635700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa85c15dec0 0x7fa85c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 -- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15e320 msgr2=0x7fa85c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15e320 0x7fa85c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 -- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa85c15dec0 msgr2=0x7fa85c0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:29.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa85c15dec0 0x7fa85c0b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:29.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 -- 172.21.15.152:0/1457874320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854009a70 con 0x7fa85c15a250 2023-10-16T20:06:29.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa861e36700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 0x7fa85c0c5180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00c780 tx=0x7fa84c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c004c80 con 0x7fa85c15a250 2023-10-16T20:06:29.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c004de0 con 0x7fa85c15a250 2023-10-16T20:06:29.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa85c0c5c40 con 0x7fa85c15a250 2023-10-16T20:06:29.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c007310 con 0x7fa85c15a250 2023-10-16T20:06:29.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.830+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c0c6200 con 0x7fa85c15a250 2023-10-16T20:06:29.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.831+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c04ebb0 con 0x7fa85c15a250 2023-10-16T20:06:29.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.832+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa84c007470 con 0x7fa85c15a250 2023-10-16T20:06:29.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.832+0000 7fa8527fc700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa84006af00 0x7fa84006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:29.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.832+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa84c088790 con 0x7fa85c15a250 2023-10-16T20:06:29.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.832+0000 7fa861635700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa84006af00 0x7fa84006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:29.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.832+0000 7fa861635700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa84006af00 0x7fa84006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa858006fd0 tx=0x7fa858008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:29.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:29.836+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa84c053b90 con 0x7fa85c15a250 2023-10-16T20:06:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.025+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa85c0b60e0 con 0x7fa85c15a250 2023-10-16T20:06:30.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:30.692 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:06:30.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.730+0000 7fa8527fc700 1 -- 172.21.15.152:0/1457874320 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa84c0180b0 con 0x7fa85c15a250 2023-10-16T20:06:30.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa84006af00 msgr2=0x7fa84006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:30.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa84006af00 0x7fa84006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa858006fd0 tx=0x7fa858008040 comp rx=0 tx=0).stop 2023-10-16T20:06:30.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 msgr2=0x7fa85c0c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:30.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 0x7fa85c0c5180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00c780 tx=0x7fa84c00cb40 comp rx=0 tx=0).stop 2023-10-16T20:06:30.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 shutdown_connections 2023-10-16T20:06:30.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa84006af00 0x7fa84006d3c0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa858006fd0 tx=0x7fa858008040 comp rx=0 tx=0).stop 2023-10-16T20:06:30.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa85c15e320 0x7fa85c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa85c15a250 0x7fa85c0c5180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 --2- 172.21.15.152:0/1457874320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa85c15dec0 0x7fa85c0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 >> 172.21.15.152:0/1457874320 conn(0x7fa85c0ccbe0 msgr2=0x7fa85c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:30.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 shutdown_connections 2023-10-16T20:06:30.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.733+0000 7fa86409a700 1 -- 172.21.15.152:0/1457874320 wait complete. 2023-10-16T20:06:30.738 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' created 2023-10-16T20:06:30.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-16T20:06:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.919+0000 7f3bb58ac700 1 Processor -- start 2023-10-16T20:06:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.919+0000 7f3bb58ac700 1 -- start start 2023-10-16T20:06:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bb58ac700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb015d760 0x7f3bb00b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bb58ac700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bb00ce0a0 0x7f3bb00cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bb58ac700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f3bb006b7e0 0x7f3bb006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bb58ac700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb00b95a0 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bb58ac700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb006c1b0 con 0x7f3bb006b7e0 2023-10-16T20:06:30.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bb58ac700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00cf420 con 0x7f3bb015d760 2023-10-16T20:06:30.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bb00ce0a0 0x7f3bb00cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bb00ce0a0 0x7f3bb00cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58190/0 (socket says 172.21.15.152:58190) 2023-10-16T20:06:30.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3959368030 learned_addr learned my addr 172.21.15.152:0/3959368030 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:30.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3baf7fe700 1 --2- 172.21.15.152:0/3959368030 >> v2:172.21.15.163:3300/0 conn(0x7f3bb006b7e0 0x7f3bb006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3baeffd700 1 --2- 172.21.15.152:0/3959368030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb015d760 0x7f3bb00b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3959368030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb015d760 msgr2=0x7f3bb00b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 --2- 172.21.15.152:0/3959368030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb015d760 0x7f3bb00b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3959368030 >> v2:172.21.15.163:3300/0 conn(0x7f3bb006b7e0 msgr2=0x7f3bb006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 --2- 172.21.15.152:0/3959368030 >> v2:172.21.15.163:3300/0 conn(0x7f3bb006b7e0 0x7f3bb006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.920+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3959368030 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00cfdf0 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bae7fc700 1 --2- 172.21.15.152:0/3959368030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00cf8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d0df0 tx=0x7f3ba0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4382aa8d6149c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:30.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3badffb700 1 -- 172.21.15.152:0/3959368030 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000b870 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3badffb700 1 -- 172.21.15.152:0/3959368030 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000b9d0 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3badffb700 1 -- 172.21.15.152:0/3959368030 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000bd60 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3959368030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 msgr2=0x7f3bb00cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:30.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3959368030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00cf8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d0df0 tx=0x7f3ba0009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3959368030 shutdown_connections 2023-10-16T20:06:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3959368030 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb015d760 0x7f3bb00b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3959368030 >> v2:172.21.15.163:3300/0 conn(0x7f3bb006b7e0 0x7f3bb006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3959368030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00cf8b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3959368030 >> 172.21.15.152:0/3959368030 conn(0x7f3bb0072340 msgr2=0x7f3bb0072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3959368030 shutdown_connections 2023-10-16T20:06:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.921+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3959368030 wait complete. 2023-10-16T20:06:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.922+0000 7f3bb58ac700 1 Processor -- start 2023-10-16T20:06:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.923+0000 7f3bb58ac700 1 -- start start 2023-10-16T20:06:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb006b7e0 0x7f3bb00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bb015d760 0x7f3bb00cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00cb0a0 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00c6be0 con 0x7f3bb015d760 2023-10-16T20:06:30.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00cb2a0 con 0x7f3bb006b7e0 2023-10-16T20:06:30.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58196/0 (socket says 172.21.15.152:58196) 2023-10-16T20:06:30.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3528017217 learned_addr learned my addr 172.21.15.152:0/3528017217 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:30.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3baf7fe700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bb015d760 0x7f3bb00cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3baeffd700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb006b7e0 0x7f3bb00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb006b7e0 msgr2=0x7f3bb00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb006b7e0 0x7f3bb00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bb015d760 msgr2=0x7f3bb00cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bb015d760 0x7f3bb00cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 -- 172.21.15.152:0/3528017217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0009550 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bae7fc700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00ca620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:30.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0004590 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba00036a0 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb00cb580 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0003a50 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.924+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb00cbb40 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.925+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb00c6d50 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.926+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ba0003bb0 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.926+0000 7f3b97fff700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3b9c06af00 0x7f3b9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.926+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3ba0021030 con 0x7f3bb00ce0a0 2023-10-16T20:06:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.926+0000 7f3baeffd700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3b9c06af00 0x7f3b9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.926+0000 7f3baeffd700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3b9c06af00 0x7f3b9c06d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400b930 tx=0x7f3ba4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:30.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:30.931+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bb00c6d50 con 0x7f3bb00ce0a0 2023-10-16T20:06:31.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.121+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f3bb00cbd30 con 0x7f3bb00ce0a0 2023-10-16T20:06:31.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.737+0000 7f3b97fff700 1 -- 172.21.15.152:0/3528017217 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3bb00cbd30 con 0x7f3bb00ce0a0 2023-10-16T20:06:31.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3b9c06af00 msgr2=0x7f3b9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:31.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3b9c06af00 0x7f3b9c06d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400b930 tx=0x7f3ba4008040 comp rx=0 tx=0).stop 2023-10-16T20:06:31.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 msgr2=0x7f3bb00ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:31.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00ca620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba0004750 comp rx=0 tx=0).stop 2023-10-16T20:06:31.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 shutdown_connections 2023-10-16T20:06:31.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3b9c06af00 0x7f3b9c06d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3bb006b7e0 0x7f3bb00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bb015d760 0x7f3bb00cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 --2- 172.21.15.152:0/3528017217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bb00ce0a0 0x7f3bb00ca620 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000c00 tx=0x7f3ba0004750 comp rx=0 tx=0).stop 2023-10-16T20:06:31.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.742+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 >> 172.21.15.152:0/3528017217 conn(0x7f3bb0072340 msgr2=0x7f3bb015e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:31.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.744+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 shutdown_connections 2023-10-16T20:06:31.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.745+0000 7f3bb58ac700 1 -- 172.21.15.152:0/3528017217 wait complete. 2023-10-16T20:06:31.752 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' created 2023-10-16T20:06:31.771 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T20:06:31.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 Processor -- start 2023-10-16T20:06:31.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 -- start start 2023-10-16T20:06:31.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcf815b4d0 0x7fdcf815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:31.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdcf80ce510 0x7fdcf815fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:31.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf80cec30 con 0x7fdcf815f620 2023-10-16T20:06:31.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf8160010 con 0x7fdcf815b4d0 2023-10-16T20:06:31.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.899+0000 7fdcfe98b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf80cee80 con 0x7fdcf80ce510 2023-10-16T20:06:31.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcf815b4d0 0x7fdcf815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:31.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcf815b4d0 0x7fdcf815f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58202/0 (socket says 172.21.15.152:58202) 2023-10-16T20:06:31.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 -- 172.21.15.152:0/1891087036 learned_addr learned my addr 172.21.15.152:0/1891087036 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:31.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcfcf28700 1 --2- 172.21.15.152:0/1891087036 >> v2:172.21.15.163:3300/0 conn(0x7fdcf80ce510 0x7fdcf815fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:31.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 -- 172.21.15.152:0/1891087036 >> v2:172.21.15.163:3300/0 conn(0x7fdcf80ce510 msgr2=0x7fdcf815fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:31.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 --2- 172.21.15.152:0/1891087036 >> v2:172.21.15.163:3300/0 conn(0x7fdcf80ce510 0x7fdcf815fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 -- 172.21.15.152:0/1891087036 >> v1:172.21.15.163:6789/0 conn(0x7fdcf815f620 legacy=0x7fdcf806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:31.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 -- 172.21.15.152:0/1891087036 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80cf160 con 0x7fdcf815b4d0 2023-10-16T20:06:31.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcfcf28700 1 --2- 172.21.15.152:0/1891087036 >> v2:172.21.15.163:3300/0 conn(0x7fdcf80ce510 0x7fdcf815fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:31.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf7fff700 1 --2- 172.21.15.152:0/1891087036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815f0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80c3400 tx=0x7fdce8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddb062055741fd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:31.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf6ffd700 1 -- 172.21.15.152:0/1891087036 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce800b870 con 0x7fdcf815b4d0 2023-10-16T20:06:31.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf6ffd700 1 -- 172.21.15.152:0/1891087036 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce800b9d0 con 0x7fdcf815b4d0 2023-10-16T20:06:31.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.900+0000 7fdcf6ffd700 1 -- 172.21.15.152:0/1891087036 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce800bd60 con 0x7fdcf815b4d0 2023-10-16T20:06:31.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 -- 172.21.15.152:0/1891087036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 msgr2=0x7fdcf815f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:31.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/1891087036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815f0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80c3400 tx=0x7fdce8009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 -- 172.21.15.152:0/1891087036 shutdown_connections 2023-10-16T20:06:31.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/1891087036 >> v2:172.21.15.163:3300/0 conn(0x7fdcf80ce510 0x7fdcf815fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/1891087036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815f0e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 -- 172.21.15.152:0/1891087036 >> 172.21.15.152:0/1891087036 conn(0x7fdcf80b14b0 msgr2=0x7fdcf80b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:31.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 -- 172.21.15.152:0/1891087036 shutdown_connections 2023-10-16T20:06:31.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.901+0000 7fdcfe98b700 1 -- 172.21.15.152:0/1891087036 wait complete. 2023-10-16T20:06:31.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.902+0000 7fdcfe98b700 1 Processor -- start 2023-10-16T20:06:31.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 -- start start 2023-10-16T20:06:31.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf80ce510 0x7fdcf815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:31.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:31.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdcf815f620 0x7fdcf81462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:31.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf8143fa0 con 0x7fdcf815b4d0 2023-10-16T20:06:31.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf815cba0 con 0x7fdcf80ce510 2023-10-16T20:06:31.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.903+0000 7fdcfe98b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf815ce80 con 0x7fdcf815f620 2023-10-16T20:06:31.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:31.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58208/0 (socket says 172.21.15.152:58208) 2023-10-16T20:06:31.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 -- 172.21.15.152:0/3965099098 learned_addr learned my addr 172.21.15.152:0/3965099098 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:31.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf7fff700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf80ce510 0x7fdcf815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:31.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcfcf28700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdcf815f620 0x7fdcf81462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:31.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 -- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdcf815f620 msgr2=0x7fdcf81462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:31.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdcf815f620 0x7fdcf81462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 -- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf80ce510 msgr2=0x7fdcf815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:31.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf80ce510 0x7fdcf815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:31.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 -- 172.21.15.152:0/3965099098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009550 con 0x7fdcf815b4d0 2023-10-16T20:06:31.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcfcf28700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdcf815f620 0x7fdcf81462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:31.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf77fe700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815c370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c450 tx=0x7fdcec00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:31.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0052d0 con 0x7fdcf815b4d0 2023-10-16T20:06:31.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec005430 con 0x7fdcf815b4d0 2023-10-16T20:06:31.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf815d160 con 0x7fdcf815b4d0 2023-10-16T20:06:31.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0038c0 con 0x7fdcf815b4d0 2023-10-16T20:06:31.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.904+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf815d720 con 0x7fdcf815b4d0 2023-10-16T20:06:31.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.905+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf80743d0 con 0x7fdcf815b4d0 2023-10-16T20:06:31.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.906+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdcec003a20 con 0x7fdcf815b4d0 2023-10-16T20:06:31.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.906+0000 7fdcf4ff9700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdce406af00 0x7fdce406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:31.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.906+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdcec088920 con 0x7fdcf815b4d0 2023-10-16T20:06:31.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.906+0000 7fdcf7fff700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdce406af00 0x7fdce406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:31.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.906+0000 7fdcf7fff700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdce406af00 0x7fdce406d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdce8000c00 tx=0x7fdce8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:31.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:31.911+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcec053a30 con 0x7fdcf815b4d0 2023-10-16T20:06:32.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.143+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdcf804ebb0 con 0x7fdcf815b4d0 2023-10-16T20:06:32.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.849+0000 7fdcf4ff9700 1 -- 172.21.15.152:0/3965099098 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdcec0170c0 con 0x7fdcf815b4d0 2023-10-16T20:06:32.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdce406af00 msgr2=0x7fdce406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:32.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdce406af00 0x7fdce406d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdce8000c00 tx=0x7fdce8008030 comp rx=0 tx=0).stop 2023-10-16T20:06:32.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 msgr2=0x7fdcf815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:32.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815c370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00c450 tx=0x7fdcec00c760 comp rx=0 tx=0).stop 2023-10-16T20:06:32.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 shutdown_connections 2023-10-16T20:06:32.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdce406af00 0x7fdce406d3c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:32.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdcf815f620 0x7fdcf81462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:32.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf80ce510 0x7fdcf815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:32.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 --2- 172.21.15.152:0/3965099098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcf815b4d0 0x7fdcf815c370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:32.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.853+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 >> 172.21.15.152:0/3965099098 conn(0x7fdcf80b14b0 msgr2=0x7fdcf8155970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:32.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.854+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 shutdown_connections 2023-10-16T20:06:32.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:32.854+0000 7fdcfe98b700 1 -- 172.21.15.152:0/3965099098 wait complete. 2023-10-16T20:06:32.860 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T20:06:32.875 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-16T20:06:32.876 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-16T20:06:33.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.006+0000 7fb88359e700 1 Processor -- start 2023-10-16T20:06:33.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.006+0000 7fb88359e700 1 -- start start 2023-10-16T20:06:33.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88359e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb87c1546a0 0x7fb87c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88359e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb87c06fea0 0x7fb87c071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88359e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c15b610 con 0x7fb87c071720 2023-10-16T20:06:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88359e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0720e0 con 0x7fb87c1546a0 2023-10-16T20:06:33.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88359e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c15e120 con 0x7fb87c06fea0 2023-10-16T20:06:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88259c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb87c1546a0 0x7fb87c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb881d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb87c071720 0x7fb87c0ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38428/0 (socket says 172.21.15.152:38428) 2023-10-16T20:06:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb88259c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb87c1546a0 0x7fb87c15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58232/0 (socket says 172.21.15.152:58232) 2023-10-16T20:06:33.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.007+0000 7fb881d9b700 1 -- 172.21.15.152:0/131502981 learned_addr learned my addr 172.21.15.152:0/131502981 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb882d9d700 1 --2- 172.21.15.152:0/131502981 >> v2:172.21.15.163:3300/0 conn(0x7fb87c06fea0 0x7fb87c071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88259c700 1 -- 172.21.15.152:0/131502981 >> v2:172.21.15.163:3300/0 conn(0x7fb87c06fea0 msgr2=0x7fb87c071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88259c700 1 --2- 172.21.15.152:0/131502981 >> v2:172.21.15.163:3300/0 conn(0x7fb87c06fea0 0x7fb87c071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88259c700 1 -- 172.21.15.152:0/131502981 >> v1:172.21.15.152:6789/0 conn(0x7fb87c071720 legacy=0x7fb87c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88259c700 1 -- 172.21.15.152:0/131502981 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c15e400 con 0x7fb87c1546a0 2023-10-16T20:06:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88159a700 1 -- 172.21.15.152:0/131502981 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095833046 0 0) 0x7fb870001110 con 0x7fb87c071720 2023-10-16T20:06:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88259c700 1 --2- 172.21.15.152:0/131502981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c15b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb87c15a6c0 tx=0x7fb874009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c3020248674d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:33.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88159a700 1 -- 172.21.15.152:0/131502981 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011830 con 0x7fb87c1546a0 2023-10-16T20:06:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88159a700 1 -- 172.21.15.152:0/131502981 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874011990 con 0x7fb87c1546a0 2023-10-16T20:06:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.008+0000 7fb88159a700 1 -- 172.21.15.152:0/131502981 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011d20 con 0x7fb87c1546a0 2023-10-16T20:06:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 -- 172.21.15.152:0/131502981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 msgr2=0x7fb87c15b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 --2- 172.21.15.152:0/131502981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c15b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb87c15a6c0 tx=0x7fb874009b20 comp rx=0 tx=0).stop 2023-10-16T20:06:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 -- 172.21.15.152:0/131502981 shutdown_connections 2023-10-16T20:06:33.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 --2- 172.21.15.152:0/131502981 >> v2:172.21.15.163:3300/0 conn(0x7fb87c06fea0 0x7fb87c071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 --2- 172.21.15.152:0/131502981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c15b0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 -- 172.21.15.152:0/131502981 >> 172.21.15.152:0/131502981 conn(0x7fb87c0d00a0 msgr2=0x7fb87c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 -- 172.21.15.152:0/131502981 shutdown_connections 2023-10-16T20:06:33.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.009+0000 7fb88359e700 1 -- 172.21.15.152:0/131502981 wait complete. 2023-10-16T20:06:33.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.010+0000 7fb88359e700 1 Processor -- start 2023-10-16T20:06:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.010+0000 7fb88359e700 1 -- start start 2023-10-16T20:06:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88359e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb87c06fea0 0x7fb87c1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88359e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb87c071720 0x7fb87c0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88359e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c1efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88359e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c14e080 con 0x7fb87c1546a0 2023-10-16T20:06:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88359e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c14dac0 con 0x7fb87c071720 2023-10-16T20:06:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88359e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c14dda0 con 0x7fb87c06fea0 2023-10-16T20:06:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c1efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c1efe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58240/0 (socket says 172.21.15.152:58240) 2023-10-16T20:06:33.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 -- 172.21.15.152:0/3280634400 learned_addr learned my addr 172.21.15.152:0/3280634400 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:33.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb881d9b700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb87c071720 0x7fb87c0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88259c700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb87c06fea0 0x7fb87c1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 -- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb87c06fea0 msgr2=0x7fb87c1f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb87c06fea0 0x7fb87c1f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 -- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb87c071720 msgr2=0x7fb87c0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb87c071720 0x7fb87c0b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 -- 172.21.15.152:0/3280634400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740094a0 con 0x7fb87c1546a0 2023-10-16T20:06:33.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb88259c700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb87c06fea0 0x7fb87c1f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:33.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.011+0000 7fb882d9d700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c1efe30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb878007e30 tx=0x7fb87800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:33.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.012+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800ede0 con 0x7fb87c1546a0 2023-10-16T20:06:33.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.012+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878014420 con 0x7fb87c1546a0 2023-10-16T20:06:33.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.012+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c0b2df0 con 0x7fb87c1546a0 2023-10-16T20:06:33.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.012+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780147d0 con 0x7fb87c1546a0 2023-10-16T20:06:33.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.012+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c14d750 con 0x7fb87c1546a0 2023-10-16T20:06:33.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.012+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c0b3310 con 0x7fb87c1546a0 2023-10-16T20:06:33.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.013+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb878014930 con 0x7fb87c1546a0 2023-10-16T20:06:33.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.013+0000 7fb86effd700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb86006af00 0x7fb86006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.013+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb878089c40 con 0x7fb87c1546a0 2023-10-16T20:06:33.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.013+0000 7fb88259c700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb86006af00 0x7fb86006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.014+0000 7fb88259c700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb86006af00 0x7fb86006d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8740090b0 tx=0x7fb87401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:33.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.018+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb878054d80 con 0x7fb87c1546a0 2023-10-16T20:06:33.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.219+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb87c04f400 con 0x7fb87c1546a0 2023-10-16T20:06:33.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.744+0000 7fb86effd700 1 -- 172.21.15.152:0/3280634400 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb8780583a0 con 0x7fb87c1546a0 2023-10-16T20:06:33.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.746+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb86006af00 msgr2=0x7fb86006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.746+0000 7fb88359e700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb86006af00 0x7fb86006d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb8740090b0 tx=0x7fb87401c040 comp rx=0 tx=0).stop 2023-10-16T20:06:33.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.746+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 msgr2=0x7fb87c1efe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.746+0000 7fb88359e700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c1efe30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb878007e30 tx=0x7fb87800e3c0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 shutdown_connections 2023-10-16T20:06:33.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb86006af00 0x7fb86006d3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb87c06fea0 0x7fb87c1f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c1546a0 0x7fb87c1efe30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 --2- 172.21.15.152:0/3280634400 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb87c071720 0x7fb87c0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 >> 172.21.15.152:0/3280634400 conn(0x7fb87c0d00a0 msgr2=0x7fb87c1530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 shutdown_connections 2023-10-16T20:06:33.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.747+0000 7fb88359e700 1 -- 172.21.15.152:0/3280634400 wait complete. 2023-10-16T20:06:33.761 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T20:06:33.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.889+0000 7fb454c18700 1 Processor -- start 2023-10-16T20:06:33.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.889+0000 7fb454c18700 1 -- start start 2023-10-16T20:06:33.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb454c18700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb45015da80 0x7fb4500af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb454c18700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4500cfbc0 0x7fb45006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb454c18700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45006ebd0 con 0x7fb45006a820 2023-10-16T20:06:33.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb454c18700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500727e0 con 0x7fb4500cfbc0 2023-10-16T20:06:33.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb454c18700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb450072240 con 0x7fb45015da80 2023-10-16T20:06:33.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4500cfbc0 0x7fb45006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4500cfbc0 0x7fb45006d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58246/0 (socket says 172.21.15.152:58246) 2023-10-16T20:06:33.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 -- 172.21.15.152:0/1440038048 learned_addr learned my addr 172.21.15.152:0/1440038048 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:33.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44e59c700 1 --2- 172.21.15.152:0/1440038048 >> v2:172.21.15.163:3300/0 conn(0x7fb45015da80 0x7fb4500af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 -- 172.21.15.152:0/1440038048 >> v2:172.21.15.163:3300/0 conn(0x7fb45015da80 msgr2=0x7fb4500af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:33.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 --2- 172.21.15.152:0/1440038048 >> v2:172.21.15.163:3300/0 conn(0x7fb45015da80 0x7fb4500af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 -- 172.21.15.152:0/1440038048 >> v1:172.21.15.163:6789/0 conn(0x7fb45006a820 legacy=0x7fb4500ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 -- 172.21.15.152:0/1440038048 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500cf810 con 0x7fb4500cfbc0 2023-10-16T20:06:33.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44dd9b700 1 --2- 172.21.15.152:0/1440038048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb45006d0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4500674e0 tx=0x7fb444009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a172aaafd87fd806 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:33.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.890+0000 7fb44d59a700 1 -- 172.21.15.152:0/1440038048 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400b870 con 0x7fb4500cfbc0 2023-10-16T20:06:33.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb44d59a700 1 -- 172.21.15.152:0/1440038048 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400b9d0 con 0x7fb4500cfbc0 2023-10-16T20:06:33.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb44d59a700 1 -- 172.21.15.152:0/1440038048 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400bd60 con 0x7fb4500cfbc0 2023-10-16T20:06:33.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 -- 172.21.15.152:0/1440038048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 msgr2=0x7fb45006d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 --2- 172.21.15.152:0/1440038048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb45006d0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb4500674e0 tx=0x7fb444009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 -- 172.21.15.152:0/1440038048 shutdown_connections 2023-10-16T20:06:33.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 --2- 172.21.15.152:0/1440038048 >> v2:172.21.15.163:3300/0 conn(0x7fb45015da80 0x7fb4500af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 --2- 172.21.15.152:0/1440038048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb45006d0e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 -- 172.21.15.152:0/1440038048 >> 172.21.15.152:0/1440038048 conn(0x7fb4500d0160 msgr2=0x7fb4500d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:33.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 -- 172.21.15.152:0/1440038048 shutdown_connections 2023-10-16T20:06:33.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.891+0000 7fb454c18700 1 -- 172.21.15.152:0/1440038048 wait complete. 2023-10-16T20:06:33.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.892+0000 7fb454c18700 1 Processor -- start 2023-10-16T20:06:33.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 -- start start 2023-10-16T20:06:33.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb45006a820 0x7fb45014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb4500afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb45015da80 0x7fb4500b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500b3e00 con 0x7fb4500cfbc0 2023-10-16T20:06:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45015cb50 con 0x7fb45015da80 2023-10-16T20:06:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb454c18700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500b31f0 con 0x7fb45006a820 2023-10-16T20:06:33.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb44dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb4500afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb44dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb4500afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58252/0 (socket says 172.21.15.152:58252) 2023-10-16T20:06:33.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb44dd9b700 1 -- 172.21.15.152:0/2024882670 learned_addr learned my addr 172.21.15.152:0/2024882670 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:33.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb44ed9d700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb45015da80 0x7fb4500b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.893+0000 7fb44e59c700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb45006a820 0x7fb45014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44dd9b700 1 -- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb45006a820 msgr2=0x7fb45014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44dd9b700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb45006a820 0x7fb45014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44dd9b700 1 -- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb45015da80 msgr2=0x7fb4500b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44dd9b700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb45015da80 0x7fb4500b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44dd9b700 1 -- 172.21.15.152:0/2024882670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444009550 con 0x7fb4500cfbc0 2023-10-16T20:06:33.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44ed9d700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb45015da80 0x7fb4500b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb44dd9b700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb4500afac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb444013000 tx=0x7fb444004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444004540 con 0x7fb4500cfbc0 2023-10-16T20:06:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4440036a0 con 0x7fb4500cfbc0 2023-10-16T20:06:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4500b34d0 con 0x7fb4500cfbc0 2023-10-16T20:06:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444003a30 con 0x7fb4500cfbc0 2023-10-16T20:06:33.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.894+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4500b3a90 con 0x7fb4500cfbc0 2023-10-16T20:06:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.895+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45004ebb0 con 0x7fb4500cfbc0 2023-10-16T20:06:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.895+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb444021070 con 0x7fb4500cfbc0 2023-10-16T20:06:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.896+0000 7fb43effd700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb43006af00 0x7fb43006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.896+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb44408b1f0 con 0x7fb4500cfbc0 2023-10-16T20:06:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.896+0000 7fb44e59c700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb43006af00 0x7fb43006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.896+0000 7fb44e59c700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb43006af00 0x7fb43006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb440009930 tx=0x7fb440008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:33.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:33.900+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb444056370 con 0x7fb4500cfbc0 2023-10-16T20:06:34.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:34.092+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb45006edd0 con 0x7fb4500cfbc0 2023-10-16T20:06:35.323 INFO:tasks.ceph.mds.a.smithi152.stderr:2023-10-16T20:06:35.321+0000 7f1b17d5e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T20:06:35.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.868+0000 7fb43effd700 1 -- 172.21.15.152:0/2024882670 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb444059990 con 0x7fb4500cfbc0 2023-10-16T20:06:35.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.873+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb43006af00 msgr2=0x7fb43006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:35.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.873+0000 7fb454c18700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb43006af00 0x7fb43006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb440009930 tx=0x7fb440008040 comp rx=0 tx=0).stop 2023-10-16T20:06:35.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.873+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 msgr2=0x7fb4500afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:35.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.873+0000 7fb454c18700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb4500afac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb444013000 tx=0x7fb444004750 comp rx=0 tx=0).stop 2023-10-16T20:06:35.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.876+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 shutdown_connections 2023-10-16T20:06:35.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.876+0000 7fb454c18700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb43006af00 0x7fb43006d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:35.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.876+0000 7fb454c18700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb45006a820 0x7fb45014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:35.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.876+0000 7fb454c18700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb45015da80 0x7fb4500b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:35.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.876+0000 7fb454c18700 1 --2- 172.21.15.152:0/2024882670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4500cfbc0 0x7fb4500afac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:35.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.876+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 >> 172.21.15.152:0/2024882670 conn(0x7fb4500d0160 msgr2=0x7fb4500aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:35.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.877+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 shutdown_connections 2023-10-16T20:06:35.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:35.878+0000 7fb454c18700 1 -- 172.21.15.152:0/2024882670 wait complete. 2023-10-16T20:06:35.882 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data_ec' created 2023-10-16T20:06:35.896 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-16T20:06:36.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.024+0000 7f3259ff4700 1 Processor -- start 2023-10-16T20:06:36.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.024+0000 7f3259ff4700 1 -- start start 2023-10-16T20:06:36.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f3259ff4700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f325406b370 0x7f325415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f3259ff4700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f325406a820 0x7f325406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f3259ff4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540cdd30 0x7f32540ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f3259ff4700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32540ce720 con 0x7f325406b370 2023-10-16T20:06:36.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f3259ff4700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3254161360 con 0x7f325406a820 2023-10-16T20:06:36.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f3259ff4700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325406b750 con 0x7f32540cdd30 2023-10-16T20:06:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f325406b370 0x7f325415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f325406b370 0x7f325415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58258/0 (socket says 172.21.15.152:58258) 2023-10-16T20:06:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 -- 172.21.15.152:0/530244167 learned_addr learned my addr 172.21.15.152:0/530244167 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 -- 172.21.15.152:0/530244167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540cdd30 msgr2=0x7f32540ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 --2- 172.21.15.152:0/530244167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540cdd30 0x7f32540ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 -- 172.21.15.152:0/530244167 >> v2:172.21.15.163:3300/0 conn(0x7f325406a820 msgr2=0x7f325406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:36.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 --2- 172.21.15.152:0/530244167 >> v2:172.21.15.163:3300/0 conn(0x7f325406a820 0x7f325406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 -- 172.21.15.152:0/530244167 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325415e300 con 0x7f325406b370 2023-10-16T20:06:36.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32537fe700 1 --2- 172.21.15.152:0/530244167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f325406b370 0x7f325415dcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3254070360 tx=0x7f3244009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde2499b4f173d20 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:36.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32527fc700 1 -- 172.21.15.152:0/530244167 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400b870 con 0x7f325406b370 2023-10-16T20:06:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32527fc700 1 -- 172.21.15.152:0/530244167 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324400b9d0 con 0x7f325406b370 2023-10-16T20:06:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.025+0000 7f32527fc700 1 -- 172.21.15.152:0/530244167 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400bd60 con 0x7f325406b370 2023-10-16T20:06:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 -- 172.21.15.152:0/530244167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f325406b370 msgr2=0x7f325415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 --2- 172.21.15.152:0/530244167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f325406b370 0x7f325415dcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3254070360 tx=0x7f3244009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 -- 172.21.15.152:0/530244167 shutdown_connections 2023-10-16T20:06:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 --2- 172.21.15.152:0/530244167 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f32540cdd30 0x7f32540ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 --2- 172.21.15.152:0/530244167 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f325406b370 0x7f325415dcb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 --2- 172.21.15.152:0/530244167 >> v2:172.21.15.163:3300/0 conn(0x7f325406a820 0x7f325406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 -- 172.21.15.152:0/530244167 >> 172.21.15.152:0/530244167 conn(0x7f32540ccbe0 msgr2=0x7f32540ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 -- 172.21.15.152:0/530244167 shutdown_connections 2023-10-16T20:06:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.026+0000 7f3259ff4700 1 -- 172.21.15.152:0/530244167 wait complete. 2023-10-16T20:06:36.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.027+0000 7f3259ff4700 1 Processor -- start 2023-10-16T20:06:36.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.027+0000 7f3259ff4700 1 -- start start 2023-10-16T20:06:36.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3259ff4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f325406a820 0x7f325414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3259ff4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f325406b370 0x7f32540c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3259ff4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 0x7f325415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3259ff4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540cc700 con 0x7f32540cdd30 2023-10-16T20:06:36.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3259ff4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3254159520 con 0x7f325406a820 2023-10-16T20:06:36.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3259ff4700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3254159800 con 0x7f325406b370 2023-10-16T20:06:36.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 0x7f325415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:36.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 0x7f325415a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58268/0 (socket says 172.21.15.152:58268) 2023-10-16T20:06:36.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 -- 172.21.15.152:0/1820258911 learned_addr learned my addr 172.21.15.152:0/1820258911 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:36.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f32537fe700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f325406a820 0x7f325414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:36.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3252ffd700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f325406b370 0x7f32540c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:36.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 -- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f325406b370 msgr2=0x7f32540c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:36.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f325406b370 0x7f32540c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 -- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f325406a820 msgr2=0x7f325414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f325406a820 0x7f325414ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.028+0000 7f3253fff700 1 -- 172.21.15.152:0/1820258911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244009550 con 0x7f32540cdd30 2023-10-16T20:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f3252ffd700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f325406b370 0x7f32540c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f3253fff700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 0x7f325415a8a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f324c00b970 tx=0x7f324c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:36.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00c930 con 0x7f32540cdd30 2023-10-16T20:06:36.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00cab0 con 0x7f32540cdd30 2023-10-16T20:06:36.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00ce60 con 0x7f32540cdd30 2023-10-16T20:06:36.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3254159ae0 con 0x7f32540cdd30 2023-10-16T20:06:36.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.029+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325415a0a0 con 0x7f32540cdd30 2023-10-16T20:06:36.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.030+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3254072d10 con 0x7f32540cdd30 2023-10-16T20:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.030+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f324c01d3b0 con 0x7f32540cdd30 2023-10-16T20:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.031+0000 7f323bfff700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f324006af00 0x7f324006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.031+0000 7f32537fe700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f324006af00 0x7f324006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.031+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f324c006e40 con 0x7f32540cdd30 2023-10-16T20:06:36.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.031+0000 7f32537fe700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f324006af00 0x7f324006d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3244014040 tx=0x7f3244008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:36.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.035+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f324c0543a0 con 0x7f32540cdd30 2023-10-16T20:06:36.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.223+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f325404ebb0 con 0x7f32540cdd30 2023-10-16T20:06:36.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.871+0000 7f323bfff700 1 -- 172.21.15.152:0/1820258911 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f324c0579c0 con 0x7f32540cdd30 2023-10-16T20:06:36.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.874+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f324006af00 msgr2=0x7f324006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:36.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.874+0000 7f3259ff4700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f324006af00 0x7f324006d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3244014040 tx=0x7f3244008030 comp rx=0 tx=0).stop 2023-10-16T20:06:36.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.874+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 msgr2=0x7f325415a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:36.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.874+0000 7f3259ff4700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 0x7f325415a8a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f324c00b970 tx=0x7f324c00bc80 comp rx=0 tx=0).stop 2023-10-16T20:06:36.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 shutdown_connections 2023-10-16T20:06:36.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f324006af00 0x7f324006d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32540cdd30 0x7f325415a8a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f325406a820 0x7f325414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 --2- 172.21.15.152:0/1820258911 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f325406b370 0x7f32540c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:36.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 >> 172.21.15.152:0/1820258911 conn(0x7f32540ccbe0 msgr2=0x7f325406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:36.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 shutdown_connections 2023-10-16T20:06:36.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:36.875+0000 7f3259ff4700 1 -- 172.21.15.152:0/1820258911 wait complete. 2023-10-16T20:06:36.879 INFO:teuthology.orchestra.run.smithi152.stderr:set pool 4 allow_ec_overwrites to true 2023-10-16T20:06:36.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-16T20:06:37.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.029+0000 7fd9c421d700 1 Processor -- start 2023-10-16T20:06:37.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.029+0000 7fd9c421d700 1 -- start start 2023-10-16T20:06:37.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c421d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd9bc06a820 0x7fd9bc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:37.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c421d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9bc0cdd30 0x7fd9bc0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:37.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c421d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc161360 con 0x7fd9bc06b370 2023-10-16T20:06:37.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c421d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0ce720 con 0x7fd9bc0cdd30 2023-10-16T20:06:37.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c421d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc06b750 con 0x7fd9bc06a820 2023-10-16T20:06:37.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c27ba700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9bc0cdd30 0x7fd9bc0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:37.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c1fb9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd9bc06b370 0x7fd9bc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38470/0 (socket says 172.21.15.152:38470) 2023-10-16T20:06:37.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c27ba700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd9bc0cdd30 0x7fd9bc0ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58276/0 (socket says 172.21.15.152:58276) 2023-10-16T20:06:37.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c1fb9700 1 -- 172.21.15.152:0/4260610453 learned_addr learned my addr 172.21.15.152:0/4260610453 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:37.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.030+0000 7fd9c17b8700 1 --2- 172.21.15.152:0/4260610453 >> v2:172.21.15.163:3300/0 conn(0x7fd9bc06a820 0x7fd9bc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:37.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c27ba700 1 -- 172.21.15.152:0/4260610453 >> v2:172.21.15.163:3300/0 conn(0x7fd9bc06a820 msgr2=0x7fd9bc15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:37.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c27ba700 1 --2- 172.21.15.152:0/4260610453 >> v2:172.21.15.163:3300/0 conn(0x7fd9bc06a820 0x7fd9bc15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c27ba700 1 -- 172.21.15.152:0/4260610453 >> v1:172.21.15.152:6789/0 conn(0x7fd9bc06b370 legacy=0x7fd9bc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:37.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c27ba700 1 -- 172.21.15.152:0/4260610453 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc06dcc0 con 0x7fd9bc0cdd30 2023-10-16T20:06:37.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c0fb7700 1 -- 172.21.15.152:0/4260610453 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931819030 0 0) 0x7fd9bc161360 con 0x7fd9bc06b370 2023-10-16T20:06:37.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c27ba700 1 --2- 172.21.15.152:0/4260610453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0cdd30 0x7fd9bc0ce1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc070360 tx=0x7fd9b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1825cde8534bd921 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:37.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c0fb7700 1 -- 172.21.15.152:0/4260610453 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b400e070 con 0x7fd9bc0cdd30 2023-10-16T20:06:37.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c0fb7700 1 -- 172.21.15.152:0/4260610453 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b400bbd0 con 0x7fd9bc0cdd30 2023-10-16T20:06:37.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c0fb7700 1 -- 172.21.15.152:0/4260610453 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4012430 con 0x7fd9bc0cdd30 2023-10-16T20:06:37.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 -- 172.21.15.152:0/4260610453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0cdd30 msgr2=0x7fd9bc0ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:37.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 --2- 172.21.15.152:0/4260610453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0cdd30 0x7fd9bc0ce1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc070360 tx=0x7fd9b400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:37.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 -- 172.21.15.152:0/4260610453 shutdown_connections 2023-10-16T20:06:37.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 --2- 172.21.15.152:0/4260610453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc0cdd30 0x7fd9bc0ce1e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 --2- 172.21.15.152:0/4260610453 >> v2:172.21.15.163:3300/0 conn(0x7fd9bc06a820 0x7fd9bc15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 -- 172.21.15.152:0/4260610453 >> 172.21.15.152:0/4260610453 conn(0x7fd9bc0ccbe0 msgr2=0x7fd9bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:37.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.031+0000 7fd9c421d700 1 -- 172.21.15.152:0/4260610453 shutdown_connections 2023-10-16T20:06:37.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.032+0000 7fd9c421d700 1 -- 172.21.15.152:0/4260610453 wait complete. 2023-10-16T20:06:37.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 Processor -- start 2023-10-16T20:06:37.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 -- start start 2023-10-16T20:06:37.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9bc06a820 0x7fd9bc156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:37.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 0x7fd9bc0c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:37.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9bc0cdd30 0x7fd9bc0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:37.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0ca2c0 con 0x7fd9bc06b370 2023-10-16T20:06:37.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0c72d0 con 0x7fd9bc06a820 2023-10-16T20:06:37.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c421d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0c75b0 con 0x7fd9bc0cdd30 2023-10-16T20:06:37.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c17b8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 0x7fd9bc0c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:37.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c17b8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 0x7fd9bc0c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58280/0 (socket says 172.21.15.152:58280) 2023-10-16T20:06:37.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.033+0000 7fd9c17b8700 1 -- 172.21.15.152:0/1712305157 learned_addr learned my addr 172.21.15.152:0/1712305157 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:37.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c27ba700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9bc0cdd30 0x7fd9bc0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:37.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c1fb9700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9bc06a820 0x7fd9bc156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:37.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c17b8700 1 -- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9bc0cdd30 msgr2=0x7fd9bc0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:37.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c17b8700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9bc0cdd30 0x7fd9bc0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c17b8700 1 -- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9bc06a820 msgr2=0x7fd9bc156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:37.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c17b8700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9bc06a820 0x7fd9bc156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c17b8700 1 -- 172.21.15.152:0/1712305157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4009a70 con 0x7fd9bc06b370 2023-10-16T20:06:37.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c17b8700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 0x7fd9bc0c8370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800d7d0 tx=0x7fd9b800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:37.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80125f0 con 0x7fd9bc06b370 2023-10-16T20:06:37.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8012750 con 0x7fd9bc06b370 2023-10-16T20:06:37.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc0c7890 con 0x7fd9bc06b370 2023-10-16T20:06:37.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8012ac0 con 0x7fd9bc06b370 2023-10-16T20:06:37.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.034+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc0c7e50 con 0x7fd9bc06b370 2023-10-16T20:06:37.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.035+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc072d10 con 0x7fd9bc06b370 2023-10-16T20:06:37.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.035+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd9b8012c20 con 0x7fd9bc06b370 2023-10-16T20:06:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.036+0000 7fd9b27fc700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd9a006af30 0x7fd9a006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.036+0000 7fd9c1fb9700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd9a006af30 0x7fd9a006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.036+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fd9b8089c20 con 0x7fd9bc06b370 2023-10-16T20:06:37.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.036+0000 7fd9c1fb9700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd9a006af30 0x7fd9a006d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000f60 tx=0x7fd9ac007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:37.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.040+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd9b8054a00 con 0x7fd9bc06b370 2023-10-16T20:06:37.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.279+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fd9bc0c8040 con 0x7fd9bc06b370 2023-10-16T20:06:37.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.873+0000 7fd9b27fc700 1 -- 172.21.15.152:0/1712305157 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fd9b8012ed0 con 0x7fd9bc06b370 2023-10-16T20:06:37.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd9a006af30 msgr2=0x7fd9a006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:37.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd9a006af30 0x7fd9a006d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000f60 tx=0x7fd9ac007be0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 msgr2=0x7fd9bc0c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:37.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 0x7fd9bc0c8370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800d7d0 tx=0x7fd9b800db90 comp rx=0 tx=0).stop 2023-10-16T20:06:37.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 shutdown_connections 2023-10-16T20:06:37.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd9a006af30 0x7fd9a006d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd9bc0cdd30 0x7fd9bc0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9bc06a820 0x7fd9bc156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 --2- 172.21.15.152:0/1712305157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9bc06b370 0x7fd9bc0c8370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:37.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 >> 172.21.15.152:0/1712305157 conn(0x7fd9bc0ccbe0 msgr2=0x7fd9bc15d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:37.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 shutdown_connections 2023-10-16T20:06:37.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:37.877+0000 7fd9c421d700 1 -- 172.21.15.152:0/1712305157 wait complete. 2023-10-16T20:06:37.882 INFO:teuthology.orchestra.run.smithi152.stderr:added data pool 4 to fsmap 2023-10-16T20:06:37.894 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:06:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.018+0000 7fc9bc9a3700 1 Processor -- start 2023-10-16T20:06:38.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.018+0000 7fc9bc9a3700 1 -- start start 2023-10-16T20:06:38.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9bc9a3700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc9b806af30 0x7fc9b806f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9bc9a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80721f0 0x7fc9b815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9bc9a3700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80cf830 con 0x7fc9b80af560 2023-10-16T20:06:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9bc9a3700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b8072640 con 0x7fc9b806af30 2023-10-16T20:06:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9bc9a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80cfab0 con 0x7fc9b80721f0 2023-10-16T20:06:38.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc9b806af30 0x7fc9b806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc9b806af30 0x7fc9b806f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58286/0 (socket says 172.21.15.152:58286) 2023-10-16T20:06:38.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 -- 172.21.15.152:0/142972370 learned_addr learned my addr 172.21.15.152:0/142972370 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:38.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b6d9d700 1 --2- 172.21.15.152:0/142972370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80721f0 0x7fc9b815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 -- 172.21.15.152:0/142972370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80721f0 msgr2=0x7fc9b815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 --2- 172.21.15.152:0/142972370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80721f0 0x7fc9b815f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 -- 172.21.15.152:0/142972370 >> v1:172.21.15.163:6789/0 conn(0x7fc9b80af560 legacy=0x7fc9b806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.019+0000 7fc9b5d9b700 1 -- 172.21.15.152:0/142972370 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80cfd90 con 0x7fc9b806af30 2023-10-16T20:06:38.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9b5d9b700 1 --2- 172.21.15.152:0/142972370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b806af30 0x7fc9b806f000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80098f0 tx=0x7fc9a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4963edfb5d81b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9b559a700 1 -- 172.21.15.152:0/142972370 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800b8a0 con 0x7fc9b806af30 2023-10-16T20:06:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9b559a700 1 -- 172.21.15.152:0/142972370 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a800ba00 con 0x7fc9b806af30 2023-10-16T20:06:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9b559a700 1 -- 172.21.15.152:0/142972370 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800bd90 con 0x7fc9b806af30 2023-10-16T20:06:38.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/142972370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b806af30 msgr2=0x7fc9b806f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/142972370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b806af30 0x7fc9b806f000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80098f0 tx=0x7fc9a8009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/142972370 shutdown_connections 2023-10-16T20:06:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/142972370 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b80721f0 0x7fc9b815f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/142972370 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b806af30 0x7fc9b806f000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/142972370 >> 172.21.15.152:0/142972370 conn(0x7fc9b80d0180 msgr2=0x7fc9b80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:38.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/142972370 shutdown_connections 2023-10-16T20:06:38.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.020+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/142972370 wait complete. 2023-10-16T20:06:38.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 Processor -- start 2023-10-16T20:06:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 -- start start 2023-10-16T20:06:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b806af30 0x7fc9b80c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80721f0 0x7fc9b809d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 0x7fc9b8157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80c46f0 con 0x7fc9b80af560 2023-10-16T20:06:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80b4d70 con 0x7fc9b80721f0 2023-10-16T20:06:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9bc9a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80b5050 con 0x7fc9b806af30 2023-10-16T20:06:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.022+0000 7fc9b6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 0x7fc9b8157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 0x7fc9b8157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58294/0 (socket says 172.21.15.152:58294) 2023-10-16T20:06:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 -- 172.21.15.152:0/258477564 learned_addr learned my addr 172.21.15.152:0/258477564 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b5d9b700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80721f0 0x7fc9b809d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b659c700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b806af30 0x7fc9b80c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 -- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b806af30 msgr2=0x7fc9b80c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b806af30 0x7fc9b80c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 -- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80721f0 msgr2=0x7fc9b809d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80721f0 0x7fc9b809d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 -- 172.21.15.152:0/258477564 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8009550 con 0x7fc9b80af560 2023-10-16T20:06:38.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b659c700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b806af30 0x7fc9b80c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9b6d9d700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 0x7fc9b8157480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0007e40 tx=0x7fc9b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000ede0 con 0x7fc9b80af560 2023-10-16T20:06:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0014420 con 0x7fc9b80af560 2023-10-16T20:06:38.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80b5330 con 0x7fc9b80af560 2023-10-16T20:06:38.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00147d0 con 0x7fc9b80af560 2023-10-16T20:06:38.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.023+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80c6c60 con 0x7fc9b80af560 2023-10-16T20:06:38.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.024+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b806e110 con 0x7fc9b80af560 2023-10-16T20:06:38.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.024+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc9b0014930 con 0x7fc9b80af560 2023-10-16T20:06:38.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.025+0000 7fc9a6ffd700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc99806af00 0x7fc99806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.025+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9b0089f70 con 0x7fc9b80af560 2023-10-16T20:06:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.025+0000 7fc9b659c700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc99806af00 0x7fc99806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.025+0000 7fc9b659c700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc99806af00 0x7fc99806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80cc970 tx=0x7fc9ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.029+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9b00bcca0 con 0x7fc9b80af560 2023-10-16T20:06:38.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.265+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9b806d510 con 0x7fc9b80af560 2023-10-16T20:06:38.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.265+0000 7fc9a6ffd700 1 -- 172.21.15.152:0/258477564 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fc9b806d510 con 0x7fc9b80af560 2023-10-16T20:06:38.268 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:38.268 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:37.280711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T20:06:38.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc99806af00 msgr2=0x7fc99806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc99806af00 0x7fc99806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80cc970 tx=0x7fc9ac009040 comp rx=0 tx=0).stop 2023-10-16T20:06:38.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 msgr2=0x7fc9b8157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 0x7fc9b8157480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0007e40 tx=0x7fc9b000e3c0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 shutdown_connections 2023-10-16T20:06:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc99806af00 0x7fc99806d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9b806af30 0x7fc9b80c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9b80af560 0x7fc9b8157480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 --2- 172.21.15.152:0/258477564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9b80721f0 0x7fc9b809d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 >> 172.21.15.152:0/258477564 conn(0x7fc9b80d0180 msgr2=0x7fc9b80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:38.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 shutdown_connections 2023-10-16T20:06:38.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.268+0000 7fc9bc9a3700 1 -- 172.21.15.152:0/258477564 wait complete. 2023-10-16T20:06:38.272 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 7 2023-10-16T20:06:38.282 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:38.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.400+0000 7f573eceb700 1 Processor -- start 2023-10-16T20:06:38.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573eceb700 1 -- start start 2023-10-16T20:06:38.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573eceb700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f57380cf7d0 0x7f573815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573eceb700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f57380ca7d0 0x7f5738071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573eceb700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380cfeb0 con 0x7f573806a820 2023-10-16T20:06:38.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573eceb700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380ce410 con 0x7f57380ca7d0 2023-10-16T20:06:38.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573eceb700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380cfc30 con 0x7f57380cf7d0 2023-10-16T20:06:38.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573d288700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f57380ca7d0 0x7f5738071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573d288700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f57380ca7d0 0x7f5738071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58302/0 (socket says 172.21.15.152:58302) 2023-10-16T20:06:38.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.401+0000 7f573d288700 1 -- 172.21.15.152:0/3269310920 learned_addr learned my addr 172.21.15.152:0/3269310920 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:38.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f5737fff700 1 --2- 172.21.15.152:0/3269310920 >> v2:172.21.15.163:3300/0 conn(0x7f57380cf7d0 0x7f573815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f573d288700 1 -- 172.21.15.152:0/3269310920 >> v2:172.21.15.163:3300/0 conn(0x7f57380cf7d0 msgr2=0x7f573815e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:38.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f573d288700 1 --2- 172.21.15.152:0/3269310920 >> v2:172.21.15.163:3300/0 conn(0x7f57380cf7d0 0x7f573815e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f573d288700 1 -- 172.21.15.152:0/3269310920 >> v1:172.21.15.163:6789/0 conn(0x7f573806a820 legacy=0x7f573806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f573d288700 1 -- 172.21.15.152:0/3269310920 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380af9d0 con 0x7f57380ca7d0 2023-10-16T20:06:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f573d288700 1 --2- 172.21.15.152:0/3269310920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380ca7d0 0x7f5738071ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f573806c8a0 tx=0x7f573000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b387e471ef31244c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f57377fe700 1 -- 172.21.15.152:0/3269310920 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000e070 con 0x7f57380ca7d0 2023-10-16T20:06:38.408 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f57377fe700 1 -- 172.21.15.152:0/3269310920 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000b9c0 con 0x7f57380ca7d0 2023-10-16T20:06:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.402+0000 7f57377fe700 1 -- 172.21.15.152:0/3269310920 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000bd70 con 0x7f57380ca7d0 2023-10-16T20:06:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 -- 172.21.15.152:0/3269310920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380ca7d0 msgr2=0x7f5738071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 --2- 172.21.15.152:0/3269310920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380ca7d0 0x7f5738071ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f573806c8a0 tx=0x7f573000b330 comp rx=0 tx=0).stop 2023-10-16T20:06:38.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 -- 172.21.15.152:0/3269310920 shutdown_connections 2023-10-16T20:06:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 --2- 172.21.15.152:0/3269310920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380ca7d0 0x7f5738071ea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 --2- 172.21.15.152:0/3269310920 >> v2:172.21.15.163:3300/0 conn(0x7f57380cf7d0 0x7f573815e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 -- 172.21.15.152:0/3269310920 >> 172.21.15.152:0/3269310920 conn(0x7f57380d0180 msgr2=0x7f57380d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 -- 172.21.15.152:0/3269310920 shutdown_connections 2023-10-16T20:06:38.410 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.403+0000 7f573eceb700 1 -- 172.21.15.152:0/3269310920 wait complete. 2023-10-16T20:06:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.404+0000 7f573eceb700 1 Processor -- start 2023-10-16T20:06:38.411 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.404+0000 7f573eceb700 1 -- start start 2023-10-16T20:06:38.413 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f573806a820 0x7f57380c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.413 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57380ca7d0 0x7f57380c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.413 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 0x7f573815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57380acdf0 con 0x7f57380cf7d0 2023-10-16T20:06:38.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57380c99a0 con 0x7f573806a820 2023-10-16T20:06:38.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57380c9c80 con 0x7f57380ca7d0 2023-10-16T20:06:38.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 0x7f573815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 0x7f573815ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58308/0 (socket says 172.21.15.152:58308) 2023-10-16T20:06:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 -- 172.21.15.152:0/85725854 learned_addr learned my addr 172.21.15.152:0/85725854 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573ca87700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f573806a820 0x7f57380c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f5737fff700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57380ca7d0 0x7f57380c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 -- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57380ca7d0 msgr2=0x7f57380c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57380ca7d0 0x7f57380c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 -- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f573806a820 msgr2=0x7f57380c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f573806a820 0x7f57380c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 -- 172.21.15.152:0/85725854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009b30 con 0x7f57380cf7d0 2023-10-16T20:06:38.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f5737fff700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57380ca7d0 0x7f57380c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:38.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573d288700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 0x7f573815ff20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5730009fd0 tx=0x7f5730004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730004930 con 0x7f57380cf7d0 2023-10-16T20:06:38.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300092e0 con 0x7f57380cf7d0 2023-10-16T20:06:38.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57380c9f60 con 0x7f57380cf7d0 2023-10-16T20:06:38.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573001c680 con 0x7f57380cf7d0 2023-10-16T20:06:38.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.405+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57380c9520 con 0x7f57380cf7d0 2023-10-16T20:06:38.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.406+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57380ad270 con 0x7f57380cf7d0 2023-10-16T20:06:38.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.407+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f573001c7e0 con 0x7f57380cf7d0 2023-10-16T20:06:38.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.407+0000 7f57357fa700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f571c06af00 0x7f571c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.407+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f573008b160 con 0x7f57380cf7d0 2023-10-16T20:06:38.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.407+0000 7f573ca87700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f571c06af00 0x7f571c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.407+0000 7f573ca87700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f571c06af00 0x7f571c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f572c007fd0 tx=0x7f572c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.411+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5730055fb0 con 0x7f57380cf7d0 2023-10-16T20:06:38.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.603+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f573804ebb0 con 0x7f57380cf7d0 2023-10-16T20:06:38.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.604+0000 7f57357fa700 1 -- 172.21.15.152:0/85725854 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f57300595d0 con 0x7f57380cf7d0 2023-10-16T20:06:38.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:38.606 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:38.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f571c06af00 msgr2=0x7f571c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f571c06af00 0x7f571c06d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f572c007fd0 tx=0x7f572c009040 comp rx=0 tx=0).stop 2023-10-16T20:06:38.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 msgr2=0x7f573815ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 0x7f573815ff20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5730009fd0 tx=0x7f5730004b20 comp rx=0 tx=0).stop 2023-10-16T20:06:38.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 shutdown_connections 2023-10-16T20:06:38.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f571c06af00 0x7f571c06d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57380cf7d0 0x7f573815ff20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f573806a820 0x7f57380c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 --2- 172.21.15.152:0/85725854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f57380ca7d0 0x7f57380c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 >> 172.21.15.152:0/85725854 conn(0x7f57380d0180 msgr2=0x7f57381599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:38.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 shutdown_connections 2023-10-16T20:06:38.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.606+0000 7f573eceb700 1 -- 172.21.15.152:0/85725854 wait complete. 2023-10-16T20:06:38.620 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:38.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.740+0000 7fbf22e44700 1 Processor -- start 2023-10-16T20:06:38.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.740+0000 7fbf22e44700 1 -- start start 2023-10-16T20:06:38.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.740+0000 7fbf22e44700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbf1c0cf7d0 0x7fbf1c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.740+0000 7fbf22e44700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0cfeb0 con 0x7fbf1c06a820 2023-10-16T20:06:38.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.740+0000 7fbf22e44700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0cfc30 con 0x7fbf1c0ca7d0 2023-10-16T20:06:38.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.740+0000 7fbf22e44700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ce410 con 0x7fbf1c0cf7d0 2023-10-16T20:06:38.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbf1c06a820 0x7fbf1c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38510/0 (socket says 172.21.15.152:38510) 2023-10-16T20:06:38.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 -- 172.21.15.152:0/769243807 learned_addr learned my addr 172.21.15.152:0/769243807 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:38.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228805778 0 0) 0x7fbf1c0cfeb0 con 0x7fbf1c06a820 2023-10-16T20:06:38.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1bfff700 1 --2- 172.21.15.152:0/769243807 >> v2:172.21.15.163:3300/0 conn(0x7fbf1c0cf7d0 0x7fbf1c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf0c0035b0 con 0x7fbf1c06a820 2023-10-16T20:06:38.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 392494579 0 0) 0x7fbf0c0035b0 con 0x7fbf1c06a820 2023-10-16T20:06:38.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 >> v2:172.21.15.163:3300/0 conn(0x7fbf1c0cf7d0 msgr2=0x7fbf1c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:38.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 --2- 172.21.15.152:0/769243807 >> v2:172.21.15.163:3300/0 conn(0x7fbf1c0cf7d0 0x7fbf1c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 >> v1:172.21.15.163:6789/0 conn(0x7fbf1c0ca7d0 legacy=0x7fbf1c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0af9d0 con 0x7fbf1c06a820 2023-10-16T20:06:38.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fbf10001670 con 0x7fbf1c06a820 2023-10-16T20:06:38.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 >> v1:172.21.15.152:6789/0 conn(0x7fbf1c06a820 legacy=0x7fbf1c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0c003a00 0x7fbf0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf0c004850 0x7fbf0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c005330 0x7fbf0c014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ce410 con 0x7fbf0c003a00 2023-10-16T20:06:38.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c014a10 con 0x7fbf0c005330 2023-10-16T20:06:38.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c014bd0 con 0x7fbf0c004850 2023-10-16T20:06:38.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0c003a00 0x7fbf0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf213e1700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c005330 0x7fbf0c014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf1bfff700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf0c004850 0x7fbf0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 -- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf0c004850 msgr2=0x7fbf0c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:38.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf0c004850 0x7fbf0c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 -- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c005330 msgr2=0x7fbf0c014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:38.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c005330 0x7fbf0c014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf20be0700 1 -- 172.21.15.152:0/769243807 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0035b0 con 0x7fbf0c003a00 2023-10-16T20:06:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.741+0000 7fbf213e1700 1 -- 172.21.15.152:0/769243807 reap_dead start 2023-10-16T20:06:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf20be0700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0c003a00 0x7fbf0c003e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000c210 tx=0x7fbf0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a940c33b10ae26b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10007c10 con 0x7fbf0c003a00 2023-10-16T20:06:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000cdd0 con 0x7fbf0c003a00 2023-10-16T20:06:38.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf1b7fe700 1 -- 172.21.15.152:0/769243807 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10005ba0 con 0x7fbf0c003a00 2023-10-16T20:06:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 -- 172.21.15.152:0/769243807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0c003a00 msgr2=0x7fbf0c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0c003a00 0x7fbf0c003e20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000c210 tx=0x7fbf0c005880 comp rx=0 tx=0).stop 2023-10-16T20:06:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 -- 172.21.15.152:0/769243807 shutdown_connections 2023-10-16T20:06:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 --2- 172.21.15.152:0/769243807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0c003a00 0x7fbf0c003e20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 -- 172.21.15.152:0/769243807 >> 172.21.15.152:0/769243807 conn(0x7fbf1c0d0180 msgr2=0x7fbf1c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 -- 172.21.15.152:0/769243807 shutdown_connections 2023-10-16T20:06:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.742+0000 7fbf22e44700 1 -- 172.21.15.152:0/769243807 wait complete. 2023-10-16T20:06:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.743+0000 7fbf22e44700 1 Processor -- start 2023-10-16T20:06:38.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 -- start start 2023-10-16T20:06:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c003a00 0x7fbf1c161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 0x7fbf1c1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf1c06e150 0x7fbf1c06e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c1554b0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0adae0 con 0x7fbf0c003a00 2023-10-16T20:06:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf22e44700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ad520 con 0x7fbf1c06e150 2023-10-16T20:06:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf1bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 0x7fbf1c1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf1bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 0x7fbf1c1617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58326/0 (socket says 172.21.15.152:58326) 2023-10-16T20:06:38.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.744+0000 7fbf1bfff700 1 -- 172.21.15.152:0/1340325097 learned_addr learned my addr 172.21.15.152:0/1340325097 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf20be0700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c003a00 0x7fbf1c161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf213e1700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf1c06e150 0x7fbf1c06e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf1bfff700 1 -- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf1c06e150 msgr2=0x7fbf1c06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf1bfff700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf1c06e150 0x7fbf1c06e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf1bfff700 1 -- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c003a00 msgr2=0x7fbf1c161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf1bfff700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c003a00 0x7fbf1c161270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf1bfff700 1 -- 172.21.15.152:0/1340325097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0ad800 con 0x7fbf1c0acf50 2023-10-16T20:06:38.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf1bfff700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 0x7fbf1c1617b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf08010890 tx=0x7fbf08010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08004230 con 0x7fbf1c0acf50 2023-10-16T20:06:38.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800c050 con 0x7fbf1c0acf50 2023-10-16T20:06:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c1550d0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf080036a0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.745+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c06ecf0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.746+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c06efd0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.746+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf08003800 con 0x7fbf1c0acf50 2023-10-16T20:06:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.747+0000 7fbf197fa700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbf0006af00 0x7fbf0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.747+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf08089f90 con 0x7fbf1c0acf50 2023-10-16T20:06:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.747+0000 7fbf20be0700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbf0006af00 0x7fbf0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.747+0000 7fbf20be0700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbf0006af00 0x7fbf0006d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbf10015040 tx=0x7fbf10007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:38.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.751+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf08054de0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.946+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf1c1555f0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.947+0000 7fbf197fa700 1 -- 172.21.15.152:0/1340325097 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fbf1c1555f0 con 0x7fbf1c0acf50 2023-10-16T20:06:38.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:38.950 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:38.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.949+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbf0006af00 msgr2=0x7fbf0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.949+0000 7fbf22e44700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbf0006af00 0x7fbf0006d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbf10015040 tx=0x7fbf10007000 comp rx=0 tx=0).stop 2023-10-16T20:06:38.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 msgr2=0x7fbf1c1617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:38.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 0x7fbf1c1617b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf08010890 tx=0x7fbf08010c50 comp rx=0 tx=0).stop 2023-10-16T20:06:38.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 shutdown_connections 2023-10-16T20:06:38.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbf0006af00 0x7fbf0006d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf1c06e150 0x7fbf1c06e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf0c003a00 0x7fbf1c161270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 --2- 172.21.15.152:0/1340325097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf1c0acf50 0x7fbf1c1617b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:38.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 >> 172.21.15.152:0/1340325097 conn(0x7fbf1c0d0180 msgr2=0x7fbf1c0b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:38.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 shutdown_connections 2023-10-16T20:06:38.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:38.950+0000 7fbf22e44700 1 -- 172.21.15.152:0/1340325097 wait complete. 2023-10-16T20:06:38.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:06:39.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.097+0000 7f870699e700 1 Processor -- start 2023-10-16T20:06:39.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.097+0000 7f870699e700 1 -- start start 2023-10-16T20:06:39.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870699e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f870015b2c0 0x7f87000cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870699e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f87000ce030 0x7f87000b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870699e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87000b11b0 con 0x7f87000cceb0 2023-10-16T20:06:39.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870699e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000ce790 con 0x7f870015b2c0 2023-10-16T20:06:39.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870699e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000b0ba0 con 0x7f87000ce030 2023-10-16T20:06:39.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870599c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f870015b2c0 0x7f87000cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870519b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f87000cceb0 0x7f87000cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38532/0 (socket says 172.21.15.152:38532) 2023-10-16T20:06:39.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.098+0000 7f870519b700 1 -- 172.21.15.152:0/14714457 learned_addr learned my addr 172.21.15.152:0/14714457 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:39.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870619d700 1 --2- 172.21.15.152:0/14714457 >> v2:172.21.15.163:3300/0 conn(0x7f87000ce030 0x7f87000b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870599c700 1 -- 172.21.15.152:0/14714457 >> v2:172.21.15.163:3300/0 conn(0x7f87000ce030 msgr2=0x7f87000b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:39.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870599c700 1 --2- 172.21.15.152:0/14714457 >> v2:172.21.15.163:3300/0 conn(0x7f87000ce030 0x7f87000b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870599c700 1 -- 172.21.15.152:0/14714457 >> v1:172.21.15.152:6789/0 conn(0x7f87000cceb0 legacy=0x7f87000cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870599c700 1 -- 172.21.15.152:0/14714457 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000ce4b0 con 0x7f870015b2c0 2023-10-16T20:06:39.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870499a700 1 -- 172.21.15.152:0/14714457 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224727448 0 0) 0x7f87000b11b0 con 0x7f87000cceb0 2023-10-16T20:06:39.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870599c700 1 --2- 172.21.15.152:0/14714457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f870015b2c0 0x7f87000cdaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87000cb7a0 tx=0x7f86f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f06fb83eaf23d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:39.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870499a700 1 -- 172.21.15.152:0/14714457 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0011830 con 0x7f870015b2c0 2023-10-16T20:06:39.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870499a700 1 -- 172.21.15.152:0/14714457 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0011990 con 0x7f870015b2c0 2023-10-16T20:06:39.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870499a700 1 -- 172.21.15.152:0/14714457 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0011d20 con 0x7f870015b2c0 2023-10-16T20:06:39.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870699e700 1 -- 172.21.15.152:0/14714457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f870015b2c0 msgr2=0x7f87000cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.099+0000 7f870699e700 1 --2- 172.21.15.152:0/14714457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f870015b2c0 0x7f87000cdaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87000cb7a0 tx=0x7f86f0009b20 comp rx=0 tx=0).stop 2023-10-16T20:06:39.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.100+0000 7f870699e700 1 -- 172.21.15.152:0/14714457 shutdown_connections 2023-10-16T20:06:39.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.100+0000 7f870699e700 1 --2- 172.21.15.152:0/14714457 >> v2:172.21.15.163:3300/0 conn(0x7f87000ce030 0x7f87000b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.100+0000 7f870699e700 1 --2- 172.21.15.152:0/14714457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f870015b2c0 0x7f87000cdaf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.100+0000 7f870699e700 1 -- 172.21.15.152:0/14714457 >> 172.21.15.152:0/14714457 conn(0x7f870009a4a0 msgr2=0x7f87000d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:39.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.100+0000 7f870699e700 1 -- 172.21.15.152:0/14714457 shutdown_connections 2023-10-16T20:06:39.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.100+0000 7f870699e700 1 -- 172.21.15.152:0/14714457 wait complete. 2023-10-16T20:06:39.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.101+0000 7f870699e700 1 Processor -- start 2023-10-16T20:06:39.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.101+0000 7f870699e700 1 -- start start 2023-10-16T20:06:39.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870699e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 0x7f87000c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870699e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87000ce030 0x7f87001506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870699e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870015b2c0 0x7f87000ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870699e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700150c10 con 0x7f87000cceb0 2023-10-16T20:06:39.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870699e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87000c8c30 con 0x7f87000ce030 2023-10-16T20:06:39.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870699e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000c8e80 con 0x7f870015b2c0 2023-10-16T20:06:39.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870599c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 0x7f87000c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870599c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 0x7f87000c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58338/0 (socket says 172.21.15.152:58338) 2023-10-16T20:06:39.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.102+0000 7f870599c700 1 -- 172.21.15.152:0/3100827777 learned_addr learned my addr 172.21.15.152:0/3100827777 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:39.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870599c700 1 -- 172.21.15.152:0/3100827777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870015b2c0 msgr2=0x7f87000ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870599c700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870015b2c0 0x7f87000ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870599c700 1 -- 172.21.15.152:0/3100827777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87000ce030 msgr2=0x7f87001506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870599c700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87000ce030 0x7f87001506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870599c700 1 -- 172.21.15.152:0/3100827777 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00094a0 con 0x7f87000cceb0 2023-10-16T20:06:39.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870599c700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 0x7f87000c9f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009b60 tx=0x7f86f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:39.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00038a0 con 0x7f87000cceb0 2023-10-16T20:06:39.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f001e070 con 0x7f87000cceb0 2023-10-16T20:06:39.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87000c9160 con 0x7f87000cceb0 2023-10-16T20:06:39.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0003c00 con 0x7f87000cceb0 2023-10-16T20:06:39.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.103+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87000c9720 con 0x7f87000cceb0 2023-10-16T20:06:39.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.104+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870004ebb0 con 0x7f87000cceb0 2023-10-16T20:06:39.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.104+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f86f002d450 con 0x7f87000cceb0 2023-10-16T20:06:39.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.105+0000 7f86f67fc700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.105+0000 7f870519b700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.105+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86f008a8f0 con 0x7f87000cceb0 2023-10-16T20:06:39.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.105+0000 7f870519b700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0011e0 tx=0x7f86fc0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:39.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.109+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86f0055740 con 0x7f87000cceb0 2023-10-16T20:06:39.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.342+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f870015a720 con 0x7f87000cceb0 2023-10-16T20:06:39.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.343+0000 7f86f67fc700 1 -- 172.21.15.152:0/3100827777 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f86f0020090 con 0x7f87000cceb0 2023-10-16T20:06:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:39.345 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:37.280711+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T20:06:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 msgr2=0x7f86e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0011e0 tx=0x7f86fc0079b0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 msgr2=0x7f87000c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 0x7f87000c9f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009b60 tx=0x7f86f0004750 comp rx=0 tx=0).stop 2023-10-16T20:06:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 shutdown_connections 2023-10-16T20:06:39.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.345+0000 7f870699e700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870015b2c0 0x7f87000ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.346+0000 7f870699e700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cceb0 0x7f87000c9f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.346+0000 7f870699e700 1 --2- 172.21.15.152:0/3100827777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87000ce030 0x7f87001506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.346+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 >> 172.21.15.152:0/3100827777 conn(0x7f870009a4a0 msgr2=0x7f87000af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:39.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.346+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 shutdown_connections 2023-10-16T20:06:39.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.346+0000 7f870699e700 1 -- 172.21.15.152:0/3100827777 wait complete. 2023-10-16T20:06:39.350 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 7 2023-10-16T20:06:39.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:39.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.478+0000 7f41f7dc2700 1 Processor -- start 2023-10-16T20:06:39.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.478+0000 7f41f7dc2700 1 -- start start 2023-10-16T20:06:39.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f7dc2700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f015daa0 0x7f41f00af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f7dc2700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41f0071f60 0x7f41f006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f7dc2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f015ed10 con 0x7f41f00af560 2023-10-16T20:06:39.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f7dc2700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f015de80 con 0x7f41f0071f60 2023-10-16T20:06:39.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f7dc2700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f015e100 con 0x7f41f015daa0 2023-10-16T20:06:39.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f635f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41f0071f60 0x7f41f006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f535d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f41f00af560 0x7f41f0071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38544/0 (socket says 172.21.15.152:38544) 2023-10-16T20:06:39.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.479+0000 7f41f535d700 1 -- 172.21.15.152:0/1826826688 learned_addr learned my addr 172.21.15.152:0/1826826688 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:39.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f635f700 1 -- 172.21.15.152:0/1826826688 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f015daa0 msgr2=0x7f41f00af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:39.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f635f700 1 --2- 172.21.15.152:0/1826826688 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f015daa0 0x7f41f00af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f635f700 1 -- 172.21.15.152:0/1826826688 >> v1:172.21.15.152:6789/0 conn(0x7f41f00af560 legacy=0x7f41f0071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f635f700 1 -- 172.21.15.152:0/1826826688 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f015e3e0 con 0x7f41f0071f60 2023-10-16T20:06:39.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f635f700 1 --2- 172.21.15.152:0/1826826688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f0071f60 0x7f41f006d100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009d90 tx=0x7f41e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb567079e2952e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:39.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f4b5c700 1 -- 172.21.15.152:0/1826826688 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e800e070 con 0x7f41f0071f60 2023-10-16T20:06:39.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f4b5c700 1 -- 172.21.15.152:0/1826826688 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e800bbd0 con 0x7f41f0071f60 2023-10-16T20:06:39.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f4b5c700 1 -- 172.21.15.152:0/1826826688 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8012430 con 0x7f41f0071f60 2023-10-16T20:06:39.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f7dc2700 1 -- 172.21.15.152:0/1826826688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f0071f60 msgr2=0x7f41f006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/1826826688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f0071f60 0x7f41f006d100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009d90 tx=0x7f41e800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:39.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f7dc2700 1 -- 172.21.15.152:0/1826826688 shutdown_connections 2023-10-16T20:06:39.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/1826826688 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f015daa0 0x7f41f00af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/1826826688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f0071f60 0x7f41f006d100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.480+0000 7f41f7dc2700 1 -- 172.21.15.152:0/1826826688 >> 172.21.15.152:0/1826826688 conn(0x7f41f00d0180 msgr2=0x7f41f00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:39.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.481+0000 7f41f7dc2700 1 -- 172.21.15.152:0/1826826688 shutdown_connections 2023-10-16T20:06:39.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.481+0000 7f41f7dc2700 1 -- 172.21.15.152:0/1826826688 wait complete. 2023-10-16T20:06:39.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 Processor -- start 2023-10-16T20:06:39.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 -- start start 2023-10-16T20:06:39.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f0071f60 0x7f41f00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41f00af560 0x7f41f0158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 0x7f41f00b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b3ca0 con 0x7f41f015daa0 2023-10-16T20:06:39.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0159300 con 0x7f41f00af560 2023-10-16T20:06:39.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f7dc2700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00ad930 con 0x7f41f0071f60 2023-10-16T20:06:39.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.482+0000 7f41f635f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 0x7f41f00b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 0x7f41f00b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58356/0 (socket says 172.21.15.152:58356) 2023-10-16T20:06:39.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 -- 172.21.15.152:0/4202399209 learned_addr learned my addr 172.21.15.152:0/4202399209 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:39.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 -- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f0071f60 msgr2=0x7f41f00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f5b5e700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f0071f60 0x7f41f00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f0071f60 0x7f41f00b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 -- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41f00af560 msgr2=0x7f41f0158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f535d700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41f00af560 0x7f41f0158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41f00af560 0x7f41f0158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 -- 172.21.15.152:0/4202399209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8009a70 con 0x7f41f015daa0 2023-10-16T20:06:39.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f535d700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41f00af560 0x7f41f0158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:39.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f635f700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 0x7f41f00b5180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41e800b370 tx=0x7f41e8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:39.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8012430 con 0x7f41f015daa0 2023-10-16T20:06:39.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e8020070 con 0x7f41f015daa0 2023-10-16T20:06:39.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f00adc10 con 0x7f41f015daa0 2023-10-16T20:06:39.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8004280 con 0x7f41f015daa0 2023-10-16T20:06:39.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.483+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00ae1d0 con 0x7f41f015daa0 2023-10-16T20:06:39.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.484+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f004ebb0 con 0x7f41f015daa0 2023-10-16T20:06:39.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.485+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f41e80043e0 con 0x7f41f015daa0 2023-10-16T20:06:39.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.485+0000 7f41e67fc700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f41d406af00 0x7f41d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:39.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.485+0000 7f41f5b5e700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f41d406af00 0x7f41d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:39.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.485+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41e8022070 con 0x7f41f015daa0 2023-10-16T20:06:39.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.485+0000 7f41f5b5e700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f41d406af00 0x7f41d406d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41e000a810 tx=0x7f41e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:39.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.489+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41e80567c0 con 0x7f41f015daa0 2023-10-16T20:06:39.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.679+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41f0072690 con 0x7f41f015daa0 2023-10-16T20:06:39.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.680+0000 7f41e67fc700 1 -- 172.21.15.152:0/4202399209 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f41e8059de0 con 0x7f41f015daa0 2023-10-16T20:06:39.683 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:39.683 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:39.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f41d406af00 msgr2=0x7f41d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f41d406af00 0x7f41d406d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41e000a810 tx=0x7f41e0008040 comp rx=0 tx=0).stop 2023-10-16T20:06:39.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 msgr2=0x7f41f00b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:39.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 0x7f41f00b5180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41e800b370 tx=0x7f41e8004b20 comp rx=0 tx=0).stop 2023-10-16T20:06:39.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 shutdown_connections 2023-10-16T20:06:39.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f41d406af00 0x7f41d406d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41f0071f60 0x7f41f00b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41f015daa0 0x7f41f00b5180 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 --2- 172.21.15.152:0/4202399209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41f00af560 0x7f41f0158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:39.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 >> 172.21.15.152:0/4202399209 conn(0x7f41f00d0180 msgr2=0x7f41f00b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:39.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 shutdown_connections 2023-10-16T20:06:39.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:39.683+0000 7f41f7dc2700 1 -- 172.21.15.152:0/4202399209 wait complete. 2023-10-16T20:06:40.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T20:06:32.144481+0000', 'modified': '2023-10-16T20:06:37.280711+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6837/1439878702', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6835', 'nonce': 1439878702}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 1439878702}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-16T20:06:40.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T20:06:40.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T20:06:40.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.222+0000 7f0d40ca1700 1 Processor -- start 2023-10-16T20:06:40.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.222+0000 7f0d40ca1700 1 -- start start 2023-10-16T20:06:40.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d40ca1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c152470 0x7f0d3c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d40ca1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0d3c0cb8d0 0x7f0d3c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d40ca1700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d3c0b3240 0x7f0d3c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d40ca1700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0b36d0 con 0x7f0d3c0b3240 2023-10-16T20:06:40.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d40ca1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c071200 con 0x7f0d3c0cb8d0 2023-10-16T20:06:40.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d40ca1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c070d70 con 0x7f0d3c152470 2023-10-16T20:06:40.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d3c0b3240 0x7f0d3c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d3c0b3240 0x7f0d3c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58364/0 (socket says 172.21.15.152:58364) 2023-10-16T20:06:40.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1937137981 learned_addr learned my addr 172.21.15.152:0/1937137981 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1937137981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c152470 msgr2=0x7f0d3c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1937137981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c152470 0x7f0d3c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1937137981 >> v2:172.21.15.163:3300/0 conn(0x7f0d3c0cb8d0 msgr2=0x7f0d3c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1937137981 >> v2:172.21.15.163:3300/0 conn(0x7f0d3c0cb8d0 0x7f0d3c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1937137981 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c070440 con 0x7f0d3c0b3240 2023-10-16T20:06:40.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1937137981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c0b60f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c071370 tx=0x7f0d3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7db63058919cd95 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3959a700 1 -- 172.21.15.152:0/1937137981 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400e070 con 0x7f0d3c0b3240 2023-10-16T20:06:40.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3959a700 1 -- 172.21.15.152:0/1937137981 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400b9c0 con 0x7f0d3c0b3240 2023-10-16T20:06:40.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.223+0000 7f0d3959a700 1 -- 172.21.15.152:0/1937137981 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400bd70 con 0x7f0d3c0b3240 2023-10-16T20:06:40.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 -- 172.21.15.152:0/1937137981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c0b3240 msgr2=0x7f0d3c0b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/1937137981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c0b60f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c071370 tx=0x7f0d3400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:40.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 -- 172.21.15.152:0/1937137981 shutdown_connections 2023-10-16T20:06:40.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/1937137981 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c152470 0x7f0d3c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/1937137981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c0b60f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/1937137981 >> v2:172.21.15.163:3300/0 conn(0x7f0d3c0cb8d0 0x7f0d3c0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 -- 172.21.15.152:0/1937137981 >> 172.21.15.152:0/1937137981 conn(0x7f0d3c0cdd00 msgr2=0x7f0d3c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 -- 172.21.15.152:0/1937137981 shutdown_connections 2023-10-16T20:06:40.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.224+0000 7f0d40ca1700 1 -- 172.21.15.152:0/1937137981 wait complete. 2023-10-16T20:06:40.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.225+0000 7f0d40ca1700 1 Processor -- start 2023-10-16T20:06:40.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.225+0000 7f0d40ca1700 1 -- start start 2023-10-16T20:06:40.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d40ca1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d40ca1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c0cb8d0 0x7f0d3c156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d40ca1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 0x7f0d3c06cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d40ca1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c06d960 con 0x7f0d3c152470 2023-10-16T20:06:40.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d40ca1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c15d2d0 con 0x7f0d3c0b3240 2023-10-16T20:06:40.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d40ca1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c1f71b0 con 0x7f0d3c0cb8d0 2023-10-16T20:06:40.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 0x7f0d3c06cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 0x7f0d3c06cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58370/0 (socket says 172.21.15.152:58370) 2023-10-16T20:06:40.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/2009317389 learned_addr learned my addr 172.21.15.152:0/2009317389 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c0cb8d0 0x7f0d3c156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c0cb8d0 msgr2=0x7f0d3c156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c0cb8d0 0x7f0d3c156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.226+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d3c0b3240 msgr2=0x7f0d3c1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c1f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/2009317389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009b30 con 0x7f0d3c152470 2023-10-16T20:06:40.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:40.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 0x7f0d3c06cd80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400b370 tx=0x7f0d34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d2affd700 1 -- 172.21.15.152:0/2009317389 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004310 con 0x7f0d3c152470 2023-10-16T20:06:40.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d2affd700 1 -- 172.21.15.152:0/2009317389 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34004490 con 0x7f0d3c152470 2023-10-16T20:06:40.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c15c9e0 con 0x7f0d3c152470 2023-10-16T20:06:40.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d2affd700 1 -- 172.21.15.152:0/2009317389 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34004840 con 0x7f0d3c152470 2023-10-16T20:06:40.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.227+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c15cf60 con 0x7f0d3c152470 2023-10-16T20:06:40.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.228+0000 7f0d2affd700 1 -- 172.21.15.152:0/2009317389 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d3401c440 con 0x7f0d3c152470 2023-10-16T20:06:40.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.229+0000 7f0d2affd700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d1c06af00 0x7f0d1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.229+0000 7f0d2affd700 1 -- 172.21.15.152:0/2009317389 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d3408b190 con 0x7f0d3c152470 2023-10-16T20:06:40.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.229+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d1c06af00 0x7f0d1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.229+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d1c06af00 0x7f0d1c06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d300099d0 tx=0x7f0d30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.231+0000 7f0d4ce8bb80 1 Processor -- start 2023-10-16T20:06:40.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.231+0000 7f0d4ce8bb80 1 -- start start 2023-10-16T20:06:40.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 0x55eed12a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed1219c20 con 0x55eed12a3010 2023-10-16T20:06:40.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed11fec10 con 0x55eed12c8220 2023-10-16T20:06:40.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eed11fc530 con 0x55eed12cd630 2023-10-16T20:06:40.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 0x55eed12a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 0x55eed12a36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58378/0 (socket says 172.21.15.152:58378) 2023-10-16T20:06:40.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1480564959 learned_addr learned my addr 172.21.15.152:0/1480564959 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 msgr2=0x55eed12cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 msgr2=0x55eed12cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1480564959 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed11b53a0 con 0x55eed12a3010 2023-10-16T20:06:40.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:40.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:40.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 0x55eed12a36c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d34060070 tx=0x7f0d34059860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1d4e19bd71ac26 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d1bfff700 1 -- 172.21.15.152:0/1480564959 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34059ca0 con 0x55eed12a3010 2023-10-16T20:06:40.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d1bfff700 1 -- 172.21.15.152:0/1480564959 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3405ddf0 con 0x55eed12a3010 2023-10-16T20:06:40.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.232+0000 7f0d1bfff700 1 -- 172.21.15.152:0/1480564959 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34061fa0 con 0x55eed12a3010 2023-10-16T20:06:40.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1480564959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 msgr2=0x55eed12a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 0x55eed12a36c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d34060070 tx=0x7f0d34059860 comp rx=0 tx=0).stop 2023-10-16T20:06:40.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1480564959 shutdown_connections 2023-10-16T20:06:40.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12a3010 0x55eed12a36c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1480564959 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1480564959 >> 172.21.15.152:0/1480564959 conn(0x55eed11d2d80 msgr2=0x55eed12edff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1480564959 shutdown_connections 2023-10-16T20:06:40.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.233+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1480564959 wait complete. 2023-10-16T20:06:40.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.234+0000 7f0d4ce8bb80 1 -- start start 2023-10-16T20:06:40.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.234+0000 7f0d4ce8bb80 1 Processor -- start 2023-10-16T20:06:40.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12a3010 0x55eed12bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed11f7e20 con 0x55eed12cd630 2023-10-16T20:06:40.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed11946c0 con 0x55eed12c8220 2023-10-16T20:06:40.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eed1194360 con 0x55eed12a3010 2023-10-16T20:06:40.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 10 client.0 _ll_register_callbacks cb 0x55eed0ff17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T20:06:40.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58384/0 (socket says 172.21.15.152:58384) 2023-10-16T20:06:40.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/3624993668 learned_addr learned my addr 172.21.15.152:0/3624993668 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12a3010 0x55eed12bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12a3010 msgr2=0x55eed12bb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12a3010 0x55eed12bb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 msgr2=0x55eed12d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/3624993668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c15cf60 con 0x55eed12cd630 2023-10-16T20:06:40.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12cb9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d340894b0 tx=0x7f0d34009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e982fe2b882b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d197fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T20:06:40.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d197fa700 1 -- 172.21.15.152:0/3624993668 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34061fa0 con 0x55eed12cd630 2023-10-16T20:06:40.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d197fa700 1 -- 172.21.15.152:0/3624993668 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d34059190 con 0x55eed12cd630 2023-10-16T20:06:40.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eed12985b0 con 0x55eed12cd630 2023-10-16T20:06:40.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d197fa700 1 -- 172.21.15.152:0/3624993668 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d34059350 con 0x55eed12cd630 2023-10-16T20:06:40.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-10-16T20:06:40.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55eed1022d90 con 0x55eed12cd630 2023-10-16T20:06:40.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.235+0000 7f0d197fa700 1 -- 172.21.15.152:0/3624993668 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eed12985b0 con 0x55eed12cd630 2023-10-16T20:06:40.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d197fa700 1 -- 172.21.15.152:0/3624993668 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0d34061b10 con 0x55eed12cd630 2023-10-16T20:06:40.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d4ce8bb80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T20:06:40.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d4ce8bb80 10 client.4431 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T20:06:40.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d4ce8bb80 20 client.4431 populate_metadata read hostname 'smithi152' 2023-10-16T20:06:40.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12c8890 0x55eed12c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d4ce8bb80 4 client.4431 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T20:06:40.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 --> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eed11f0e00 con 0x55eed12c8890 2023-10-16T20:06:40.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12c8890 0x55eed12c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d197fa700 10 client.4431 ms_handle_connect on v2:172.21.15.152:6835/1439878702 2023-10-16T20:06:40.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.236+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12c8890 0x55eed12c8c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb122ae45f5cd99 server_cookie=123f5b6532156e90 in_seq=0 out_seq=0 2023-10-16T20:06:40.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d197fa700 1 -- 172.21.15.152:0/3624993668 <== mds.0 v2:172.21.15.152:6835/1439878702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eed11f0e00 con 0x55eed12c8890 2023-10-16T20:06:40.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d197fa700 10 client.4431 handle_command_reply: tid=0 2023-10-16T20:06:40.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 client.4431 shutdown 2023-10-16T20:06:40.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 msgr2=0x55eed12cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12cb9d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d340894b0 tx=0x7f0d34009810 comp rx=0 tx=0).stop 2023-10-16T20:06:40.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 shutdown_connections 2023-10-16T20:06:40.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12c8890 0x55eed12c8c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12a3010 0x55eed12bb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12cb9d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d197fa700 0 client.4431 ms_handle_reset on v2:172.21.15.152:6835/1439878702 2023-10-16T20:06:40.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/3624993668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12c8220 0x55eed12d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 >> 172.21.15.152:0/3624993668 conn(0x55eed11d2d80 msgr2=0x55eed129a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 shutdown_connections 2023-10-16T20:06:40.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/3624993668 wait complete. 2023-10-16T20:06:40.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.237+0000 7f0d4ce8bb80 20 client.4431 trim_cache size 0 max 16384 2023-10-16T20:06:40.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.254+0000 7f0d4ce8bb80 1 Processor -- start 2023-10-16T20:06:40.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.254+0000 7f0d4ce8bb80 1 -- start start 2023-10-16T20:06:40.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed12eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 0x55eed12a4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed10788d0 con 0x55eed12c8220 2023-10-16T20:06:40.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed12a0650 con 0x55eed12a3010 2023-10-16T20:06:40.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eed12ee950 con 0x55eed12cd630 2023-10-16T20:06:40.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 0x55eed12a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 0x55eed12a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58390/0 (socket says 172.21.15.152:58390) 2023-10-16T20:06:40.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 -- 172.21.15.152:0/1950005536 learned_addr learned my addr 172.21.15.152:0/1950005536 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 -- 172.21.15.152:0/1950005536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 msgr2=0x55eed12a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 -- 172.21.15.152:0/1950005536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 msgr2=0x55eed12eb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed12eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 -- 172.21.15.152:0/1950005536 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed12a28c0 con 0x55eed12c8220 2023-10-16T20:06:40.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 0x55eed12a4820 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0096e0 tx=0x7f0d2c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2d79bdfe74df4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.255+0000 7f0d28ff9700 1 -- 172.21.15.152:0/1950005536 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00c070 con 0x55eed12c8220 2023-10-16T20:06:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d28ff9700 1 -- 172.21.15.152:0/1950005536 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c015680 con 0x55eed12c8220 2023-10-16T20:06:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d28ff9700 1 -- 172.21.15.152:0/1950005536 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0159f0 con 0x55eed12c8220 2023-10-16T20:06:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1950005536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 msgr2=0x55eed12a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 0x55eed12a4820 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0096e0 tx=0x7f0d2c0099f0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1950005536 shutdown_connections 2023-10-16T20:06:40.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12cd630 0x55eed12a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed12eb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1950005536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12c8220 0x55eed12a4820 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1950005536 >> 172.21.15.152:0/1950005536 conn(0x55eed11d2d80 msgr2=0x55eed12cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1950005536 shutdown_connections 2023-10-16T20:06:40.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.256+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1950005536 wait complete. 2023-10-16T20:06:40.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.257+0000 7f0d4ce8bb80 1 -- start start 2023-10-16T20:06:40.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.257+0000 7f0d4ce8bb80 1 Processor -- start 2023-10-16T20:06:40.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed13515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12c8220 0x55eed12c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed1351ea0 con 0x55eed12cd630 2023-10-16T20:06:40.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed12d2e80 con 0x55eed12a3010 2023-10-16T20:06:40.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eed12d30d0 con 0x55eed12c8220 2023-10-16T20:06:40.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d4ce8bb80 10 client.0 _ll_register_callbacks cb 0x7f0d34059a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T20:06:40.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d3ad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58398/0 (socket says 172.21.15.152:58398) 2023-10-16T20:06:40.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1718347320 learned_addr learned my addr 172.21.15.152:0/1718347320 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed13515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.258+0000 7f0d39d9b700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12c8220 0x55eed12c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12c8220 msgr2=0x55eed12c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12c8220 0x55eed12c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 msgr2=0x55eed13515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:40.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed13515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3ad9d700 1 -- 172.21.15.152:0/1718347320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c00e040 con 0x55eed12cd630 2023-10-16T20:06:40.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3ad9d700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12c6410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d34056150 tx=0x7f0d3401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41c5c29135f6b62 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d197fa700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T20:06:40.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d197fa700 1 -- 172.21.15.152:0/1718347320 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34061fa0 con 0x55eed12cd630 2023-10-16T20:06:40.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d197fa700 1 -- 172.21.15.152:0/1718347320 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d3405eb30 con 0x55eed12cd630 2023-10-16T20:06:40.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d3405ddf0 con 0x55eed12cd630 2023-10-16T20:06:40.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d197fa700 1 -- 172.21.15.152:0/1718347320 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d34059600 con 0x55eed12cd630 2023-10-16T20:06:40.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 10 client.4437 fetch_fsmap learned FSMap version 7 2023-10-16T20:06:40.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55eed100bc10 con 0x55eed12cd630 2023-10-16T20:06:40.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d197fa700 1 -- 172.21.15.152:0/1718347320 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3405ddf0 con 0x55eed12cd630 2023-10-16T20:06:40.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d197fa700 1 -- 172.21.15.152:0/1718347320 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0d3405ecf0 con 0x55eed12cd630 2023-10-16T20:06:40.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T20:06:40.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 10 client.4437 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T20:06:40.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 20 client.4437 populate_metadata read hostname 'smithi152' 2023-10-16T20:06:40.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12a3880 0x55eed12a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 4 client.4437 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T20:06:40.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 --> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eed11f0b20 con 0x55eed12a3880 2023-10-16T20:06:40.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.259+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12a3880 0x55eed12a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d197fa700 10 client.4437 ms_handle_connect on v2:172.21.15.152:6835/1439878702 2023-10-16T20:06:40.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d3a59c700 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12a3880 0x55eed12a3c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc0ea3ad1a0463a server_cookie=3c74deccc7cc0f92 in_seq=0 out_seq=0 2023-10-16T20:06:40.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d197fa700 1 -- 172.21.15.152:0/1718347320 <== mds.0 v2:172.21.15.152:6835/1439878702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55eed11f0b20 con 0x55eed12a3880 2023-10-16T20:06:40.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d197fa700 10 client.4437 handle_command_reply: tid=0 2023-10-16T20:06:40.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 client.4437 shutdown 2023-10-16T20:06:40.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 msgr2=0x55eed12c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12c6410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d34056150 tx=0x7f0d3401c000 comp rx=0 tx=0).stop 2023-10-16T20:06:40.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 shutdown_connections 2023-10-16T20:06:40.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eed12cd630 0x55eed12c6410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eed12a3010 0x55eed13515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55eed12a3880 0x55eed12a3c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 --2- 172.21.15.152:0/1718347320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55eed12c8220 0x55eed12c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 >> 172.21.15.152:0/1718347320 conn(0x55eed11d2d80 msgr2=0x55eed12d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d197fa700 0 client.4437 ms_handle_reset on v2:172.21.15.152:6835/1439878702 2023-10-16T20:06:40.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 shutdown_connections 2023-10-16T20:06:40.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 1 -- 172.21.15.152:0/1718347320 wait complete. 2023-10-16T20:06:40.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.260+0000 7f0d4ce8bb80 20 client.4437 trim_cache size 0 max 16384 2023-10-16T20:06:40.283 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:06:40.284 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "e602e5ee-bf17-44e1-9fbf-0f448134fb28", 2023-10-16T20:06:40.284 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2023-10-16T20:06:40.284 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4281, 2023-10-16T20:06:40.284 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2023-10-16T20:06:40.284 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2023-10-16T20:06:40.285 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2023-10-16T20:06:40.285 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 7.4100749979999998, 2023-10-16T20:06:40.285 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 7, 2023-10-16T20:06:40.285 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 26, 2023-10-16T20:06:40.285 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 25, 2023-10-16T20:06:40.285 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 14.960106272000001 2023-10-16T20:06:40.286 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:06:40.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d1c06af00 msgr2=0x7f0d1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d1c06af00 0x7f0d1c06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d300099d0 tx=0x7f0d30008040 comp rx=0 tx=0).stop 2023-10-16T20:06:40.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 msgr2=0x7f0d3c06cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 0x7f0d3c06cd80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400b370 tx=0x7f0d34004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 shutdown_connections 2023-10-16T20:06:40.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d1c06af00 0x7f0d1c06d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d3c152470 0x7f0d3c06cd80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d3c0b3240 0x7f0d3c1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 --2- 172.21.15.152:0/2009317389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d3c0cb8d0 0x7f0d3c156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 >> 172.21.15.152:0/2009317389 conn(0x7f0d3c0cdd00 msgr2=0x7f0d3c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 shutdown_connections 2023-10-16T20:06:40.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.261+0000 7f0d40ca1700 1 -- 172.21.15.152:0/2009317389 wait complete. 2023-10-16T20:06:40.290 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T20:06:40.291 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:40.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T20:06:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.410+0000 7fb5a2cca700 1 Processor -- start 2023-10-16T20:06:40.412 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.410+0000 7fb5a2cca700 1 -- start start 2023-10-16T20:06:40.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a2cca700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb59c15e7f0 0x7fb59c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a2cca700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0cfeb0 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a2cca700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0cfc30 con 0x7fb59c06a820 2023-10-16T20:06:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a2cca700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c0ce410 con 0x7fb59c15e7f0 2023-10-16T20:06:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a1267700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb59c15e7f0 0x7fb59c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb59bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb59c0cf7d0 0x7fb59c0ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38602/0 (socket says 172.21.15.152:38602) 2023-10-16T20:06:40.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb59bfff700 1 -- 172.21.15.152:0/3963460664 learned_addr learned my addr 172.21.15.152:0/3963460664 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:40.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a1267700 1 -- 172.21.15.152:0/3963460664 >> v1:172.21.15.163:6789/0 conn(0x7fb59c06a820 legacy=0x7fb59c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a1267700 1 -- 172.21.15.152:0/3963460664 >> v1:172.21.15.152:6789/0 conn(0x7fb59c0cf7d0 legacy=0x7fb59c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.411+0000 7fb5a1267700 1 -- 172.21.15.152:0/3963460664 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0af9d0 con 0x7fb59c15e7f0 2023-10-16T20:06:40.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a1267700 1 --2- 172.21.15.152:0/3963460664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c15e7f0 0x7fb59c071ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb594009d90 tx=0x7fb59400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401ab4b63232a6f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb59b7fe700 1 -- 172.21.15.152:0/3963460664 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400e070 con 0x7fb59c15e7f0 2023-10-16T20:06:40.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb59b7fe700 1 -- 172.21.15.152:0/3963460664 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400bbd0 con 0x7fb59c15e7f0 2023-10-16T20:06:40.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb59b7fe700 1 -- 172.21.15.152:0/3963460664 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594012430 con 0x7fb59c15e7f0 2023-10-16T20:06:40.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 -- 172.21.15.152:0/3963460664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c15e7f0 msgr2=0x7fb59c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/3963460664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c15e7f0 0x7fb59c071ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb594009d90 tx=0x7fb59400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 -- 172.21.15.152:0/3963460664 shutdown_connections 2023-10-16T20:06:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/3963460664 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c15e7f0 0x7fb59c071ea0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 -- 172.21.15.152:0/3963460664 >> 172.21.15.152:0/3963460664 conn(0x7fb59c0d0180 msgr2=0x7fb59c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 -- 172.21.15.152:0/3963460664 shutdown_connections 2023-10-16T20:06:40.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.412+0000 7fb5a2cca700 1 -- 172.21.15.152:0/3963460664 wait complete. 2023-10-16T20:06:40.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.413+0000 7fb5a2cca700 1 Processor -- start 2023-10-16T20:06:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.413+0000 7fb5a2cca700 1 -- start start 2023-10-16T20:06:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb5a2cca700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb59c06a820 0x7fb59c0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb5a2cca700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 0x7fb59c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb5a2cca700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb59c15e7f0 0x7fb59c0c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb5a2cca700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0ae970 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb5a2cca700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0ae690 con 0x7fb59c06a820 2023-10-16T20:06:40.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb5a2cca700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0b3f40 con 0x7fb59c15e7f0 2023-10-16T20:06:40.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb59bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 0x7fb59c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb59bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 0x7fb59c153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58410/0 (socket says 172.21.15.152:58410) 2023-10-16T20:06:40.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.414+0000 7fb59bfff700 1 -- 172.21.15.152:0/14257239 learned_addr learned my addr 172.21.15.152:0/14257239 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:40.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5a1267700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb59c15e7f0 0x7fb59c0c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5a0a66700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb59c06a820 0x7fb59c0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb59bfff700 1 -- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb59c15e7f0 msgr2=0x7fb59c0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb59bfff700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb59c15e7f0 0x7fb59c0c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb59bfff700 1 -- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb59c06a820 msgr2=0x7fb59c0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb59bfff700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb59c06a820 0x7fb59c0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb59bfff700 1 -- 172.21.15.152:0/14257239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594009a70 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5a0a66700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb59c06a820 0x7fb59c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:40.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb59bfff700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 0x7fb59c153650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c520 tx=0x7fb58800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588005d70 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5880070d0 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c0b4220 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588007440 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.415+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c0ae380 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.416+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c0b4740 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.416+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb5880075a0 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.417+0000 7fb5997fa700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb58006af00 0x7fb58006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:40.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.417+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb588088c00 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.417+0000 7fb5a0a66700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb58006af00 0x7fb58006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:40.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.417+0000 7fb5a0a66700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb58006af00 0x7fb58006d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb590000f60 tx=0x7fb590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:40.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.421+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb59c0b4740 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.654+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb59c0b4740 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.654+0000 7fb5997fa700 1 -- 172.21.15.152:0/14257239 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb59c0b4740 con 0x7fb59c0cf7d0 2023-10-16T20:06:40.657 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T20:06:40.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb58006af00 msgr2=0x7fb58006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb58006af00 0x7fb58006d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb590000f60 tx=0x7fb590009040 comp rx=0 tx=0).stop 2023-10-16T20:06:40.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 msgr2=0x7fb59c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:40.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 0x7fb59c153650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c520 tx=0x7fb58800c830 comp rx=0 tx=0).stop 2023-10-16T20:06:40.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 shutdown_connections 2023-10-16T20:06:40.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb58006af00 0x7fb58006d3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb59c15e7f0 0x7fb59c0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb59c06a820 0x7fb59c0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 --2- 172.21.15.152:0/14257239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb59c0cf7d0 0x7fb59c153650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:40.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.656+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 >> 172.21.15.152:0/14257239 conn(0x7fb59c0d0180 msgr2=0x7fb59c15ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:40.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.657+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 shutdown_connections 2023-10-16T20:06:40.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:40.657+0000 7fb5a2cca700 1 -- 172.21.15.152:0/14257239 wait complete. 2023-10-16T20:06:40.670 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T20:06:40.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T20:06:40.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-10-16T20:06:40.671 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-16T20:06:40.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:40.672 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T20:06:40.672 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T20:06:40.672 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T20:06:40.673 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T20:06:40.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:40.673 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-10-16T20:06:40.690 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:06:40.691 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:06:40.691 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:06:40.691 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:06:40.691 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-10-16T20:06:40.691 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:06:40.692 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:06:40.692 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:06:40.692 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:06:40.692 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:06:40.692 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:06:40.693 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:06:40.693 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T20:06:40.693 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:06:40.693 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T20:06:40.693 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-10-16T20:06:40.694 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d48f:a759:35f6:99dd/64 scope link noprefixroute 2023-10-16T20:06:40.694 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:06:40.694 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T20:06:40.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:40.695 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:06:40.696 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:06:40.696 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2023-10-16T20:06:40.696 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2023-10-16T20:06:40.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2023-10-16T20:06:40.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T20:06:40.697 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:06:40.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:40.871 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T20:06:40.900 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-10-16T20:06:40.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:40.902 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-10-16T20:06:41.092 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-10-16T20:06:41.092 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T20:06:41.092 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T20:06:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T20:06:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T20:06:41.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:41.094 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:06:41.094 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:06:41.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T20:06:41.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T20:06:41.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T20:06:41.096 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:06:41.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:41.756 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:06:41.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:41.776 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-10-16T20:06:41.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:41.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:06:41.834 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:06:41.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T20:06:41.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-16T20:06:41.835 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:06:41.932 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-16T20:06:41.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:41.933 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:06:41.933 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:06:41.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-16T20:06:41.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T20:06:41.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-16T20:06:41.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-16T20:06:41.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-16T20:06:41.935 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:06:42.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:42.159 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:06:42.159 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:06:42.159 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2023-10-16T20:06:42.160 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T20:06:42.160 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:06:42.262 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-16T20:06:42.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:06:42.263 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:42.281 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T20:06:42.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:06:42.282 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:42.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2023-10-16T20:06:42.405 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T20:06:42.463 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2023-10-16T20:06:42.463 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2023-10-16T20:06:42.463 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2023-10-16T20:06:42.464 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2023-10-16T20:06:42.464 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2023-10-16T20:06:42.464 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2023-10-16T20:06:42.464 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2023-10-16T20:06:42.464 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2023-10-16T20:06:42.465 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/systemd 2023-10-16T20:06:42.465 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2023-10-16T20:06:42.465 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2023-10-16T20:06:42.465 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T20:06:42.465 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/devices 2023-10-16T20:06:42.466 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/cpuset 2023-10-16T20:06:42.466 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/blkio 2023-10-16T20:06:42.466 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T20:06:42.466 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/freezer 2023-10-16T20:06:42.466 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/pids 2023-10-16T20:06:42.466 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T20:06:42.467 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/rdma 2023-10-16T20:06:42.467 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/memory 2023-10-16T20:06:42.467 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/perf_event 2023-10-16T20:06:42.467 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2023-10-16T20:06:42.467 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2023-10-16T20:06:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2023-10-16T20:06:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/selinux 2023-10-16T20:06:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T20:06:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2023-10-16T20:06:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2023-10-16T20:06:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2023-10-16T20:06:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2023-10-16T20:06:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T20:06:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2023-10-16T20:06:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2023-10-16T20:06:42.469 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T20:06:42.470 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T20:06:42.470 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T20:06:42.470 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T20:06:42.470 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2023-10-16T20:06:42.470 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T20:06:42.471 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T20:06:42.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:42.471 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2023-10-16T20:06:42.519 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T20:06:42.520 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-16T20:06:42.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2023-10-16T20:06:42.588 DEBUG:teuthology.orchestra.run.smithi152:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T20:06:42.645 INFO:teuthology.orchestra.run.smithi152.stdout:/sys 2023-10-16T20:06:42.645 INFO:teuthology.orchestra.run.smithi152.stdout:/proc 2023-10-16T20:06:42.645 INFO:teuthology.orchestra.run.smithi152.stdout:/dev 2023-10-16T20:06:42.645 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/security 2023-10-16T20:06:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/shm 2023-10-16T20:06:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/pts 2023-10-16T20:06:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:/run 2023-10-16T20:06:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup 2023-10-16T20:06:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/systemd 2023-10-16T20:06:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/pstore 2023-10-16T20:06:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/bpf 2023-10-16T20:06:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-16T20:06:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/devices 2023-10-16T20:06:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/cpuset 2023-10-16T20:06:42.648 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/blkio 2023-10-16T20:06:42.648 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-16T20:06:42.648 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/freezer 2023-10-16T20:06:42.648 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/pids 2023-10-16T20:06:42.648 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/hugetlb 2023-10-16T20:06:42.649 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/rdma 2023-10-16T20:06:42.649 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/memory 2023-10-16T20:06:42.649 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/cgroup/perf_event 2023-10-16T20:06:42.649 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/tracing 2023-10-16T20:06:42.649 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/config 2023-10-16T20:06:42.650 INFO:teuthology.orchestra.run.smithi152.stdout:/ 2023-10-16T20:06:42.650 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/selinux 2023-10-16T20:06:42.650 INFO:teuthology.orchestra.run.smithi152.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T20:06:42.650 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/mqueue 2023-10-16T20:06:42.650 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/kernel/debug 2023-10-16T20:06:42.651 INFO:teuthology.orchestra.run.smithi152.stdout:/dev/hugepages 2023-10-16T20:06:42.651 INFO:teuthology.orchestra.run.smithi152.stdout:/sys/fs/fuse/connections 2023-10-16T20:06:42.651 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T20:06:42.651 INFO:teuthology.orchestra.run.smithi152.stdout:/run/user/1000 2023-10-16T20:06:42.651 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph 2023-10-16T20:06:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T20:06:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T20:06:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T20:06:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T20:06:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns 2023-10-16T20:06:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T20:06:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T20:06:42.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:42.654 DEBUG:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2023-10-16T20:06:42.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:2023-10-16T20:06:42.660+0000 7fd7fd0815c0 -1 init, newargv = 0x5641bd3d3700 newargc=15 2023-10-16T20:06:42.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:ceph-fuse[111760]: starting ceph client 2023-10-16T20:06:42.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:ceph-fuse[111760]: starting fuse 2023-10-16T20:06:42.679 INFO:teuthology.orchestra.run.smithi152.stdout:46 2023-10-16T20:06:42.680 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-16T20:06:42.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo stdin-killer -- python3 -c ' 2023-10-16T20:06:42.680 DEBUG:teuthology.orchestra.run.smithi152:> import glob 2023-10-16T20:06:42.681 DEBUG:teuthology.orchestra.run.smithi152:> import re 2023-10-16T20:06:42.681 DEBUG:teuthology.orchestra.run.smithi152:> import os 2023-10-16T20:06:42.682 DEBUG:teuthology.orchestra.run.smithi152:> import subprocess 2023-10-16T20:06:42.682 DEBUG:teuthology.orchestra.run.smithi152:> 2023-10-16T20:06:42.682 DEBUG:teuthology.orchestra.run.smithi152:> def _find_admin_socket(client_name): 2023-10-16T20:06:42.683 DEBUG:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-16T20:06:42.683 DEBUG:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2023-10-16T20:06:42.684 DEBUG:teuthology.orchestra.run.smithi152:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-16T20:06:42.684 DEBUG:teuthology.orchestra.run.smithi152:> 2023-10-16T20:06:42.684 DEBUG:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2023-10-16T20:06:42.685 DEBUG:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2023-10-16T20:06:42.685 DEBUG:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2023-10-16T20:06:42.685 DEBUG:teuthology.orchestra.run.smithi152:> return files[0] 2023-10-16T20:06:42.686 DEBUG:teuthology.orchestra.run.smithi152:> 2023-10-16T20:06:42.686 DEBUG:teuthology.orchestra.run.smithi152:> for f in files: 2023-10-16T20:06:42.686 DEBUG:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T20:06:42.687 DEBUG:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T20:06:42.687 DEBUG:teuthology.orchestra.run.smithi152:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T20:06:42.687 DEBUG:teuthology.orchestra.run.smithi152:> contents = proc_f.read() 2023-10-16T20:06:42.688 DEBUG:teuthology.orchestra.run.smithi152:> if mountpoint in contents: 2023-10-16T20:06:42.688 DEBUG:teuthology.orchestra.run.smithi152:> return f 2023-10-16T20:06:42.688 DEBUG:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T20:06:42.689 DEBUG:teuthology.orchestra.run.smithi152:> 2023-10-16T20:06:42.689 DEBUG:teuthology.orchestra.run.smithi152:> print(_find_admin_socket("client.admin")) 2023-10-16T20:06:42.689 DEBUG:teuthology.orchestra.run.smithi152:> ' 2023-10-16T20:06:42.803 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.admin.111760.asok 2023-10-16T20:06:42.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T20:06:42.812 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111760.asok 2023-10-16T20:06:42.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:42.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111760.asok status 2023-10-16T20:06:42.969 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:06:42.969 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2023-10-16T20:06:42.969 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T20:06:42.969 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T20:06:42.970 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "admin", 2023-10-16T20:06:42.970 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2023-10-16T20:06:42.970 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-16T20:06:42.970 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "111760", 2023-10-16T20:06:42.971 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2023-10-16T20:06:42.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:06:42.971 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2023-10-16T20:06:42.971 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2023-10-16T20:06:42.971 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4452, 2023-10-16T20:06:42.972 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2023-10-16T20:06:42.972 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2023-10-16T20:06:42.972 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2023-10-16T20:06:42.972 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4452 2023-10-16T20:06:42.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:06:42.972 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2023-10-16T20:06:42.973 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2023-10-16T20:06:42.973 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2023-10-16T20:06:42.973 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1623770024 2023-10-16T20:06:42.973 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:06:42.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:06:42.974 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2023-10-16T20:06:42.974 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2023-10-16T20:06:42.974 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "192.168.0.1:0", 2023-10-16T20:06:42.974 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1623770024 2023-10-16T20:06:42.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:06:42.974 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.4452 192.168.0.1:0/1623770024", 2023-10-16T20:06:42.975 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "192.168.0.1:0/1623770024", 2023-10-16T20:06:42.975 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2023-10-16T20:06:42.975 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 7, 2023-10-16T20:06:42.975 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 26, 2023-10-16T20:06:42.975 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2023-10-16T20:06:42.976 INFO:teuthology.orchestra.run.smithi152.stdout: "blocklisted": false, 2023-10-16T20:06:42.976 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs" 2023-10-16T20:06:42.976 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:06:42.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:42.979 DEBUG:teuthology.orchestra.run.smithi152:> stat --file-system '--printf=%T 2023-10-16T20:06:42.980 DEBUG:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:42.997 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2023-10-16T20:06:42.997 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:42.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:42.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:43.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:43.065 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-16T20:06:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:# file: . 2023-10-16T20:06:43.159 INFO:teuthology.orchestra.run.smithi152.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-16T20:06:43.159 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:43.160 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:43.160 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:06:43.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.337+0000 7f805171a700 1 Processor -- start 2023-10-16T20:06:43.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.337+0000 7f805171a700 1 -- start start 2023-10-16T20:06:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.337+0000 7f805171a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b0c30 0x7f804c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.337+0000 7f805171a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f804c15b600 0x7f804c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.337+0000 7f805171a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c0c9d40 con 0x7f804c0b1860 2023-10-16T20:06:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f805171a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c0b1550 con 0x7f804c15b600 2023-10-16T20:06:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f805171a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0cd6d0 con 0x7f804c0b0c30 2023-10-16T20:06:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804b7fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f804c15b600 0x7f804c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804a7fc700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f804c0b1860 0x7f804c0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:53810/0 (socket says 172.21.15.152:53810) 2023-10-16T20:06:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804a7fc700 1 -- 172.21.15.152:0/2939812631 learned_addr learned my addr 172.21.15.152:0/2939812631 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804affd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b0c30 0x7f804c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804b7fe700 1 -- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b0c30 msgr2=0x7f804c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804b7fe700 1 --2- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b0c30 0x7f804c0b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804b7fe700 1 -- 172.21.15.152:0/2939812631 >> v1:172.21.15.163:6789/0 conn(0x7f804c0b1860 legacy=0x7f804c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804b7fe700 1 -- 172.21.15.152:0/2939812631 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0cd9a0 con 0x7f804c15b600 2023-10-16T20:06:43.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f8049ffb700 1 -- 172.21.15.152:0/2939812631 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995577757 0 0) 0x7f804c0c9d40 con 0x7f804c0b1860 2023-10-16T20:06:43.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.338+0000 7f804affd700 1 --2- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b0c30 0x7f804c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:43.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f804b7fe700 1 --2- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c15b600 0x7f804c0ca490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f804400aea0 tx=0x7f804400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab608071ebdfbf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:43.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f8049ffb700 1 -- 172.21.15.152:0/2939812631 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400f070 con 0x7f804c15b600 2023-10-16T20:06:43.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f8049ffb700 1 -- 172.21.15.152:0/2939812631 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804400a2e0 con 0x7f804c15b600 2023-10-16T20:06:43.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f8049ffb700 1 -- 172.21.15.152:0/2939812631 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400cb50 con 0x7f804c15b600 2023-10-16T20:06:43.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 -- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c15b600 msgr2=0x7f804c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 --2- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c15b600 0x7f804c0ca490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f804400aea0 tx=0x7f804400c330 comp rx=0 tx=0).stop 2023-10-16T20:06:43.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 -- 172.21.15.152:0/2939812631 shutdown_connections 2023-10-16T20:06:43.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 --2- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b0c30 0x7f804c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 --2- 172.21.15.152:0/2939812631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c15b600 0x7f804c0ca490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 -- 172.21.15.152:0/2939812631 >> 172.21.15.152:0/2939812631 conn(0x7f804c06c850 msgr2=0x7f804c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:43.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 -- 172.21.15.152:0/2939812631 shutdown_connections 2023-10-16T20:06:43.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.339+0000 7f805171a700 1 -- 172.21.15.152:0/2939812631 wait complete. 2023-10-16T20:06:43.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 Processor -- start 2023-10-16T20:06:43.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 -- start start 2023-10-16T20:06:43.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c0b0c30 0x7f804c147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b1860 0x7f804c0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 0x7f804c158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c158360 con 0x7f804c15b600 2023-10-16T20:06:43.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c148140 con 0x7f804c0b0c30 2023-10-16T20:06:43.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.341+0000 7f805171a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c157d30 con 0x7f804c0b1860 2023-10-16T20:06:43.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 0x7f804c158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 0x7f804c158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58438/0 (socket says 172.21.15.152:58438) 2023-10-16T20:06:43.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 -- 172.21.15.152:0/4236915146 learned_addr learned my addr 172.21.15.152:0/4236915146 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:43.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804affd700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c0b0c30 0x7f804c147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804a7fc700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b1860 0x7f804c0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 -- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b1860 msgr2=0x7f804c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b1860 0x7f804c0c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 -- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c0b0c30 msgr2=0x7f804c147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c0b0c30 0x7f804c147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 -- 172.21.15.152:0/4236915146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0094a0 con 0x7f804c15b600 2023-10-16T20:06:43.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804affd700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c0b0c30 0x7f804c147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:43.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f804b7fe700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 0x7f804c158780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f804400a470 tx=0x7f8044004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:43.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044004450 con 0x7f804c15b600 2023-10-16T20:06:43.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80440045b0 con 0x7f804c15b600 2023-10-16T20:06:43.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804400ab80 con 0x7f804c15b600 2023-10-16T20:06:43.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044004960 con 0x7f804c15b600 2023-10-16T20:06:43.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.342+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c159180 con 0x7f804c15b600 2023-10-16T20:06:43.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.343+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c04f400 con 0x7f804c15b600 2023-10-16T20:06:43.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.344+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f804401e470 con 0x7f804c15b600 2023-10-16T20:06:43.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.344+0000 7f80337fe700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f803806af00 0x7f803806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.344+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f804408b170 con 0x7f804c15b600 2023-10-16T20:06:43.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.344+0000 7f804affd700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f803806af00 0x7f803806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.344+0000 7f804affd700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f803806af00 0x7f803806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f804c15b3d0 tx=0x7f803c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:43.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.348+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8044055fc0 con 0x7f804c15b600 2023-10-16T20:06:43.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.539+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f804c1584a0 con 0x7f804c15b600 2023-10-16T20:06:43.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.540+0000 7f80337fe700 1 -- 172.21.15.152:0/4236915146 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f804c1584a0 con 0x7f804c15b600 2023-10-16T20:06:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:43.543 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:43.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f803806af00 msgr2=0x7f803806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f803806af00 0x7f803806d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f804c15b3d0 tx=0x7f803c008040 comp rx=0 tx=0).stop 2023-10-16T20:06:43.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 msgr2=0x7f804c158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 0x7f804c158780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f804400a470 tx=0x7f8044004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 shutdown_connections 2023-10-16T20:06:43.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f803806af00 0x7f803806d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f804c15b600 0x7f804c158780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f804c0b0c30 0x7f804c147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 --2- 172.21.15.152:0/4236915146 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f804c0b1860 0x7f804c0c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 >> 172.21.15.152:0/4236915146 conn(0x7f804c06c850 msgr2=0x7f804c15a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:43.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 shutdown_connections 2023-10-16T20:06:43.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.543+0000 7f805171a700 1 -- 172.21.15.152:0/4236915146 wait complete. 2023-10-16T20:06:43.557 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:06:43.557 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:06:43.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 Processor -- start 2023-10-16T20:06:43.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 -- start start 2023-10-16T20:06:43.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f815a250 0x7fd5f80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5f806dcc0 0x7fd5f80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f80cba90 con 0x7fd5f815dec0 2023-10-16T20:06:43.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f80cb510 con 0x7fd5f806dcc0 2023-10-16T20:06:43.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.679+0000 7fd5fe8fe700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f815ee40 con 0x7fd5f815a250 2023-10-16T20:06:43.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5f806dcc0 0x7fd5f80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5f806dcc0 0x7fd5f80cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58444/0 (socket says 172.21.15.152:58444) 2023-10-16T20:06:43.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 -- 172.21.15.152:0/2516533397 learned_addr learned my addr 172.21.15.152:0/2516533397 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:43.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5f7fff700 1 --2- 172.21.15.152:0/2516533397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f815a250 0x7fd5f80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 -- 172.21.15.152:0/2516533397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f815a250 msgr2=0x7fd5f80717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:43.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 --2- 172.21.15.152:0/2516533397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f815a250 0x7fd5f80717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 -- 172.21.15.152:0/2516533397 >> v1:172.21.15.163:6789/0 conn(0x7fd5f815dec0 legacy=0x7fd5f806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:43.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 -- 172.21.15.152:0/2516533397 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f815e880 con 0x7fd5f806dcc0 2023-10-16T20:06:43.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5fce9b700 1 --2- 172.21.15.152:0/2516533397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f806dcc0 0x7fd5f80cbf20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009e50 tx=0x7fd5f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e382469d6de1b79 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:43.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5f6ffd700 1 -- 172.21.15.152:0/2516533397 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000e070 con 0x7fd5f806dcc0 2023-10-16T20:06:43.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5f6ffd700 1 -- 172.21.15.152:0/2516533397 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0003a20 con 0x7fd5f806dcc0 2023-10-16T20:06:43.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.680+0000 7fd5f6ffd700 1 -- 172.21.15.152:0/2516533397 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0003dd0 con 0x7fd5f806dcc0 2023-10-16T20:06:43.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/2516533397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f806dcc0 msgr2=0x7fd5f80cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/2516533397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f806dcc0 0x7fd5f80cbf20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009e50 tx=0x7fd5f000b330 comp rx=0 tx=0).stop 2023-10-16T20:06:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/2516533397 shutdown_connections 2023-10-16T20:06:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/2516533397 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f815a250 0x7fd5f80717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/2516533397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f806dcc0 0x7fd5f80cbf20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/2516533397 >> 172.21.15.152:0/2516533397 conn(0x7fd5f80ccbe0 msgr2=0x7fd5f80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/2516533397 shutdown_connections 2023-10-16T20:06:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.681+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/2516533397 wait complete. 2023-10-16T20:06:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.682+0000 7fd5fe8fe700 1 Processor -- start 2023-10-16T20:06:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.682+0000 7fd5fe8fe700 1 -- start start 2023-10-16T20:06:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f806dcc0 0x7fd5f80c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 0x7fd5f80c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f815dec0 0x7fd5f8156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c9510 con 0x7fd5f815a250 2023-10-16T20:06:43.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c7aa0 con 0x7fd5f815dec0 2023-10-16T20:06:43.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c96f0 con 0x7fd5f806dcc0 2023-10-16T20:06:43.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 0x7fd5f80c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 0x7fd5f80c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58448/0 (socket says 172.21.15.152:58448) 2023-10-16T20:06:43.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 -- 172.21.15.152:0/3744214666 learned_addr learned my addr 172.21.15.152:0/3744214666 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:43.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fce9b700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f815dec0 0x7fd5f8156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f7fff700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f806dcc0 0x7fd5f80c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 -- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f806dcc0 msgr2=0x7fd5f80c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f806dcc0 0x7fd5f80c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 -- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f815dec0 msgr2=0x7fd5f8156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f815dec0 0x7fd5f8156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 -- 172.21.15.152:0/3744214666 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0009b30 con 0x7fd5f815a250 2023-10-16T20:06:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f77fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 0x7fd5f80c7560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c4d0 tx=0x7fd5e800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011790 con 0x7fd5f815a250 2023-10-16T20:06:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e80118f0 con 0x7fd5f815a250 2023-10-16T20:06:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.683+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f80c99d0 con 0x7fd5f815a250 2023-10-16T20:06:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.684+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011ca0 con 0x7fd5f815a250 2023-10-16T20:06:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.684+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80c9f90 con 0x7fd5f815a250 2023-10-16T20:06:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.684+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f804ebb0 con 0x7fd5f815a250 2023-10-16T20:06:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.685+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd5e801c460 con 0x7fd5f815a250 2023-10-16T20:06:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.685+0000 7fd5f4ff9700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd5e406af00 0x7fd5e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.685+0000 7fd5f7fff700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd5e406af00 0x7fd5e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.685+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5e80895c0 con 0x7fd5f815a250 2023-10-16T20:06:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.686+0000 7fd5f7fff700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd5e406af00 0x7fd5e406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec006b20 tx=0x7fd5ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:43.696 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.690+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd5e8054380 con 0x7fd5f815a250 2023-10-16T20:06:43.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.879+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5f80b60e0 con 0x7fd5f815a250 2023-10-16T20:06:43.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.880+0000 7fd5f4ff9700 1 -- 172.21.15.152:0/3744214666 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5e80579a0 con 0x7fd5f815a250 2023-10-16T20:06:43.882 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:06:43.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd5e406af00 msgr2=0x7fd5e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd5e406af00 0x7fd5e406d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec006b20 tx=0x7fd5ec008040 comp rx=0 tx=0).stop 2023-10-16T20:06:43.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 msgr2=0x7fd5f80c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:43.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 0x7fd5f80c7560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c4d0 tx=0x7fd5e800c7e0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 shutdown_connections 2023-10-16T20:06:43.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd5e406af00 0x7fd5e406d3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd5f806dcc0 0x7fd5f80c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f815dec0 0x7fd5f8156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 --2- 172.21.15.152:0/3744214666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5f815a250 0x7fd5f80c7560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:43.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 >> 172.21.15.152:0/3744214666 conn(0x7fd5f80ccbe0 msgr2=0x7fd5f80afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:43.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 shutdown_connections 2023-10-16T20:06:43.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:43.882+0000 7fd5fe8fe700 1 -- 172.21.15.152:0/3744214666 wait complete. 2023-10-16T20:06:43.896 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:06:44.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.018+0000 7f719a26a700 1 Processor -- start 2023-10-16T20:06:44.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.018+0000 7f719a26a700 1 -- start start 2023-10-16T20:06:44.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f719a26a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f719406b370 0x7f719415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f719a26a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7194161360 con 0x7f719406a820 2023-10-16T20:06:44.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f719a26a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719406b750 con 0x7f71940cdd30 2023-10-16T20:06:44.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f719a26a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719406dcc0 con 0x7f719406b370 2023-10-16T20:06:44.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f719406b370 0x7f719415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f719406b370 0x7f719415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58454/0 (socket says 172.21.15.152:58454) 2023-10-16T20:06:44.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f71937fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f719406a820 0x7f719406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38652/0 (socket says 172.21.15.152:38652) 2023-10-16T20:06:44.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 -- 172.21.15.152:0/2825564412 learned_addr learned my addr 172.21.15.152:0/2825564412 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:44.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 -- 172.21.15.152:0/2825564412 >> v1:172.21.15.163:6789/0 conn(0x7f71940cdd30 legacy=0x7f71941617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 -- 172.21.15.152:0/2825564412 >> v1:172.21.15.152:6789/0 conn(0x7f719406a820 legacy=0x7f719406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 -- 172.21.15.152:0/2825564412 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719415e300 con 0x7f719406b370 2023-10-16T20:06:44.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7193fff700 1 --2- 172.21.15.152:0/2825564412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719406b370 0x7f719415dcb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71880098f0 tx=0x7f7188009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1f95ca54cabb38 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.019+0000 7f7192ffd700 1 -- 172.21.15.152:0/2825564412 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800b8a0 con 0x7f719406b370 2023-10-16T20:06:44.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f7192ffd700 1 -- 172.21.15.152:0/2825564412 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718800ba00 con 0x7f719406b370 2023-10-16T20:06:44.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f7192ffd700 1 -- 172.21.15.152:0/2825564412 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800bd90 con 0x7f719406b370 2023-10-16T20:06:44.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 -- 172.21.15.152:0/2825564412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719406b370 msgr2=0x7f719415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 --2- 172.21.15.152:0/2825564412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719406b370 0x7f719415dcb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71880098f0 tx=0x7f7188009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:44.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 -- 172.21.15.152:0/2825564412 shutdown_connections 2023-10-16T20:06:44.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 --2- 172.21.15.152:0/2825564412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f719406b370 0x7f719415dcb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 -- 172.21.15.152:0/2825564412 >> 172.21.15.152:0/2825564412 conn(0x7f71940ccbe0 msgr2=0x7f71940ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:44.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 -- 172.21.15.152:0/2825564412 shutdown_connections 2023-10-16T20:06:44.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.020+0000 7f719a26a700 1 -- 172.21.15.152:0/2825564412 wait complete. 2023-10-16T20:06:44.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.021+0000 7f719a26a700 1 Processor -- start 2023-10-16T20:06:44.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.021+0000 7f719a26a700 1 -- start start 2023-10-16T20:06:44.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f719a26a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f719406a820 0x7f7194071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f719a26a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f719406b370 0x7f71940b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f719a26a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 0x7f7194156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f719a26a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b4030 con 0x7f71940cdd30 2023-10-16T20:06:44.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f719a26a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940c7230 con 0x7f719406b370 2023-10-16T20:06:44.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f719a26a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940c74d0 con 0x7f719406a820 2023-10-16T20:06:44.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f7198807700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 0x7f7194156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f7198807700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 0x7f7194156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58464/0 (socket says 172.21.15.152:58464) 2023-10-16T20:06:44.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f7198807700 1 -- 172.21.15.152:0/3533176785 learned_addr learned my addr 172.21.15.152:0/3533176785 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:44.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f71937fe700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f719406b370 0x7f71940b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.022+0000 7f7193fff700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f719406a820 0x7f7194071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7198807700 1 -- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f719406a820 msgr2=0x7f7194071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7198807700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f719406a820 0x7f7194071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7198807700 1 -- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f719406b370 msgr2=0x7f71940b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7198807700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f719406b370 0x7f71940b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7198807700 1 -- 172.21.15.152:0/3533176785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009550 con 0x7f71940cdd30 2023-10-16T20:06:44.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7198807700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 0x7f7194156150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f718c00cc50 tx=0x7f718c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c003c00 con 0x7f71940cdd30 2023-10-16T20:06:44.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c003d60 con 0x7f71940cdd30 2023-10-16T20:06:44.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71940c77b0 con 0x7f71940cdd30 2023-10-16T20:06:44.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00aab0 con 0x7f71940cdd30 2023-10-16T20:06:44.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.023+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71940c7d70 con 0x7f71940cdd30 2023-10-16T20:06:44.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.024+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7194072d10 con 0x7f71940cdd30 2023-10-16T20:06:44.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.024+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f718c00ac10 con 0x7f71940cdd30 2023-10-16T20:06:44.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.025+0000 7f7190ff9700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f718006af00 0x7f718006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.025+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f718c0898a0 con 0x7f71940cdd30 2023-10-16T20:06:44.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.025+0000 7f7193fff700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f718006af00 0x7f718006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.025+0000 7f7193fff700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f718006af00 0x7f718006d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7188009c40 tx=0x7f7188008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.029+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f718c054660 con 0x7f71940cdd30 2023-10-16T20:06:44.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.220+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f719404ebb0 con 0x7f71940cdd30 2023-10-16T20:06:44.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.220+0000 7f7190ff9700 1 -- 172.21.15.152:0/3533176785 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f718c057c80 con 0x7f71940cdd30 2023-10-16T20:06:44.223 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:44.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f718006af00 msgr2=0x7f718006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f718006af00 0x7f718006d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7188009c40 tx=0x7f7188008030 comp rx=0 tx=0).stop 2023-10-16T20:06:44.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 msgr2=0x7f7194156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 0x7f7194156150 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f718c00cc50 tx=0x7f718c00cf60 comp rx=0 tx=0).stop 2023-10-16T20:06:44.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 shutdown_connections 2023-10-16T20:06:44.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f718006af00 0x7f718006d3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f719406a820 0x7f7194071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71940cdd30 0x7f7194156150 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 --2- 172.21.15.152:0/3533176785 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f719406b370 0x7f71940b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 >> 172.21.15.152:0/3533176785 conn(0x7f71940ccbe0 msgr2=0x7f71941573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:44.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 shutdown_connections 2023-10-16T20:06:44.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.222+0000 7f719a26a700 1 -- 172.21.15.152:0/3533176785 wait complete. 2023-10-16T20:06:44.236 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:06:44.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.358+0000 7fa1cad99700 1 Processor -- start 2023-10-16T20:06:44.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.358+0000 7fa1cad99700 1 -- start start 2023-10-16T20:06:44.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1cad99700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa1c40cd2d0 0x7fa1c415e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1cad99700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1c40ce380 0x7fa1c40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1cad99700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c415eb30 con 0x7fa1c40d0d60 2023-10-16T20:06:44.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1cad99700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c40d1e80 con 0x7fa1c40ce380 2023-10-16T20:06:44.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1cad99700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c40d1200 con 0x7fa1c40cd2d0 2023-10-16T20:06:44.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1c40ce380 0x7fa1c40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1c40ce380 0x7fa1c40cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58472/0 (socket says 172.21.15.152:58472) 2023-10-16T20:06:44.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 -- 172.21.15.152:0/989020393 learned_addr learned my addr 172.21.15.152:0/989020393 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:44.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c8b35700 1 --2- 172.21.15.152:0/989020393 >> v2:172.21.15.163:3300/0 conn(0x7fa1c40cd2d0 0x7fa1c415e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 -- 172.21.15.152:0/989020393 >> v2:172.21.15.163:3300/0 conn(0x7fa1c40cd2d0 msgr2=0x7fa1c415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:44.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 --2- 172.21.15.152:0/989020393 >> v2:172.21.15.163:3300/0 conn(0x7fa1c40cd2d0 0x7fa1c415e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 -- 172.21.15.152:0/989020393 >> v1:172.21.15.163:6789/0 conn(0x7fa1c40d0d60 legacy=0x7fa1c40cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:44.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 -- 172.21.15.152:0/989020393 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c40d14e0 con 0x7fa1c40ce380 2023-10-16T20:06:44.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.359+0000 7fa1c9336700 1 --2- 172.21.15.152:0/989020393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40cb8d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40b2fb0 tx=0x7fa1bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48982a3f599bc445 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1c37fe700 1 -- 172.21.15.152:0/989020393 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc00e070 con 0x7fa1c40ce380 2023-10-16T20:06:44.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1c37fe700 1 -- 172.21.15.152:0/989020393 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc003a20 con 0x7fa1c40ce380 2023-10-16T20:06:44.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1c37fe700 1 -- 172.21.15.152:0/989020393 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc003dd0 con 0x7fa1c40ce380 2023-10-16T20:06:44.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 -- 172.21.15.152:0/989020393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 msgr2=0x7fa1c40cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 --2- 172.21.15.152:0/989020393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40cb8d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40b2fb0 tx=0x7fa1bc00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:44.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 -- 172.21.15.152:0/989020393 shutdown_connections 2023-10-16T20:06:44.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 --2- 172.21.15.152:0/989020393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40cb8d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 --2- 172.21.15.152:0/989020393 >> v2:172.21.15.163:3300/0 conn(0x7fa1c40cd2d0 0x7fa1c415e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 -- 172.21.15.152:0/989020393 >> 172.21.15.152:0/989020393 conn(0x7fa1c406a820 msgr2=0x7fa1c406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:44.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 -- 172.21.15.152:0/989020393 shutdown_connections 2023-10-16T20:06:44.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.360+0000 7fa1cad99700 1 -- 172.21.15.152:0/989020393 wait complete. 2023-10-16T20:06:44.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.361+0000 7fa1cad99700 1 Processor -- start 2023-10-16T20:06:44.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.361+0000 7fa1cad99700 1 -- start start 2023-10-16T20:06:44.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1cad99700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1c40cd2d0 0x7fa1c40cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1cad99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1cad99700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1c40d0d60 0x7fa1c40ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1cad99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c41521d0 con 0x7fa1c40ce380 2023-10-16T20:06:44.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1cad99700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40b00c0 con 0x7fa1c40d0d60 2023-10-16T20:06:44.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1cad99700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c40b03a0 con 0x7fa1c40cd2d0 2023-10-16T20:06:44.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1c3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1c3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58476/0 (socket says 172.21.15.152:58476) 2023-10-16T20:06:44.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1c3fff700 1 -- 172.21.15.152:0/282928555 learned_addr learned my addr 172.21.15.152:0/282928555 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:44.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1c8b35700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1c40cd2d0 0x7fa1c40cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.362+0000 7fa1c9336700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1c40d0d60 0x7fa1c40ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c3fff700 1 -- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1c40cd2d0 msgr2=0x7fa1c40cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c3fff700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1c40cd2d0 0x7fa1c40cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c3fff700 1 -- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1c40d0d60 msgr2=0x7fa1c40ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c3fff700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1c40d0d60 0x7fa1c40ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c3fff700 1 -- 172.21.15.152:0/282928555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc009b30 con 0x7fa1c40ce380 2023-10-16T20:06:44.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c3fff700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40ac8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b4a0 tx=0x7fa1b000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011830 con 0x7fa1c40ce380 2023-10-16T20:06:44.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0011990 con 0x7fa1c40ce380 2023-10-16T20:06:44.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c40b0680 con 0x7fa1c40ce380 2023-10-16T20:06:44.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0011d40 con 0x7fa1c40ce380 2023-10-16T20:06:44.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.363+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c40cc010 con 0x7fa1c40ce380 2023-10-16T20:06:44.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.364+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c414f340 con 0x7fa1c40ce380 2023-10-16T20:06:44.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.364+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa1b001a400 con 0x7fa1c40ce380 2023-10-16T20:06:44.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.365+0000 7fa1c17fa700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa1a806af00 0x7fa1a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.365+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1b00894a0 con 0x7fa1c40ce380 2023-10-16T20:06:44.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.365+0000 7fa1c8b35700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa1a806af00 0x7fa1a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.365+0000 7fa1c8b35700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa1a806af00 0x7fa1a806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8006b20 tx=0x7fa1b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.369+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa1c414f340 con 0x7fa1c40ce380 2023-10-16T20:06:44.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.556+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1c414f340 con 0x7fa1c40ce380 2023-10-16T20:06:44.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.557+0000 7fa1c17fa700 1 -- 172.21.15.152:0/282928555 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa1c414f340 con 0x7fa1c40ce380 2023-10-16T20:06:44.559 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:06:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa1a806af00 msgr2=0x7fa1a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa1a806af00 0x7fa1a806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8006b20 tx=0x7fa1b8008040 comp rx=0 tx=0).stop 2023-10-16T20:06:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 msgr2=0x7fa1c40ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40ac8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b4a0 tx=0x7fa1b000b7b0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 shutdown_connections 2023-10-16T20:06:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa1a806af00 0x7fa1a806d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa1c40cd2d0 0x7fa1c40cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1c40d0d60 0x7fa1c40ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 --2- 172.21.15.152:0/282928555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1c40ce380 0x7fa1c40ac8c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 >> 172.21.15.152:0/282928555 conn(0x7fa1c406a820 msgr2=0x7fa1c415f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:44.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 shutdown_connections 2023-10-16T20:06:44.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.559+0000 7fa1cad99700 1 -- 172.21.15.152:0/282928555 wait complete. 2023-10-16T20:06:44.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:06:44.696 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.694+0000 7f2e9cf37700 1 Processor -- start 2023-10-16T20:06:44.696 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.694+0000 7f2e9cf37700 1 -- start start 2023-10-16T20:06:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9cf37700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2e9806a820 0x7f2e9815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9cf37700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2e980cdd30 0x7f2e980ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9cf37700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e98161360 con 0x7f2e9806b370 2023-10-16T20:06:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9cf37700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e980ce720 con 0x7f2e980cdd30 2023-10-16T20:06:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9cf37700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9806b750 con 0x7f2e9806a820 2023-10-16T20:06:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e96d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2e980cdd30 0x7f2e980ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9659c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2e9806b370 0x7f2e9806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38680/0 (socket says 172.21.15.152:38680) 2023-10-16T20:06:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e9659c700 1 -- 172.21.15.152:0/4205511506 learned_addr learned my addr 172.21.15.152:0/4205511506 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e95d9b700 1 --2- 172.21.15.152:0/4205511506 >> v2:172.21.15.163:3300/0 conn(0x7f2e9806a820 0x7f2e9815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e96d9d700 1 -- 172.21.15.152:0/4205511506 >> v2:172.21.15.163:3300/0 conn(0x7f2e9806a820 msgr2=0x7f2e9815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:44.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e96d9d700 1 --2- 172.21.15.152:0/4205511506 >> v2:172.21.15.163:3300/0 conn(0x7f2e9806a820 0x7f2e9815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.695+0000 7f2e96d9d700 1 -- 172.21.15.152:0/4205511506 >> v1:172.21.15.152:6789/0 conn(0x7f2e9806b370 legacy=0x7f2e9806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9559a700 1 -- 172.21.15.152:0/4205511506 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776860342 0 0) 0x7f2e98161360 con 0x7f2e9806b370 2023-10-16T20:06:44.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e96d9d700 1 -- 172.21.15.152:0/4205511506 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9806dcc0 con 0x7f2e980cdd30 2023-10-16T20:06:44.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e96d9d700 1 --2- 172.21.15.152:0/4205511506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e980cdd30 0x7f2e980ce1e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e98070360 tx=0x7f2e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65aff2e9ee2ba631 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9559a700 1 -- 172.21.15.152:0/4205511506 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000e070 con 0x7f2e980cdd30 2023-10-16T20:06:44.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9559a700 1 -- 172.21.15.152:0/4205511506 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9000bb20 con 0x7f2e980cdd30 2023-10-16T20:06:44.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9559a700 1 -- 172.21.15.152:0/4205511506 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90012430 con 0x7f2e980cdd30 2023-10-16T20:06:44.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 -- 172.21.15.152:0/4205511506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e980cdd30 msgr2=0x7f2e980ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/4205511506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e980cdd30 0x7f2e980ce1e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e98070360 tx=0x7f2e9000b330 comp rx=0 tx=0).stop 2023-10-16T20:06:44.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 -- 172.21.15.152:0/4205511506 shutdown_connections 2023-10-16T20:06:44.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/4205511506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e980cdd30 0x7f2e980ce1e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/4205511506 >> v2:172.21.15.163:3300/0 conn(0x7f2e9806a820 0x7f2e9815dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 -- 172.21.15.152:0/4205511506 >> 172.21.15.152:0/4205511506 conn(0x7f2e980ccbe0 msgr2=0x7f2e980ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:44.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 -- 172.21.15.152:0/4205511506 shutdown_connections 2023-10-16T20:06:44.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.696+0000 7f2e9cf37700 1 -- 172.21.15.152:0/4205511506 wait complete. 2023-10-16T20:06:44.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 Processor -- start 2023-10-16T20:06:44.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 -- start start 2023-10-16T20:06:44.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 0x7f2e981564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2e9806b370 0x7f2e980b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e980cdd30 0x7f2e980cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980ad370 con 0x7f2e9806a820 2023-10-16T20:06:44.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980ad610 con 0x7f2e980cdd30 2023-10-16T20:06:44.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.698+0000 7f2e9cf37700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980ad8f0 con 0x7f2e9806b370 2023-10-16T20:06:44.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 0x7f2e981564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 0x7f2e981564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58488/0 (socket says 172.21.15.152:58488) 2023-10-16T20:06:44.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 -- 172.21.15.152:0/899335126 learned_addr learned my addr 172.21.15.152:0/899335126 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:44.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e96d9d700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e980cdd30 0x7f2e980cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e95d9b700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2e9806b370 0x7f2e980b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 -- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2e9806b370 msgr2=0x7f2e980b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2e9806b370 0x7f2e980b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 -- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e980cdd30 msgr2=0x7f2e980cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e980cdd30 0x7f2e980cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 -- 172.21.15.152:0/899335126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90009a70 con 0x7f2e9806a820 2023-10-16T20:06:44.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9659c700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 0x7f2e981564a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0011e0 tx=0x7f2e8c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c004c80 con 0x7f2e9806a820 2023-10-16T20:06:44.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c004e00 con 0x7f2e9806a820 2023-10-16T20:06:44.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e980adbd0 con 0x7f2e9806a820 2023-10-16T20:06:44.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c007310 con 0x7f2e9806a820 2023-10-16T20:06:44.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.699+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e981569e0 con 0x7f2e9806a820 2023-10-16T20:06:44.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.700+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e98072d10 con 0x7f2e9806a820 2023-10-16T20:06:44.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.701+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2e8c007470 con 0x7f2e9806a820 2023-10-16T20:06:44.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.701+0000 7f2e86ffd700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f2e7806af00 0x7f2e7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:44.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.701+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e8c089500 con 0x7f2e9806a820 2023-10-16T20:06:44.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.701+0000 7f2e95d9b700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f2e7806af00 0x7f2e7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:44.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.701+0000 7f2e95d9b700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f2e7806af00 0x7f2e7806d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e9815f550 tx=0x7f2e88009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:44.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.705+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e8c0542c0 con 0x7f2e9806a820 2023-10-16T20:06:44.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.898+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2e9804ebb0 con 0x7f2e9806a820 2023-10-16T20:06:44.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.899+0000 7f2e86ffd700 1 -- 172.21.15.152:0/899335126 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2e8c0578e0 con 0x7f2e9806a820 2023-10-16T20:06:44.902 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:44.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f2e7806af00 msgr2=0x7f2e7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f2e7806af00 0x7f2e7806d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e9815f550 tx=0x7f2e88009210 comp rx=0 tx=0).stop 2023-10-16T20:06:44.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 msgr2=0x7f2e981564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:44.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 0x7f2e981564a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0011e0 tx=0x7f2e8c00ca30 comp rx=0 tx=0).stop 2023-10-16T20:06:44.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 shutdown_connections 2023-10-16T20:06:44.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f2e7806af00 0x7f2e7806d3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e980cdd30 0x7f2e980cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e9806a820 0x7f2e981564a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 --2- 172.21.15.152:0/899335126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2e9806b370 0x7f2e980b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:44.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.901+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 >> 172.21.15.152:0/899335126 conn(0x7f2e980ccbe0 msgr2=0x7f2e9815d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:44.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.902+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 shutdown_connections 2023-10-16T20:06:44.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:44.902+0000 7f2e9cf37700 1 -- 172.21.15.152:0/899335126 wait complete. 2023-10-16T20:06:44.916 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:06:45.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.036+0000 7feb8b1ab700 1 Processor -- start 2023-10-16T20:06:45.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.036+0000 7feb8b1ab700 1 -- start start 2023-10-16T20:06:45.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb8b1ab700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 0x7feb84071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb8b1ab700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840cfeb0 con 0x7feb840cf7d0 2023-10-16T20:06:45.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb8b1ab700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415ec80 con 0x7feb8406a820 2023-10-16T20:06:45.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb8b1ab700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840ce410 con 0x7feb8415e7f0 2023-10-16T20:06:45.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb83fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7feb840cf7d0 0x7feb840ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38704/0 (socket says 172.21.15.152:38704) 2023-10-16T20:06:45.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb83fff700 1 -- 172.21.15.152:0/1589940577 learned_addr learned my addr 172.21.15.152:0/1589940577 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:45.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb89748700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 0x7feb84071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30814930 0 0) 0x7feb840cfeb0 con 0x7feb840cf7d0 2023-10-16T20:06:45.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb740035b0 con 0x7feb840cf7d0 2023-10-16T20:06:45.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 201988669 0 0) 0x7feb740035b0 con 0x7feb840cf7d0 2023-10-16T20:06:45.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 msgr2=0x7feb84071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:45.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 0x7feb84071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 >> v1:172.21.15.163:6789/0 conn(0x7feb8406a820 legacy=0x7feb8406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840cfc30 con 0x7feb840cf7d0 2023-10-16T20:06:45.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7feb70001670 con 0x7feb840cf7d0 2023-10-16T20:06:45.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.037+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 >> v1:172.21.15.152:6789/0 conn(0x7feb840cf7d0 legacy=0x7feb840ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 0x7feb74003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb74003f70 0x7feb74004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb74004d90 0x7feb74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840ce410 con 0x7feb74004d90 2023-10-16T20:06:45.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400bb20 con 0x7feb74003f70 2023-10-16T20:06:45.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7400bce0 con 0x7feb8415e7f0 2023-10-16T20:06:45.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb74004d90 0x7feb74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb88f47700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 0x7feb74003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb83fff700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb74003f70 0x7feb74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 -- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 msgr2=0x7feb74003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:45.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb8415e7f0 0x7feb74003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 -- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb74003f70 msgr2=0x7feb74004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:45.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb74003f70 0x7feb74004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 -- 172.21.15.152:0/1589940577 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb740035b0 con 0x7feb74004d90 2023-10-16T20:06:45.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb89748700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb74004d90 0x7feb74005210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009fa0 tx=0x7feb74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c50fa369fa6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c003a70 con 0x7feb74004d90 2023-10-16T20:06:45.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00f040 con 0x7feb74004d90 2023-10-16T20:06:45.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.038+0000 7feb837fe700 1 -- 172.21.15.152:0/1589940577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c003e10 con 0x7feb74004d90 2023-10-16T20:06:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb8b1ab700 1 -- 172.21.15.152:0/1589940577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb74004d90 msgr2=0x7feb74005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/1589940577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb74004d90 0x7feb74005210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009fa0 tx=0x7feb74005880 comp rx=0 tx=0).stop 2023-10-16T20:06:45.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb89748700 1 -- 172.21.15.152:0/1589940577 reap_dead start 2023-10-16T20:06:45.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb8b1ab700 1 -- 172.21.15.152:0/1589940577 shutdown_connections 2023-10-16T20:06:45.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb8b1ab700 1 -- 172.21.15.152:0/1589940577 >> 172.21.15.152:0/1589940577 conn(0x7feb840d0180 msgr2=0x7feb840d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:45.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb8b1ab700 1 -- 172.21.15.152:0/1589940577 shutdown_connections 2023-10-16T20:06:45.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.039+0000 7feb8b1ab700 1 -- 172.21.15.152:0/1589940577 wait complete. 2023-10-16T20:06:45.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.040+0000 7feb8b1ab700 1 Processor -- start 2023-10-16T20:06:45.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.040+0000 7feb8b1ab700 1 -- start start 2023-10-16T20:06:45.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb8b1ab700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb84156b60 0x7feb841f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb8b1ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 0x7feb840b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb8b1ab700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb840b0b90 0x7feb8415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb8b1ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b1010 con 0x7feb841582d0 2023-10-16T20:06:45.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb8b1ab700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b2d50 con 0x7feb84156b60 2023-10-16T20:06:45.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb8b1ab700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb841f6fa0 con 0x7feb840b0b90 2023-10-16T20:06:45.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 0x7feb840b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 0x7feb840b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58520/0 (socket says 172.21.15.152:58520) 2023-10-16T20:06:45.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 -- 172.21.15.152:0/3529139177 learned_addr learned my addr 172.21.15.152:0/3529139177 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:45.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb88f47700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb84156b60 0x7feb841f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb89748700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb840b0b90 0x7feb8415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 -- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb840b0b90 msgr2=0x7feb8415c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb840b0b90 0x7feb8415c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 -- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb84156b60 msgr2=0x7feb841f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb84156b60 0x7feb841f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 -- 172.21.15.152:0/3529139177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb841f7280 con 0x7feb841582d0 2023-10-16T20:06:45.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.041+0000 7feb83fff700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 0x7feb840b0650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb700072c0 tx=0x7feb700075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.042+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70011580 con 0x7feb841582d0 2023-10-16T20:06:45.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.042+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb700116e0 con 0x7feb841582d0 2023-10-16T20:06:45.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.042+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb841f7560 con 0x7feb841582d0 2023-10-16T20:06:45.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.042+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70011a90 con 0x7feb841582d0 2023-10-16T20:06:45.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.042+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb841f6c90 con 0x7feb841582d0 2023-10-16T20:06:45.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.042+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb84067320 con 0x7feb841582d0 2023-10-16T20:06:45.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.043+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feb70011bf0 con 0x7feb841582d0 2023-10-16T20:06:45.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.043+0000 7feb817fa700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7feb6806af00 0x7feb6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.044+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb70089780 con 0x7feb841582d0 2023-10-16T20:06:45.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.044+0000 7feb88f47700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7feb6806af00 0x7feb6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.044+0000 7feb88f47700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7feb6806af00 0x7feb6806d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb78007fd0 tx=0x7feb78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.048+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb70054540 con 0x7feb841582d0 2023-10-16T20:06:45.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.259+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feb8404ebb0 con 0x7feb841582d0 2023-10-16T20:06:45.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.260+0000 7feb817fa700 1 -- 172.21.15.152:0/3529139177 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7feb70057b60 con 0x7feb841582d0 2023-10-16T20:06:45.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7feb6806af00 msgr2=0x7feb6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7feb6806af00 0x7feb6806d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb78007fd0 tx=0x7feb78009040 comp rx=0 tx=0).stop 2023-10-16T20:06:45.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 msgr2=0x7feb840b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 0x7feb840b0650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb700072c0 tx=0x7feb700075d0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 shutdown_connections 2023-10-16T20:06:45.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7feb6806af00 0x7feb6806d3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feb840b0b90 0x7feb8415c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb84156b60 0x7feb841f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 --2- 172.21.15.152:0/3529139177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb841582d0 0x7feb840b0650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 >> 172.21.15.152:0/3529139177 conn(0x7feb840d0180 msgr2=0x7feb8415a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:45.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 shutdown_connections 2023-10-16T20:06:45.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.262+0000 7feb8b1ab700 1 -- 172.21.15.152:0/3529139177 wait complete. 2023-10-16T20:06:45.267 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2023-10-16T20:06:45.275 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:06:45.276 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:06:45.293 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:45.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.450+0000 7fb1df194700 1 Processor -- start 2023-10-16T20:06:45.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.450+0000 7fb1df194700 1 -- start start 2023-10-16T20:06:45.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1df194700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1d806a820 0x7fb1d80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1df194700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1d815e7f0 0x7fb1d806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1df194700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80cfeb0 con 0x7fb1d80ca7d0 2023-10-16T20:06:45.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1df194700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80ce410 con 0x7fb1d815e7f0 2023-10-16T20:06:45.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1df194700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d815ec50 con 0x7fb1d806a820 2023-10-16T20:06:45.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1d815e7f0 0x7fb1d806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1d815e7f0 0x7fb1d806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58530/0 (socket says 172.21.15.152:58530) 2023-10-16T20:06:45.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 -- 172.21.15.152:0/4059016840 learned_addr learned my addr 172.21.15.152:0/4059016840 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:45.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1dcf30700 1 --2- 172.21.15.152:0/4059016840 >> v2:172.21.15.163:3300/0 conn(0x7fb1d806a820 0x7fb1d80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 -- 172.21.15.152:0/4059016840 >> v2:172.21.15.163:3300/0 conn(0x7fb1d806a820 msgr2=0x7fb1d80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:45.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 --2- 172.21.15.152:0/4059016840 >> v2:172.21.15.163:3300/0 conn(0x7fb1d806a820 0x7fb1d80cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 -- 172.21.15.152:0/4059016840 >> v1:172.21.15.163:6789/0 conn(0x7fb1d80ca7d0 legacy=0x7fb1d8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 -- 172.21.15.152:0/4059016840 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80af9d0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d77fe700 1 -- 172.21.15.152:0/4059016840 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082465057 0 0) 0x7fb1d80cfeb0 con 0x7fb1d80ca7d0 2023-10-16T20:06:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.451+0000 7fb1d7fff700 1 --2- 172.21.15.152:0/4059016840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d806ac00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8067df0 tx=0x7fb1c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d104636aaa27a32c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1d77fe700 1 -- 172.21.15.152:0/4059016840 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4011830 con 0x7fb1d815e7f0 2023-10-16T20:06:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1d77fe700 1 -- 172.21.15.152:0/4059016840 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c4011990 con 0x7fb1d815e7f0 2023-10-16T20:06:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1d77fe700 1 -- 172.21.15.152:0/4059016840 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4011d20 con 0x7fb1d815e7f0 2023-10-16T20:06:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 -- 172.21.15.152:0/4059016840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 msgr2=0x7fb1d806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 --2- 172.21.15.152:0/4059016840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d806ac00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8067df0 tx=0x7fb1c4009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 -- 172.21.15.152:0/4059016840 shutdown_connections 2023-10-16T20:06:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 --2- 172.21.15.152:0/4059016840 >> v2:172.21.15.163:3300/0 conn(0x7fb1d806a820 0x7fb1d80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 --2- 172.21.15.152:0/4059016840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d806ac00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 -- 172.21.15.152:0/4059016840 >> 172.21.15.152:0/4059016840 conn(0x7fb1d80d0180 msgr2=0x7fb1d80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 -- 172.21.15.152:0/4059016840 shutdown_connections 2023-10-16T20:06:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.452+0000 7fb1df194700 1 -- 172.21.15.152:0/4059016840 wait complete. 2023-10-16T20:06:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.453+0000 7fb1df194700 1 Processor -- start 2023-10-16T20:06:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.453+0000 7fb1df194700 1 -- start start 2023-10-16T20:06:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1df194700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d806a820 0x7fb1d8158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1df194700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d80ca7d0 0x7fb1d80c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1df194700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1df194700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c6b20 con 0x7fb1d815e7f0 2023-10-16T20:06:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1df194700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c5540 con 0x7fb1d806a820 2023-10-16T20:06:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1df194700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c5820 con 0x7fb1d80ca7d0 2023-10-16T20:06:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1dd731700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1dcf30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d806a820 0x7fb1d8158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1dd731700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58538/0 (socket says 172.21.15.152:58538) 2023-10-16T20:06:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1dd731700 1 -- 172.21.15.152:0/1823612635 learned_addr learned my addr 172.21.15.152:0/1823612635 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.454+0000 7fb1d7fff700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d80ca7d0 0x7fb1d80c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1dd731700 1 -- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d80ca7d0 msgr2=0x7fb1d80c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1dd731700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d80ca7d0 0x7fb1d80c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1dd731700 1 -- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d806a820 msgr2=0x7fb1d8158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1dd731700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d806a820 0x7fb1d8158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1dd731700 1 -- 172.21.15.152:0/1823612635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009550 con 0x7fb1d815e7f0 2023-10-16T20:06:45.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1dd731700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d815cac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000cc10 tx=0x7fb1d000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0003e80 con 0x7fb1d815e7f0 2023-10-16T20:06:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d000a690 con 0x7fb1d815e7f0 2023-10-16T20:06:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d80c5b00 con 0x7fb1d815e7f0 2023-10-16T20:06:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000aa40 con 0x7fb1d815e7f0 2023-10-16T20:06:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.455+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d80c60c0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.456+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d80c62e0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.456+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1d000aba0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.457+0000 7fb1d57fa700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb1bc06af00 0x7fb1bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.457+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1d00892d0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.457+0000 7fb1dcf30700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb1bc06af00 0x7fb1bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.457+0000 7fb1dcf30700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb1bc06af00 0x7fb1bc06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80cc2b0 tx=0x7fb1cc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.461+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1d0054080 con 0x7fb1d815e7f0 2023-10-16T20:06:45.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.652+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d804ebb0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.653+0000 7fb1d57fa700 1 -- 172.21.15.152:0/1823612635 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fb1d00576a0 con 0x7fb1d815e7f0 2023-10-16T20:06:45.655 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:45.656 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:45.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb1bc06af00 msgr2=0x7fb1bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb1bc06af00 0x7fb1bc06d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80cc2b0 tx=0x7fb1cc009210 comp rx=0 tx=0).stop 2023-10-16T20:06:45.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 msgr2=0x7fb1d815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d815cac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000cc10 tx=0x7fb1d000cf20 comp rx=0 tx=0).stop 2023-10-16T20:06:45.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 shutdown_connections 2023-10-16T20:06:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb1bc06af00 0x7fb1bc06d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1d815e7f0 0x7fb1d815cac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1d806a820 0x7fb1d8158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 --2- 172.21.15.152:0/1823612635 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1d80ca7d0 0x7fb1d80c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 >> 172.21.15.152:0/1823612635 conn(0x7fb1d80d0180 msgr2=0x7fb1d8071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 shutdown_connections 2023-10-16T20:06:45.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.655+0000 7fb1df194700 1 -- 172.21.15.152:0/1823612635 wait complete. 2023-10-16T20:06:45.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:06:45.670 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:06:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.791+0000 7fb05a4f7700 1 Processor -- start 2023-10-16T20:06:45.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.791+0000 7fb05a4f7700 1 -- start start 2023-10-16T20:06:45.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb05a4f7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb05a4f7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb05406e310 0x7fb0540cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb05a4f7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb05406e790 0x7fb0540ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb05a4f7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb054159f30 con 0x7fb05406e790 2023-10-16T20:06:45.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb05a4f7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05406ac90 con 0x7fb05406e310 2023-10-16T20:06:45.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb05a4f7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05406af70 con 0x7fb054159b50 2023-10-16T20:06:45.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb058a94700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb05406e790 0x7fb0540ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb058a94700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb05406e790 0x7fb0540ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58542/0 (socket says 172.21.15.152:58542) 2023-10-16T20:06:45.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.792+0000 7fb058a94700 1 -- 172.21.15.152:0/2591080181 learned_addr learned my addr 172.21.15.152:0/2591080181 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:45.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb0537fe700 1 --2- 172.21.15.152:0/2591080181 >> v2:172.21.15.163:3300/0 conn(0x7fb05406e310 0x7fb0540cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb053fff700 1 --2- 172.21.15.152:0/2591080181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb058a94700 1 -- 172.21.15.152:0/2591080181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 msgr2=0x7fb05406bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:45.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb058a94700 1 --2- 172.21.15.152:0/2591080181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05406bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb058a94700 1 -- 172.21.15.152:0/2591080181 >> v2:172.21.15.163:3300/0 conn(0x7fb05406e310 msgr2=0x7fb0540cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:45.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb058a94700 1 --2- 172.21.15.152:0/2591080181 >> v2:172.21.15.163:3300/0 conn(0x7fb05406e310 0x7fb0540cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb058a94700 1 -- 172.21.15.152:0/2591080181 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05406b250 con 0x7fb05406e790 2023-10-16T20:06:45.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb0537fe700 1 --2- 172.21.15.152:0/2591080181 >> v2:172.21.15.163:3300/0 conn(0x7fb05406e310 0x7fb0540cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:45.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb058a94700 1 --2- 172.21.15.152:0/2591080181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb0540ce280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb054070870 tx=0x7fb04c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4358c9d7e76602 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb052ffd700 1 -- 172.21.15.152:0/2591080181 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00e070 con 0x7fb05406e790 2023-10-16T20:06:45.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb052ffd700 1 -- 172.21.15.152:0/2591080181 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00b9c0 con 0x7fb05406e790 2023-10-16T20:06:45.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb052ffd700 1 -- 172.21.15.152:0/2591080181 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00bd70 con 0x7fb05406e790 2023-10-16T20:06:45.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb05a4f7700 1 -- 172.21.15.152:0/2591080181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 msgr2=0x7fb0540ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.793+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/2591080181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb0540ce280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb054070870 tx=0x7fb04c00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:45.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 -- 172.21.15.152:0/2591080181 shutdown_connections 2023-10-16T20:06:45.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/2591080181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05406bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/2591080181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb0540ce280 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/2591080181 >> v2:172.21.15.163:3300/0 conn(0x7fb05406e310 0x7fb0540cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 -- 172.21.15.152:0/2591080181 >> 172.21.15.152:0/2591080181 conn(0x7fb0540b13e0 msgr2=0x7fb0540b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:45.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 -- 172.21.15.152:0/2591080181 shutdown_connections 2023-10-16T20:06:45.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.794+0000 7fb05a4f7700 1 -- 172.21.15.152:0/2591080181 wait complete. 2023-10-16T20:06:45.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.795+0000 7fb05a4f7700 1 Processor -- start 2023-10-16T20:06:45.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.795+0000 7fb05a4f7700 1 -- start start 2023-10-16T20:06:45.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb05406e310 0x7fb0540add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb054151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054157fd0 con 0x7fb05406e790 2023-10-16T20:06:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054157c30 con 0x7fb05406e310 2023-10-16T20:06:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415aff0 con 0x7fb054159b50 2023-10-16T20:06:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb054151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb054151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58550/0 (socket says 172.21.15.152:58550) 2023-10-16T20:06:45.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 -- 172.21.15.152:0/3716980773 learned_addr learned my addr 172.21.15.152:0/3716980773 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:45.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb053fff700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb05406e310 0x7fb0540add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb058a94700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 -- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 msgr2=0x7fb05415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 -- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb05406e310 msgr2=0x7fb0540add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb05406e310 0x7fb0540add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 -- 172.21.15.152:0/3716980773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c009b30 con 0x7fb05406e790 2023-10-16T20:06:45.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb058a94700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:45.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb0537fe700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb054151fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb04400d6a0 tx=0x7fb04400d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044004230 con 0x7fb05406e790 2023-10-16T20:06:45.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044004390 con 0x7fb05406e790 2023-10-16T20:06:45.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb054155f30 con 0x7fb05406e790 2023-10-16T20:06:45.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440036a0 con 0x7fb05406e790 2023-10-16T20:06:45.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.796+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0541564f0 con 0x7fb05406e790 2023-10-16T20:06:45.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.797+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb054157a90 con 0x7fb05406e790 2023-10-16T20:06:45.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.798+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb044003800 con 0x7fb05406e790 2023-10-16T20:06:45.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.798+0000 7fb050ff9700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb03406af00 0x7fb03406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:45.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.798+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0440898d0 con 0x7fb05406e790 2023-10-16T20:06:45.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.798+0000 7fb053fff700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb03406af00 0x7fb03406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:45.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.799+0000 7fb053fff700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb03406af00 0x7fb03406d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb03c006b20 tx=0x7fb03c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:45.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.803+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb054157a90 con 0x7fb05406e790 2023-10-16T20:06:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.994+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb054158110 con 0x7fb05406e790 2023-10-16T20:06:45.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.994+0000 7fb050ff9700 1 -- 172.21.15.152:0/3716980773 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb054158110 con 0x7fb05406e790 2023-10-16T20:06:45.996 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:06:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb03406af00 msgr2=0x7fb03406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb03406af00 0x7fb03406d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb03c006b20 tx=0x7fb03c008040 comp rx=0 tx=0).stop 2023-10-16T20:06:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 msgr2=0x7fb054151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb054151fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb04400d6a0 tx=0x7fb04400d9b0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 shutdown_connections 2023-10-16T20:06:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb03406af00 0x7fb03406d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb054159b50 0x7fb05415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:45.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb05406e310 0x7fb0540add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 --2- 172.21.15.152:0/3716980773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb05406e790 0x7fb054151fd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 >> 172.21.15.152:0/3716980773 conn(0x7fb0540b13e0 msgr2=0x7fb05406d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:46.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 shutdown_connections 2023-10-16T20:06:46.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:45.996+0000 7fb05a4f7700 1 -- 172.21.15.152:0/3716980773 wait complete. 2023-10-16T20:06:46.010 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:06:46.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.132+0000 7ffb403ff700 1 Processor -- start 2023-10-16T20:06:46.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.132+0000 7ffb403ff700 1 -- start start 2023-10-16T20:06:46.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb403ff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffb3815dec0 0x7ffb3806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb403ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffb3815e350 0x7ffb3806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb403ff700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb380cba90 con 0x7ffb3815a250 2023-10-16T20:06:46.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb403ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380cb510 con 0x7ffb3815e350 2023-10-16T20:06:46.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb403ff700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb38071ec0 con 0x7ffb3815dec0 2023-10-16T20:06:46.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffb3815e350 0x7ffb3806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffb3815e350 0x7ffb3806daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58560/0 (socket says 172.21.15.152:58560) 2023-10-16T20:06:46.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 -- 172.21.15.152:0/4086965714 learned_addr learned my addr 172.21.15.152:0/4086965714 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:46.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3d99a700 1 --2- 172.21.15.152:0/4086965714 >> v2:172.21.15.163:3300/0 conn(0x7ffb3815dec0 0x7ffb3806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 -- 172.21.15.152:0/4086965714 >> v2:172.21.15.163:3300/0 conn(0x7ffb3815dec0 msgr2=0x7ffb3806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:46.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 --2- 172.21.15.152:0/4086965714 >> v2:172.21.15.163:3300/0 conn(0x7ffb3815dec0 0x7ffb3806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 -- 172.21.15.152:0/4086965714 >> v1:172.21.15.163:6789/0 conn(0x7ffb3815a250 legacy=0x7ffb380717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:46.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 -- 172.21.15.152:0/4086965714 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3815ee40 con 0x7ffb3815e350 2023-10-16T20:06:46.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3e99c700 1 --2- 172.21.15.152:0/4086965714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815e350 0x7ffb3806daf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb380af840 tx=0x7ffb3000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72b54601eb64cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.133+0000 7ffb3d199700 1 -- 172.21.15.152:0/4086965714 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30010070 con 0x7ffb3815e350 2023-10-16T20:06:46.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb3d199700 1 -- 172.21.15.152:0/4086965714 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3000dd50 con 0x7ffb3815e350 2023-10-16T20:06:46.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb3d199700 1 -- 172.21.15.152:0/4086965714 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000b310 con 0x7ffb3815e350 2023-10-16T20:06:46.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 -- 172.21.15.152:0/4086965714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815e350 msgr2=0x7ffb3806daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 --2- 172.21.15.152:0/4086965714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815e350 0x7ffb3806daf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb380af840 tx=0x7ffb3000d430 comp rx=0 tx=0).stop 2023-10-16T20:06:46.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 -- 172.21.15.152:0/4086965714 shutdown_connections 2023-10-16T20:06:46.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 --2- 172.21.15.152:0/4086965714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815e350 0x7ffb3806daf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 --2- 172.21.15.152:0/4086965714 >> v2:172.21.15.163:3300/0 conn(0x7ffb3815dec0 0x7ffb3806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 -- 172.21.15.152:0/4086965714 >> 172.21.15.152:0/4086965714 conn(0x7ffb380ccbe0 msgr2=0x7ffb380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:46.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 -- 172.21.15.152:0/4086965714 shutdown_connections 2023-10-16T20:06:46.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.134+0000 7ffb403ff700 1 -- 172.21.15.152:0/4086965714 wait complete. 2023-10-16T20:06:46.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.135+0000 7ffb403ff700 1 Processor -- start 2023-10-16T20:06:46.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.135+0000 7ffb403ff700 1 -- start start 2023-10-16T20:06:46.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb403ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 0x7ffb380c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb403ff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3815dec0 0x7ffb381547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb403ff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb3815e350 0x7ffb381ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb403ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38154d10 con 0x7ffb3815a250 2023-10-16T20:06:46.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb403ff700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c5c70 con 0x7ffb3815e350 2023-10-16T20:06:46.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb403ff700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c5f50 con 0x7ffb3815dec0 2023-10-16T20:06:46.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 0x7ffb380c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 0x7ffb380c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58562/0 (socket says 172.21.15.152:58562) 2023-10-16T20:06:46.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 -- 172.21.15.152:0/2227668265 learned_addr learned my addr 172.21.15.152:0/2227668265 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:46.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e99c700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb3815e350 0x7ffb381ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3d99a700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3815dec0 0x7ffb381547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 -- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3815dec0 msgr2=0x7ffb381547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3815dec0 0x7ffb381547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 -- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb3815e350 msgr2=0x7ffb381ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb3815e350 0x7ffb381ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3e19b700 1 -- 172.21.15.152:0/2227668265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3000bd40 con 0x7ffb3815a250 2023-10-16T20:06:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.136+0000 7ffb3d99a700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3815dec0 0x7ffb381547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.137+0000 7ffb3e19b700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 0x7ffb380c55d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400c4d0 tx=0x7ffb3400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.137+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34011790 con 0x7ffb3815a250 2023-10-16T20:06:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.137+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb340118f0 con 0x7ffb3815a250 2023-10-16T20:06:46.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.137+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380c6230 con 0x7ffb3815a250 2023-10-16T20:06:46.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.137+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34011ca0 con 0x7ffb3815a250 2023-10-16T20:06:46.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.137+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb380c67f0 con 0x7ffb3815a250 2023-10-16T20:06:46.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.138+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3804ebb0 con 0x7ffb3815a250 2023-10-16T20:06:46.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.138+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffb3401c460 con 0x7ffb3815a250 2023-10-16T20:06:46.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.138+0000 7ffb2effd700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffb1c06af00 0x7ffb1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.139+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb340896a0 con 0x7ffb3815a250 2023-10-16T20:06:46.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.139+0000 7ffb3d99a700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffb1c06af00 0x7ffb1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.139+0000 7ffb3d99a700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffb1c06af00 0x7ffb1c06d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009a00 tx=0x7ffb28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.143+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffb340544f0 con 0x7ffb3815a250 2023-10-16T20:06:46.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.332+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb380b60e0 con 0x7ffb3815a250 2023-10-16T20:06:46.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.332+0000 7ffb2effd700 1 -- 172.21.15.152:0/2227668265 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb34057b10 con 0x7ffb3815a250 2023-10-16T20:06:46.334 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffb1c06af00 msgr2=0x7ffb1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffb1c06af00 0x7ffb1c06d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009a00 tx=0x7ffb28008040 comp rx=0 tx=0).stop 2023-10-16T20:06:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 msgr2=0x7ffb380c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 0x7ffb380c55d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400c4d0 tx=0x7ffb3400c890 comp rx=0 tx=0).stop 2023-10-16T20:06:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 shutdown_connections 2023-10-16T20:06:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffb1c06af00 0x7ffb1c06d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb3815e350 0x7ffb381ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb3815a250 0x7ffb380c55d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 --2- 172.21.15.152:0/2227668265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffb3815dec0 0x7ffb381547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 >> 172.21.15.152:0/2227668265 conn(0x7ffb380ccbe0 msgr2=0x7ffb3806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:46.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 shutdown_connections 2023-10-16T20:06:46.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.334+0000 7ffb403ff700 1 -- 172.21.15.152:0/2227668265 wait complete. 2023-10-16T20:06:46.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:06:46.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.469+0000 7efd95ee9700 1 Processor -- start 2023-10-16T20:06:46.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.469+0000 7efd95ee9700 1 -- start start 2023-10-16T20:06:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd95ee9700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd9015d580 0x7efd900cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd95ee9700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efd9006e030 0x7efd900cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd95ee9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9006a820 con 0x7efd9015d960 2023-10-16T20:06:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd95ee9700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd90066cd0 con 0x7efd9015d580 2023-10-16T20:06:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd95ee9700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9006d490 con 0x7efd9006e030 2023-10-16T20:06:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd8f7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd9015d580 0x7efd900cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd8f7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd9015d580 0x7efd900cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58570/0 (socket says 172.21.15.152:58570) 2023-10-16T20:06:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd8effd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efd9015d960 0x7efd90161310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38768/0 (socket says 172.21.15.152:38768) 2023-10-16T20:06:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.470+0000 7efd8f7fe700 1 -- 172.21.15.152:0/2319860858 learned_addr learned my addr 172.21.15.152:0/2319860858 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8ffff700 1 --2- 172.21.15.152:0/2319860858 >> v2:172.21.15.163:3300/0 conn(0x7efd9006e030 0x7efd900cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8f7fe700 1 -- 172.21.15.152:0/2319860858 >> v2:172.21.15.163:3300/0 conn(0x7efd9006e030 msgr2=0x7efd900cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8f7fe700 1 --2- 172.21.15.152:0/2319860858 >> v2:172.21.15.163:3300/0 conn(0x7efd9006e030 0x7efd900cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8f7fe700 1 -- 172.21.15.152:0/2319860858 >> v1:172.21.15.152:6789/0 conn(0x7efd9015d960 legacy=0x7efd90161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8f7fe700 1 -- 172.21.15.152:0/2319860858 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9006d770 con 0x7efd9015d580 2023-10-16T20:06:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8e7fc700 1 -- 172.21.15.152:0/2319860858 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205430335 0 0) 0x7efd9006a820 con 0x7efd9015d960 2023-10-16T20:06:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8f7fe700 1 --2- 172.21.15.152:0/2319860858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9015d580 0x7efd900cd4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd900cbff0 tx=0x7efd84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1427685bfdf97c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8e7fc700 1 -- 172.21.15.152:0/2319860858 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400b870 con 0x7efd9015d580 2023-10-16T20:06:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8e7fc700 1 -- 172.21.15.152:0/2319860858 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400b9d0 con 0x7efd9015d580 2023-10-16T20:06:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.471+0000 7efd8e7fc700 1 -- 172.21.15.152:0/2319860858 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400bd60 con 0x7efd9015d580 2023-10-16T20:06:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 -- 172.21.15.152:0/2319860858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9015d580 msgr2=0x7efd900cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 --2- 172.21.15.152:0/2319860858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9015d580 0x7efd900cd4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd900cbff0 tx=0x7efd84009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 -- 172.21.15.152:0/2319860858 shutdown_connections 2023-10-16T20:06:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 --2- 172.21.15.152:0/2319860858 >> v2:172.21.15.163:3300/0 conn(0x7efd9006e030 0x7efd900cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 --2- 172.21.15.152:0/2319860858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9015d580 0x7efd900cd4c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 -- 172.21.15.152:0/2319860858 >> 172.21.15.152:0/2319860858 conn(0x7efd900b13e0 msgr2=0x7efd900b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:46.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 -- 172.21.15.152:0/2319860858 shutdown_connections 2023-10-16T20:06:46.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.472+0000 7efd95ee9700 1 -- 172.21.15.152:0/2319860858 wait complete. 2023-10-16T20:06:46.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.473+0000 7efd95ee9700 1 Processor -- start 2023-10-16T20:06:46.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.473+0000 7efd95ee9700 1 -- start start 2023-10-16T20:06:46.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 0x7efd900c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9015d580 0x7efd900c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9015d960 0x7efd9014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd900b05a0 con 0x7efd9006e030 2023-10-16T20:06:46.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901f2ec0 con 0x7efd9015d960 2023-10-16T20:06:46.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd901f31a0 con 0x7efd9015d580 2023-10-16T20:06:46.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 0x7efd900c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 0x7efd900c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58576/0 (socket says 172.21.15.152:58576) 2023-10-16T20:06:46.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 -- 172.21.15.152:0/1649082608 learned_addr learned my addr 172.21.15.152:0/1649082608 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:46.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 -- 172.21.15.152:0/1649082608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9015d580 msgr2=0x7efd900c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9015d580 0x7efd900c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 -- 172.21.15.152:0/1649082608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9015d960 msgr2=0x7efd9014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9015d960 0x7efd9014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 -- 172.21.15.152:0/1649082608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009550 con 0x7efd9006e030 2023-10-16T20:06:46.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd8f7fe700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 0x7efd900c5770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd84009c10 tx=0x7efd84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84004520 con 0x7efd9006e030 2023-10-16T20:06:46.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd840036a0 con 0x7efd9006e030 2023-10-16T20:06:46.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84003a10 con 0x7efd9006e030 2023-10-16T20:06:46.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd901f3480 con 0x7efd9006e030 2023-10-16T20:06:46.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.474+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd901f2980 con 0x7efd9006e030 2023-10-16T20:06:46.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.475+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd901f3a90 con 0x7efd9006e030 2023-10-16T20:06:46.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.476+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd84021070 con 0x7efd9006e030 2023-10-16T20:06:46.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.476+0000 7efd77fff700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7c06af00 0x7efd7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.476+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd8408b020 con 0x7efd9006e030 2023-10-16T20:06:46.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.476+0000 7efd8effd700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7c06af00 0x7efd7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.477+0000 7efd8effd700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7c06af00 0x7efd7c06d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd9015a590 tx=0x7efd800079f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.481+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd84055e70 con 0x7efd9006e030 2023-10-16T20:06:46.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.673+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd9004ebb0 con 0x7efd9006e030 2023-10-16T20:06:46.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.674+0000 7efd77fff700 1 -- 172.21.15.152:0/1649082608 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd840150a0 con 0x7efd9006e030 2023-10-16T20:06:46.676 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:06:46.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7c06af00 msgr2=0x7efd7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7c06af00 0x7efd7c06d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd9015a590 tx=0x7efd800079f0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 msgr2=0x7efd900c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 0x7efd900c5770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd84009c10 tx=0x7efd84004750 comp rx=0 tx=0).stop 2023-10-16T20:06:46.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 shutdown_connections 2023-10-16T20:06:46.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd7c06af00 0x7efd7c06d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd9015d960 0x7efd9014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd9006e030 0x7efd900c5770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 --2- 172.21.15.152:0/1649082608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd9015d580 0x7efd900c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 >> 172.21.15.152:0/1649082608 conn(0x7efd900b13e0 msgr2=0x7efd900b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:46.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 shutdown_connections 2023-10-16T20:06:46.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.676+0000 7efd95ee9700 1 -- 172.21.15.152:0/1649082608 wait complete. 2023-10-16T20:06:46.690 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:06:46.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.812+0000 7f2240b79700 1 Processor -- start 2023-10-16T20:06:46.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.812+0000 7f2240b79700 1 -- start start 2023-10-16T20:06:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f2240b79700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 0x7f223c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f2240b79700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0cad30 con 0x7f223c0717b0 2023-10-16T20:06:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f2240b79700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0cb1c0 con 0x7f223c15fd40 2023-10-16T20:06:46.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f2240b79700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0ca7b0 con 0x7f223c06a820 2023-10-16T20:06:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f2239d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f223c0717b0 0x7f223c071c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38782/0 (socket says 172.21.15.152:38782) 2023-10-16T20:06:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f2239d9b700 1 -- 172.21.15.152:0/3021836897 learned_addr learned my addr 172.21.15.152:0/3021836897 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223a59c700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 0x7f223c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170717805 0 0) 0x7f223c0cad30 con 0x7f223c0717b0 2023-10-16T20:06:46.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22240035b0 con 0x7f223c0717b0 2023-10-16T20:06:46.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213662621 0 0) 0x7f223c0cb1c0 con 0x7f223c15fd40 2023-10-16T20:06:46.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f223c0cad30 con 0x7f223c15fd40 2023-10-16T20:06:46.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562072464 0 0) 0x7f22240035b0 con 0x7f223c0717b0 2023-10-16T20:06:46.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 msgr2=0x7f223c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:46.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 0x7f223c06ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 >> v1:172.21.15.163:6789/0 conn(0x7f223c15fd40 legacy=0x7f223c166240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c06df70 con 0x7f223c0717b0 2023-10-16T20:06:46.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f2230001670 con 0x7f223c0717b0 2023-10-16T20:06:46.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 >> v1:172.21.15.152:6789/0 conn(0x7f223c0717b0 legacy=0x7f223c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f2224003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2224004850 0x7f2224004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 0x7f2224005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0ca7b0 con 0x7f2224003bc0 2023-10-16T20:06:46.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222400bba0 con 0x7f2224004850 2023-10-16T20:06:46.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222400bd30 con 0x7f223c06a820 2023-10-16T20:06:46.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.813+0000 7f223a59c700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f2224003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223ad9d700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 0x7f2224005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f2239d9b700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2224004850 0x7f2224004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223a59c700 1 -- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 msgr2=0x7f2224005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:46.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223a59c700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c06a820 0x7f2224005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223a59c700 1 -- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2224004850 msgr2=0x7f2224004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:46.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223a59c700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2224004850 0x7f2224004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223a59c700 1 -- 172.21.15.152:0/3021836897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22240035b0 con 0x7f2224003bc0 2023-10-16T20:06:46.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223a59c700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f2224003fc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f222c009b90 tx=0x7f2224005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71751aca3890d903 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00e6c0 con 0x7f2224003bc0 2023-10-16T20:06:46.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c00e820 con 0x7f2224003bc0 2023-10-16T20:06:46.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.814+0000 7f223959a700 1 -- 172.21.15.152:0/3021836897 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00eb90 con 0x7f2224003bc0 2023-10-16T20:06:46.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f2240b79700 1 -- 172.21.15.152:0/3021836897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 msgr2=0x7f2224003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f2240b79700 1 --2- 172.21.15.152:0/3021836897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f2224003fc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f222c009b90 tx=0x7f2224005880 comp rx=0 tx=0).stop 2023-10-16T20:06:46.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f223ad9d700 1 -- 172.21.15.152:0/3021836897 reap_dead start 2023-10-16T20:06:46.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f2240b79700 1 -- 172.21.15.152:0/3021836897 shutdown_connections 2023-10-16T20:06:46.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f2240b79700 1 -- 172.21.15.152:0/3021836897 >> 172.21.15.152:0/3021836897 conn(0x7f223c0ccbe0 msgr2=0x7f223c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:46.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f2240b79700 1 -- 172.21.15.152:0/3021836897 shutdown_connections 2023-10-16T20:06:46.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.815+0000 7f2240b79700 1 -- 172.21.15.152:0/3021836897 wait complete. 2023-10-16T20:06:46.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.816+0000 7f2240b79700 1 Processor -- start 2023-10-16T20:06:46.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 -- start start 2023-10-16T20:06:46.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f223c1f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223c1f1d20 0x7f223c15c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c15cad0 0x7f223c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15cf50 con 0x7f2224003bc0 2023-10-16T20:06:46.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b2da0 con 0x7f223c1f1d20 2023-10-16T20:06:46.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.817+0000 7f2240b79700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15c120 con 0x7f223c15cad0 2023-10-16T20:06:46.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f223c1f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f223c1f3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58596/0 (socket says 172.21.15.152:58596) 2023-10-16T20:06:46.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 -- 172.21.15.152:0/4057213329 learned_addr learned my addr 172.21.15.152:0/4057213329 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:46.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f2239d9b700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223c1f1d20 0x7f223c15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223ad9d700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c15cad0 0x7f223c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 -- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c15cad0 msgr2=0x7f223c15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c15cad0 0x7f223c15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 -- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223c1f1d20 msgr2=0x7f223c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:46.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223c1f1d20 0x7f223c15c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:46.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 -- 172.21.15.152:0/4057213329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0b3060 con 0x7f2224003bc0 2023-10-16T20:06:46.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f2239d9b700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223c1f1d20 0x7f223c15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:46.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223ad9d700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c15cad0 0x7f223c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:46.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f223a59c700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f223c1f3b70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22240057f0 tx=0x7f222c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00e6c0 con 0x7f2224003bc0 2023-10-16T20:06:46.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c003ab0 con 0x7f2224003bc0 2023-10-16T20:06:46.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c003e60 con 0x7f2224003bc0 2023-10-16T20:06:46.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c0b3340 con 0x7f2224003bc0 2023-10-16T20:06:46.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.818+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c15b890 con 0x7f2224003bc0 2023-10-16T20:06:46.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.819+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c15ceb0 con 0x7f2224003bc0 2023-10-16T20:06:46.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.820+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f222c013470 con 0x7f2224003bc0 2023-10-16T20:06:46.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.820+0000 7f222affd700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221c06af00 0x7f221c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:46.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.820+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f222c08b210 con 0x7f2224003bc0 2023-10-16T20:06:46.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.820+0000 7f2239d9b700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221c06af00 0x7f221c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:46.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.820+0000 7f2239d9b700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221c06af00 0x7f221c06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f223c0c9bd0 tx=0x7f2230009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:46.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:46.824+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f222c056180 con 0x7f2224003bc0 2023-10-16T20:06:47.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.017+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f223c04ebb0 con 0x7f2224003bc0 2023-10-16T20:06:47.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.017+0000 7f222affd700 1 -- 172.21.15.152:0/4057213329 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f222c0597a0 con 0x7f2224003bc0 2023-10-16T20:06:47.019 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:47.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221c06af00 msgr2=0x7f221c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221c06af00 0x7f221c06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f223c0c9bd0 tx=0x7f2230009040 comp rx=0 tx=0).stop 2023-10-16T20:06:47.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 msgr2=0x7f223c1f3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f223c1f3b70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22240057f0 tx=0x7f222c0047c0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 shutdown_connections 2023-10-16T20:06:47.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221c06af00 0x7f221c06d3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223c15cad0 0x7f223c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2224003bc0 0x7f223c1f3b70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 --2- 172.21.15.152:0/4057213329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223c1f1d20 0x7f223c15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 >> 172.21.15.152:0/4057213329 conn(0x7f223c0ccbe0 msgr2=0x7f223c15df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:47.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 shutdown_connections 2023-10-16T20:06:47.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.019+0000 7f2240b79700 1 -- 172.21.15.152:0/4057213329 wait complete. 2023-10-16T20:06:47.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:06:47.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.152+0000 7f67ff84e700 1 Processor -- start 2023-10-16T20:06:47.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.152+0000 7f67ff84e700 1 -- start start 2023-10-16T20:06:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67ff84e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f67f815daa0 0x7f67f80af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67ff84e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f67f8071f60 0x7f67f806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67ff84e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f815ed10 con 0x7f67f80af560 2023-10-16T20:06:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67ff84e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f815de80 con 0x7f67f815daa0 2023-10-16T20:06:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67ff84e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f815e100 con 0x7f67f8071f60 2023-10-16T20:06:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67fd5ea700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f67f815daa0 0x7f67f80af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67fcde9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f67f80af560 0x7f67f8071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38802/0 (socket says 172.21.15.152:38802) 2023-10-16T20:06:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67fd5ea700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f67f815daa0 0x7f67f80af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58604/0 (socket says 172.21.15.152:58604) 2023-10-16T20:06:47.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.153+0000 7f67fcde9700 1 -- 172.21.15.152:0/3942145953 learned_addr learned my addr 172.21.15.152:0/3942145953 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:47.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fddeb700 1 --2- 172.21.15.152:0/3942145953 >> v2:172.21.15.163:3300/0 conn(0x7f67f8071f60 0x7f67f806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fd5ea700 1 -- 172.21.15.152:0/3942145953 >> v2:172.21.15.163:3300/0 conn(0x7f67f8071f60 msgr2=0x7f67f806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:47.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fd5ea700 1 --2- 172.21.15.152:0/3942145953 >> v2:172.21.15.163:3300/0 conn(0x7f67f8071f60 0x7f67f806d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fd5ea700 1 -- 172.21.15.152:0/3942145953 >> v1:172.21.15.152:6789/0 conn(0x7f67f80af560 legacy=0x7f67f8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fd5ea700 1 -- 172.21.15.152:0/3942145953 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f815e3e0 con 0x7f67f815daa0 2023-10-16T20:06:47.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fddeb700 1 --2- 172.21.15.152:0/3942145953 >> v2:172.21.15.163:3300/0 conn(0x7f67f8071f60 0x7f67f806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:47.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67fd5ea700 1 --2- 172.21.15.152:0/3942145953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f815daa0 0x7f67f80af020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67f80b2d50 tx=0x7f67e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40956d43221c2736 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:47.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67effff700 1 -- 172.21.15.152:0/3942145953 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011830 con 0x7f67f815daa0 2023-10-16T20:06:47.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67effff700 1 -- 172.21.15.152:0/3942145953 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8011990 con 0x7f67f815daa0 2023-10-16T20:06:47.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67effff700 1 -- 172.21.15.152:0/3942145953 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011d20 con 0x7f67f815daa0 2023-10-16T20:06:47.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67ff84e700 1 -- 172.21.15.152:0/3942145953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f815daa0 msgr2=0x7f67f80af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.154+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3942145953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f815daa0 0x7f67f80af020 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67f80b2d50 tx=0x7f67e8009b20 comp rx=0 tx=0).stop 2023-10-16T20:06:47.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.155+0000 7f67ff84e700 1 -- 172.21.15.152:0/3942145953 shutdown_connections 2023-10-16T20:06:47.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.155+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3942145953 >> v2:172.21.15.163:3300/0 conn(0x7f67f8071f60 0x7f67f806d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.155+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3942145953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f815daa0 0x7f67f80af020 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.155+0000 7f67ff84e700 1 -- 172.21.15.152:0/3942145953 >> 172.21.15.152:0/3942145953 conn(0x7f67f80d0180 msgr2=0x7f67f80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:47.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.155+0000 7f67ff84e700 1 -- 172.21.15.152:0/3942145953 shutdown_connections 2023-10-16T20:06:47.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.155+0000 7f67ff84e700 1 -- 172.21.15.152:0/3942145953 wait complete. 2023-10-16T20:06:47.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.156+0000 7f67ff84e700 1 Processor -- start 2023-10-16T20:06:47.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.156+0000 7f67ff84e700 1 -- start start 2023-10-16T20:06:47.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67f8071f60 0x7f67f8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 0x7f67f80b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67f815daa0 0x7f67f80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f8159f00 con 0x7f67f80af560 2023-10-16T20:06:47.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f81f0da0 con 0x7f67f8071f60 2023-10-16T20:06:47.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f815a170 con 0x7f67f815daa0 2023-10-16T20:06:47.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 0x7f67f80b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 0x7f67f80b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58612/0 (socket says 172.21.15.152:58612) 2023-10-16T20:06:47.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 -- 172.21.15.152:0/3007246115 learned_addr learned my addr 172.21.15.152:0/3007246115 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:47.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 -- 172.21.15.152:0/3007246115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67f815daa0 msgr2=0x7f67f80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67f815daa0 0x7f67f80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 -- 172.21.15.152:0/3007246115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67f8071f60 msgr2=0x7f67f8159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67f8071f60 0x7f67f8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 -- 172.21.15.152:0/3007246115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80094a0 con 0x7f67f80af560 2023-10-16T20:06:47.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67fcde9700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 0x7f67f80b55f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c490 tx=0x7f67f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:47.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4005d70 con 0x7f67f80af560 2023-10-16T20:06:47.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40070d0 con 0x7f67f80af560 2023-10-16T20:06:47.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f815a450 con 0x7f67f80af560 2023-10-16T20:06:47.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.157+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4007460 con 0x7f67f80af560 2023-10-16T20:06:47.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.158+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f815aa10 con 0x7f67f80af560 2023-10-16T20:06:47.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.158+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f804ebb0 con 0x7f67f80af560 2023-10-16T20:06:47.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.159+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f67f40075c0 con 0x7f67f80af560 2023-10-16T20:06:47.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.159+0000 7f67edffb700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f67dc06af00 0x7f67dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.159+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f67f4088d30 con 0x7f67f80af560 2023-10-16T20:06:47.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.159+0000 7f67fd5ea700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f67dc06af00 0x7f67dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.160+0000 7f67fd5ea700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f67dc06af00 0x7f67dc06d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67e80090b0 tx=0x7f67e8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:47.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.164+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67f4053b80 con 0x7f67f80af560 2023-10-16T20:06:47.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.367+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67f8072690 con 0x7f67f80af560 2023-10-16T20:06:47.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.367+0000 7f67edffb700 1 -- 172.21.15.152:0/3007246115 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f67f4017020 con 0x7f67f80af560 2023-10-16T20:06:47.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f67dc06af00 msgr2=0x7f67dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f67dc06af00 0x7f67dc06d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67e80090b0 tx=0x7f67e8010000 comp rx=0 tx=0).stop 2023-10-16T20:06:47.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 msgr2=0x7f67f80b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 0x7f67f80b55f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c490 tx=0x7f67f400c850 comp rx=0 tx=0).stop 2023-10-16T20:06:47.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 shutdown_connections 2023-10-16T20:06:47.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f67dc06af00 0x7f67dc06d3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f67f815daa0 0x7f67f80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f67f8071f60 0x7f67f8159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 --2- 172.21.15.152:0/3007246115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67f80af560 0x7f67f80b55f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 >> 172.21.15.152:0/3007246115 conn(0x7f67f80d0180 msgr2=0x7f67f80ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:47.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 shutdown_connections 2023-10-16T20:06:47.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.369+0000 7f67ff84e700 1 -- 172.21.15.152:0/3007246115 wait complete. 2023-10-16T20:06:47.374 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2023-10-16T20:06:47.383 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2023-10-16T20:06:47.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:47.383 DEBUG:teuthology.orchestra.run.smithi152:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-16T20:06:47.421 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi152.stderr:ceph-fuse[111760]: fuse finished with error 0 and tester_r 0 2023-10-16T20:06:47.423 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:06:47.455 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:06:47.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:06:47.456 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-16T20:06:47.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:47.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.685+0000 7faf5ca68700 1 Processor -- start 2023-10-16T20:06:47.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.685+0000 7faf5ca68700 1 -- start start 2023-10-16T20:06:47.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5ca68700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7faf5806a820 0x7faf580cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5ca68700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faf5815e7f0 0x7faf5806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5ca68700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf580cfeb0 con 0x7faf580ca7d0 2023-10-16T20:06:47.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5ca68700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580ce410 con 0x7faf5815e7f0 2023-10-16T20:06:47.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5ca68700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5815ec50 con 0x7faf5806a820 2023-10-16T20:06:47.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faf5815e7f0 0x7faf5806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faf5815e7f0 0x7faf5806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58618/0 (socket says 172.21.15.152:58618) 2023-10-16T20:06:47.691 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf56d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faf580ca7d0 0x7faf58071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38820/0 (socket says 172.21.15.152:38820) 2023-10-16T20:06:47.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 -- 172.21.15.152:0/3695650787 learned_addr learned my addr 172.21.15.152:0/3695650787 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:47.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5659c700 1 --2- 172.21.15.152:0/3695650787 >> v2:172.21.15.163:3300/0 conn(0x7faf5806a820 0x7faf580cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 -- 172.21.15.152:0/3695650787 >> v2:172.21.15.163:3300/0 conn(0x7faf5806a820 msgr2=0x7faf580cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:47.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 --2- 172.21.15.152:0/3695650787 >> v2:172.21.15.163:3300/0 conn(0x7faf5806a820 0x7faf580cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 -- 172.21.15.152:0/3695650787 >> v1:172.21.15.152:6789/0 conn(0x7faf580ca7d0 legacy=0x7faf58071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 -- 172.21.15.152:0/3695650787 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580af9d0 con 0x7faf5815e7f0 2023-10-16T20:06:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5559a700 1 -- 172.21.15.152:0/3695650787 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498410060 0 0) 0x7faf580cfeb0 con 0x7faf580ca7d0 2023-10-16T20:06:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5659c700 1 --2- 172.21.15.152:0/3695650787 >> v2:172.21.15.163:3300/0 conn(0x7faf5806a820 0x7faf580cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf55d9b700 1 --2- 172.21.15.152:0/3695650787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5815e7f0 0x7faf5806ac00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf58067df0 tx=0x7faf4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9943746f52171f7c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5559a700 1 -- 172.21.15.152:0/3695650787 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00b870 con 0x7faf5815e7f0 2023-10-16T20:06:47.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5559a700 1 -- 172.21.15.152:0/3695650787 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00b9d0 con 0x7faf5815e7f0 2023-10-16T20:06:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.686+0000 7faf5559a700 1 -- 172.21.15.152:0/3695650787 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00bd60 con 0x7faf5815e7f0 2023-10-16T20:06:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 -- 172.21.15.152:0/3695650787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5815e7f0 msgr2=0x7faf5806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 --2- 172.21.15.152:0/3695650787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5815e7f0 0x7faf5806ac00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf58067df0 tx=0x7faf4c009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 -- 172.21.15.152:0/3695650787 shutdown_connections 2023-10-16T20:06:47.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 --2- 172.21.15.152:0/3695650787 >> v2:172.21.15.163:3300/0 conn(0x7faf5806a820 0x7faf580cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 --2- 172.21.15.152:0/3695650787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5815e7f0 0x7faf5806ac00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 -- 172.21.15.152:0/3695650787 >> 172.21.15.152:0/3695650787 conn(0x7faf580d0180 msgr2=0x7faf580d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:47.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 -- 172.21.15.152:0/3695650787 shutdown_connections 2023-10-16T20:06:47.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.687+0000 7faf5ca68700 1 -- 172.21.15.152:0/3695650787 wait complete. 2023-10-16T20:06:47.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.688+0000 7faf5ca68700 1 Processor -- start 2023-10-16T20:06:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.688+0000 7faf5ca68700 1 -- start start 2023-10-16T20:06:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5ca68700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 0x7faf58157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5ca68700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf580ca7d0 0x7faf580b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5ca68700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf5815e7f0 0x7faf580b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5ca68700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf58157ff0 con 0x7faf5806a820 2023-10-16T20:06:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5ca68700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580b2f60 con 0x7faf5815e7f0 2023-10-16T20:06:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5ca68700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf58160930 con 0x7faf580ca7d0 2023-10-16T20:06:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 0x7faf58157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 0x7faf58157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58624/0 (socket says 172.21.15.152:58624) 2023-10-16T20:06:47.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 -- 172.21.15.152:0/638625734 learned_addr learned my addr 172.21.15.152:0/638625734 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf56d9d700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf5815e7f0 0x7faf580b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf55d9b700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf580ca7d0 0x7faf580b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 -- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf580ca7d0 msgr2=0x7faf580b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf580ca7d0 0x7faf580b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 -- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf5815e7f0 msgr2=0x7faf580b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf5815e7f0 0x7faf580b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf5659c700 1 -- 172.21.15.152:0/638625734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c009550 con 0x7faf5806a820 2023-10-16T20:06:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.689+0000 7faf55d9b700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf580ca7d0 0x7faf580b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.690+0000 7faf5659c700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 0x7faf58157ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf4800e840 tx=0x7faf4800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.690+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48013610 con 0x7faf5806a820 2023-10-16T20:06:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.690+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48013770 con 0x7faf5806a820 2023-10-16T20:06:47.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.690+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5815fd20 con 0x7faf5806a820 2023-10-16T20:06:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.690+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48013b20 con 0x7faf5806a820 2023-10-16T20:06:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.690+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf581602e0 con 0x7faf5806a820 2023-10-16T20:06:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.691+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5804ebb0 con 0x7faf5806a820 2023-10-16T20:06:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.691+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf48013c80 con 0x7faf5806a820 2023-10-16T20:06:47.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.691+0000 7faf46ffd700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faf3806af00 0x7faf3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.692+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf480894e0 con 0x7faf5806a820 2023-10-16T20:06:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.692+0000 7faf55d9b700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faf3806af00 0x7faf3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.692+0000 7faf55d9b700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faf3806af00 0x7faf3806d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf4c014040 tx=0x7faf4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.696+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf480542a0 con 0x7faf5806a820 2023-10-16T20:06:47.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.887+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf580b6100 con 0x7faf5806a820 2023-10-16T20:06:47.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.888+0000 7faf46ffd700 1 -- 172.21.15.152:0/638625734 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7faf480578c0 con 0x7faf5806a820 2023-10-16T20:06:47.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:47.894 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:47.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faf3806af00 msgr2=0x7faf3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faf3806af00 0x7faf3806d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf4c014040 tx=0x7faf4c008030 comp rx=0 tx=0).stop 2023-10-16T20:06:47.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 msgr2=0x7faf58157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:47.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 0x7faf58157ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf4800e840 tx=0x7faf4800eb50 comp rx=0 tx=0).stop 2023-10-16T20:06:47.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 shutdown_connections 2023-10-16T20:06:47.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faf3806af00 0x7faf3806d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf5815e7f0 0x7faf580b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf5806a820 0x7faf58157ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 --2- 172.21.15.152:0/638625734 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faf580ca7d0 0x7faf580b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:47.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 >> 172.21.15.152:0/638625734 conn(0x7faf580d0180 msgr2=0x7faf580cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:47.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.890+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 shutdown_connections 2023-10-16T20:06:47.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:47.891+0000 7faf5ca68700 1 -- 172.21.15.152:0/638625734 wait complete. 2023-10-16T20:06:47.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:48.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.024+0000 7f22bb188700 1 Processor -- start 2023-10-16T20:06:48.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.024+0000 7f22bb188700 1 -- start start 2023-10-16T20:06:48.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22bb188700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22b40712e0 0x7f22b415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22bb188700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40cbc10 0x7f22b40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22bb188700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40cd4b0 con 0x7f22b4144ea0 2023-10-16T20:06:48.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22bb188700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b415b8f0 con 0x7f22b40712e0 2023-10-16T20:06:48.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22bb188700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40cc0c0 con 0x7f22b40cbc10 2023-10-16T20:06:48.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b8f24700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22b40712e0 0x7f22b415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b3fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f22b4144ea0 0x7f22b40716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38830/0 (socket says 172.21.15.152:38830) 2023-10-16T20:06:48.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b3fff700 1 -- 172.21.15.152:0/4106433311 learned_addr learned my addr 172.21.15.152:0/4106433311 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:48.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b9725700 1 --2- 172.21.15.152:0/4106433311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40cbc10 0x7f22b40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b8f24700 1 -- 172.21.15.152:0/4106433311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40cbc10 msgr2=0x7f22b40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:48.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b8f24700 1 --2- 172.21.15.152:0/4106433311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40cbc10 0x7f22b40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b8f24700 1 -- 172.21.15.152:0/4106433311 >> v1:172.21.15.152:6789/0 conn(0x7f22b4144ea0 legacy=0x7f22b40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b8f24700 1 -- 172.21.15.152:0/4106433311 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b415fdb0 con 0x7f22b40712e0 2023-10-16T20:06:48.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.025+0000 7f22b37fe700 1 -- 172.21.15.152:0/4106433311 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707647099 0 0) 0x7f22b40cd4b0 con 0x7f22b4144ea0 2023-10-16T20:06:48.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22b8f24700 1 --2- 172.21.15.152:0/4106433311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40712e0 0x7f22b415f790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009840 tx=0x7f22a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef9d27e0aef5e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:48.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22b37fe700 1 -- 172.21.15.152:0/4106433311 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011830 con 0x7f22b40712e0 2023-10-16T20:06:48.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22b37fe700 1 -- 172.21.15.152:0/4106433311 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8011990 con 0x7f22b40712e0 2023-10-16T20:06:48.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22b37fe700 1 -- 172.21.15.152:0/4106433311 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011d20 con 0x7f22b40712e0 2023-10-16T20:06:48.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 -- 172.21.15.152:0/4106433311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40712e0 msgr2=0x7f22b415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 --2- 172.21.15.152:0/4106433311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40712e0 0x7f22b415f790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009840 tx=0x7f22a8009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 -- 172.21.15.152:0/4106433311 shutdown_connections 2023-10-16T20:06:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 --2- 172.21.15.152:0/4106433311 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40cbc10 0x7f22b40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 --2- 172.21.15.152:0/4106433311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40712e0 0x7f22b415f790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 -- 172.21.15.152:0/4106433311 >> 172.21.15.152:0/4106433311 conn(0x7f22b40cfcd0 msgr2=0x7f22b40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 -- 172.21.15.152:0/4106433311 shutdown_connections 2023-10-16T20:06:48.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.026+0000 7f22bb188700 1 -- 172.21.15.152:0/4106433311 wait complete. 2023-10-16T20:06:48.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.027+0000 7f22bb188700 1 Processor -- start 2023-10-16T20:06:48.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.027+0000 7f22bb188700 1 -- start start 2023-10-16T20:06:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22bb188700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40712e0 0x7f22b40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22bb188700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 0x7f22b415af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22bb188700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22b4144ea0 0x7f22b40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22bb188700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b415b470 con 0x7f22b40cbc10 2023-10-16T20:06:48.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22bb188700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40acf50 con 0x7f22b4144ea0 2023-10-16T20:06:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22bb188700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40ad230 con 0x7f22b40712e0 2023-10-16T20:06:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22b3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 0x7f22b415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22b3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 0x7f22b415af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58638/0 (socket says 172.21.15.152:58638) 2023-10-16T20:06:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.028+0000 7f22b3fff700 1 -- 172.21.15.152:0/2164987351 learned_addr learned my addr 172.21.15.152:0/2164987351 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:48.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b8f24700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40712e0 0x7f22b40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b9725700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22b4144ea0 0x7f22b40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b3fff700 1 -- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40712e0 msgr2=0x7f22b40ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b3fff700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40712e0 0x7f22b40ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b3fff700 1 -- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22b4144ea0 msgr2=0x7f22b40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b3fff700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22b4144ea0 0x7f22b40b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b3fff700 1 -- 172.21.15.152:0/2164987351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80094a0 con 0x7f22b40cbc10 2023-10-16T20:06:48.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b9725700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22b4144ea0 0x7f22b40b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:48.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b3fff700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 0x7f22b415af30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f22a00011e0 tx=0x7f22a000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:48.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0004c80 con 0x7f22b40cbc10 2023-10-16T20:06:48.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0004de0 con 0x7f22b40cbc10 2023-10-16T20:06:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b40ad510 con 0x7f22b40cbc10 2023-10-16T20:06:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0007310 con 0x7f22b40cbc10 2023-10-16T20:06:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.029+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40adad0 con 0x7f22b40cbc10 2023-10-16T20:06:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.030+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b404ebb0 con 0x7f22b40cbc10 2023-10-16T20:06:48.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.031+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f22a0007470 con 0x7f22b40cbc10 2023-10-16T20:06:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.031+0000 7f22b17fa700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f229806af00 0x7f229806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.031+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f22a00895c0 con 0x7f22b40cbc10 2023-10-16T20:06:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.031+0000 7f22b8f24700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f229806af00 0x7f229806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.031+0000 7f22b8f24700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f229806af00 0x7f229806d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f22a80090b0 tx=0x7f22a801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:48.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.035+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22a0054410 con 0x7f22b40cbc10 2023-10-16T20:06:48.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.224+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b40c99e0 con 0x7f22b40cbc10 2023-10-16T20:06:48.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.225+0000 7f22b17fa700 1 -- 172.21.15.152:0/2164987351 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f22a0057a30 con 0x7f22b40cbc10 2023-10-16T20:06:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:48.228 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:48.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f229806af00 msgr2=0x7f229806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f229806af00 0x7f229806d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f22a80090b0 tx=0x7f22a801c040 comp rx=0 tx=0).stop 2023-10-16T20:06:48.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 msgr2=0x7f22b415af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 0x7f22b415af30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f22a00011e0 tx=0x7f22a000ca30 comp rx=0 tx=0).stop 2023-10-16T20:06:48.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 shutdown_connections 2023-10-16T20:06:48.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f229806af00 0x7f229806d3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22b40712e0 0x7f22b40ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22b4144ea0 0x7f22b40b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 --2- 172.21.15.152:0/2164987351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22b40cbc10 0x7f22b415af30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 >> 172.21.15.152:0/2164987351 conn(0x7f22b40cfcd0 msgr2=0x7f22b40c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:48.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 shutdown_connections 2023-10-16T20:06:48.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.228+0000 7f22bb188700 1 -- 172.21.15.152:0/2164987351 wait complete. 2023-10-16T20:06:48.242 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T20:06:48.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.364+0000 7f9b86901700 1 Processor -- start 2023-10-16T20:06:48.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.364+0000 7f9b86901700 1 -- start start 2023-10-16T20:06:48.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b86901700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9b8006dcc0 0x7f9b800cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b86901700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800cba90 con 0x7f9b8015dec0 2023-10-16T20:06:48.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b86901700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8015ee40 con 0x7f9b8015a250 2023-10-16T20:06:48.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b86901700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800cb510 con 0x7f9b8006dcc0 2023-10-16T20:06:48.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b84e9e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9b8006dcc0 0x7f9b800cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b7f7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9b8015dec0 0x7f9b8006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38842/0 (socket says 172.21.15.152:38842) 2023-10-16T20:06:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b84e9e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9b8006dcc0 0x7f9b800cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58646/0 (socket says 172.21.15.152:58646) 2023-10-16T20:06:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.365+0000 7f9b7f7fe700 1 -- 172.21.15.152:0/3635946095 learned_addr learned my addr 172.21.15.152:0/3635946095 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b84e9e700 1 -- 172.21.15.152:0/3635946095 >> v1:172.21.15.163:6789/0 conn(0x7f9b8015a250 legacy=0x7f9b800717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b84e9e700 1 -- 172.21.15.152:0/3635946095 >> v1:172.21.15.152:6789/0 conn(0x7f9b8015dec0 legacy=0x7f9b8006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b84e9e700 1 -- 172.21.15.152:0/3635946095 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8015e880 con 0x7f9b8006dcc0 2023-10-16T20:06:48.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b7effd700 1 -- 172.21.15.152:0/3635946095 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441541274 0 0) 0x7f9b800cba90 con 0x7f9b8015dec0 2023-10-16T20:06:48.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b84e9e700 1 --2- 172.21.15.152:0/3635946095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800cbf20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009d90 tx=0x7f9b7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c718d8984407c0a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:48.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b7effd700 1 -- 172.21.15.152:0/3635946095 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7800e070 con 0x7f9b8006dcc0 2023-10-16T20:06:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b7effd700 1 -- 172.21.15.152:0/3635946095 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800bbd0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b7effd700 1 -- 172.21.15.152:0/3635946095 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012430 con 0x7f9b8006dcc0 2023-10-16T20:06:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b86901700 1 -- 172.21.15.152:0/3635946095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 msgr2=0x7f9b800cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b86901700 1 --2- 172.21.15.152:0/3635946095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800cbf20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009d90 tx=0x7f9b7800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b86901700 1 -- 172.21.15.152:0/3635946095 shutdown_connections 2023-10-16T20:06:48.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b86901700 1 --2- 172.21.15.152:0/3635946095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800cbf20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.366+0000 7f9b86901700 1 -- 172.21.15.152:0/3635946095 >> 172.21.15.152:0/3635946095 conn(0x7f9b800ccbe0 msgr2=0x7f9b800ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:48.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.367+0000 7f9b86901700 1 -- 172.21.15.152:0/3635946095 shutdown_connections 2023-10-16T20:06:48.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.367+0000 7f9b86901700 1 -- 172.21.15.152:0/3635946095 wait complete. 2023-10-16T20:06:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.368+0000 7f9b86901700 1 Processor -- start 2023-10-16T20:06:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.368+0000 7f9b86901700 1 -- start start 2023-10-16T20:06:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b86901700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b86901700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b8015a250 0x7f9b800b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b86901700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b8015dec0 0x7f9b8015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b86901700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8015bc20 con 0x7f9b8006dcc0 2023-10-16T20:06:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b86901700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8015bf00 con 0x7f9b8015a250 2023-10-16T20:06:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b86901700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8015c1e0 con 0x7f9b8015dec0 2023-10-16T20:06:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b7ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58648/0 (socket says 172.21.15.152:58648) 2023-10-16T20:06:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b7ffff700 1 -- 172.21.15.152:0/707449681 learned_addr learned my addr 172.21.15.152:0/707449681 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b84e9e700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b8015dec0 0x7f9b8015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.369+0000 7f9b7f7fe700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b8015a250 0x7f9b800b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7ffff700 1 -- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b8015dec0 msgr2=0x7f9b8015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7ffff700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b8015dec0 0x7f9b8015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7ffff700 1 -- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b8015a250 msgr2=0x7f9b800b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7ffff700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b8015a250 0x7f9b800b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7ffff700 1 -- 172.21.15.152:0/707449681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78009a70 con 0x7f9b8006dcc0 2023-10-16T20:06:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7f7fe700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b8015a250 0x7f9b800b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7ffff700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800c63f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c4e0 tx=0x7f9b7400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740052d0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74005430 con 0x7f9b8006dcc0 2023-10-16T20:06:48.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8015c4c0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740038c0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.370+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800c6930 con 0x7f9b8006dcc0 2023-10-16T20:06:48.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.371+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8015c9e0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.371+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9b74003a20 con 0x7f9b8006dcc0 2023-10-16T20:06:48.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.372+0000 7f9b7cff9700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b6c06af00 0x7f9b6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:48.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.372+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b74088d10 con 0x7f9b8006dcc0 2023-10-16T20:06:48.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.372+0000 7f9b7f7fe700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b6c06af00 0x7f9b6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:48.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.372+0000 7f9b7f7fe700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b6c06af00 0x7f9b6c06d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b800c6d00 tx=0x7f9b70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:48.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.376+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b8015c9e0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.612+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9b8015c9e0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.910+0000 7f9b7cff9700 1 -- 172.21.15.152:0/707449681 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9b8015c9e0 con 0x7f9b8006dcc0 2023-10-16T20:06:48.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b6c06af00 msgr2=0x7f9b6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b6c06af00 0x7f9b6c06d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b800c6d00 tx=0x7f9b70009040 comp rx=0 tx=0).stop 2023-10-16T20:06:48.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 msgr2=0x7f9b800c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800c63f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c4e0 tx=0x7f9b7400c8a0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 shutdown_connections 2023-10-16T20:06:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b6c06af00 0x7f9b6c06d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b8015dec0 0x7f9b8015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b8006dcc0 0x7f9b800c63f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 --2- 172.21.15.152:0/707449681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b8015a250 0x7f9b800b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:48.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 >> 172.21.15.152:0/707449681 conn(0x7f9b800ccbe0 msgr2=0x7f9b800cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:48.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 shutdown_connections 2023-10-16T20:06:48.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:48.913+0000 7f9b86901700 1 -- 172.21.15.152:0/707449681 wait complete. 2023-10-16T20:06:48.927 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-16T20:06:48.928 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T20:06:49.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.049+0000 7f85ce9bc700 1 Processor -- start 2023-10-16T20:06:49.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.049+0000 7f85ce9bc700 1 -- start start 2023-10-16T20:06:49.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85ce9bc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f85c806a820 0x7f85c815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85ce9bc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85c80ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85ce9bc700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c8161360 con 0x7f85c806b370 2023-10-16T20:06:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85ce9bc700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c80ce720 con 0x7f85c806a820 2023-10-16T20:06:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85ce9bc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c806b750 con 0x7f85c80cdd30 2023-10-16T20:06:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85c7fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f85c806b370 0x7f85c806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38854/0 (socket says 172.21.15.152:38854) 2023-10-16T20:06:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.050+0000 7f85c7fff700 1 -- 172.21.15.152:0/3077199192 learned_addr learned my addr 172.21.15.152:0/3077199192 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482205637 0 0) 0x7f85c8161360 con 0x7f85c806b370 2023-10-16T20:06:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85ccf59700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85c80ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b00035b0 con 0x7f85c806b370 2023-10-16T20:06:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c77fe700 1 --2- 172.21.15.152:0/3077199192 >> v2:172.21.15.163:3300/0 conn(0x7f85c806a820 0x7f85c815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2253386976 0 0) 0x7f85b00035b0 con 0x7f85c806b370 2023-10-16T20:06:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 msgr2=0x7f85c80ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85c80ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 >> v2:172.21.15.163:3300/0 conn(0x7f85c806a820 msgr2=0x7f85c815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 --2- 172.21.15.152:0/3077199192 >> v2:172.21.15.163:3300/0 conn(0x7f85c806a820 0x7f85c815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c806dcc0 con 0x7f85c806b370 2023-10-16T20:06:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f85bc001670 con 0x7f85c806b370 2023-10-16T20:06:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 >> v1:172.21.15.152:6789/0 conn(0x7f85c806b370 legacy=0x7f85c806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:49.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85b0003a00 0x7f85b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b0004d90 0x7f85b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80ce720 con 0x7f85b0003a00 2023-10-16T20:06:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c806b750 con 0x7f85b0004d90 2023-10-16T20:06:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b000ba10 con 0x7f85c80cdd30 2023-10-16T20:06:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85b0003a00 0x7f85b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c77fe700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85ccf59700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b0004d90 0x7f85b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 -- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 msgr2=0x7f85b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 -- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b0004d90 msgr2=0x7f85b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85b0004d90 0x7f85b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 -- 172.21.15.152:0/3077199192 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00035b0 con 0x7f85b0003a00 2023-10-16T20:06:49.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c77fe700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85c80cdd30 0x7f85b0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:49.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.051+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85b0003a00 0x7f85b0003e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c320 tx=0x7f85b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8903f81ca51752 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:49.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc007c40 con 0x7f85b0003a00 2023-10-16T20:06:49.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc00ce20 con 0x7f85b0003a00 2023-10-16T20:06:49.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85c6ffd700 1 -- 172.21.15.152:0/3077199192 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc005ba0 con 0x7f85b0003a00 2023-10-16T20:06:49.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3077199192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85b0003a00 msgr2=0x7f85b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:49.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3077199192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85b0003a00 0x7f85b0003e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c320 tx=0x7f85b0005880 comp rx=0 tx=0).stop 2023-10-16T20:06:49.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ccf59700 1 -- 172.21.15.152:0/3077199192 reap_dead start 2023-10-16T20:06:49.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3077199192 shutdown_connections 2023-10-16T20:06:49.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3077199192 >> 172.21.15.152:0/3077199192 conn(0x7f85c80ccbe0 msgr2=0x7f85c80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:49.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3077199192 shutdown_connections 2023-10-16T20:06:49.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.052+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3077199192 wait complete. 2023-10-16T20:06:49.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.053+0000 7f85ce9bc700 1 Processor -- start 2023-10-16T20:06:49.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 -- start start 2023-10-16T20:06:49.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b0003a00 0x7f85c81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 0x7f85c8071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85c815a710 0x7f85c815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8072070 con 0x7f85c80716b0 2023-10-16T20:06:49.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80c4ef0 con 0x7f85c815a710 2023-10-16T20:06:49.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ce9bc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80c51d0 con 0x7f85b0003a00 2023-10-16T20:06:49.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85c77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 0x7f85c8071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85c77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 0x7f85c8071b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58670/0 (socket says 172.21.15.152:58670) 2023-10-16T20:06:49.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85c77fe700 1 -- 172.21.15.152:0/3496875806 learned_addr learned my addr 172.21.15.152:0/3496875806 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:49.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b0003a00 0x7f85c81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.054+0000 7f85ccf59700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85c815a710 0x7f85c815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c77fe700 1 -- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b0003a00 msgr2=0x7f85c81565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:49.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c77fe700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b0003a00 0x7f85c81565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c77fe700 1 -- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85c815a710 msgr2=0x7f85c815aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:49.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c77fe700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85c815a710 0x7f85c815aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c77fe700 1 -- 172.21.15.152:0/3496875806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c80c54b0 con 0x7f85c80716b0 2023-10-16T20:06:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b0003a00 0x7f85c81565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c77fe700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 0x7f85c8071b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85b80108f0 tx=0x7f85b8010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8004030 con 0x7f85c80716b0 2023-10-16T20:06:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8004190 con 0x7f85c80716b0 2023-10-16T20:06:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c80c5790 con 0x7f85c80716b0 2023-10-16T20:06:49.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8004520 con 0x7f85c80716b0 2023-10-16T20:06:49.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.055+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c8156af0 con 0x7f85c80716b0 2023-10-16T20:06:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.056+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c80c5de0 con 0x7f85c80716b0 2023-10-16T20:06:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.056+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f85b80036a0 con 0x7f85c80716b0 2023-10-16T20:06:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.057+0000 7f85c4ff9700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f85b406af00 0x7f85b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.057+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85b8089820 con 0x7f85c80716b0 2023-10-16T20:06:49.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.057+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f85b406af00 0x7f85b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.057+0000 7f85c7fff700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f85b406af00 0x7f85b406d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85bc015040 tx=0x7f85bc00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:49.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.061+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f85b8054670 con 0x7f85c80716b0 2023-10-16T20:06:49.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.294+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f85c8072d10 con 0x7f85c80716b0 2023-10-16T20:06:49.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.912+0000 7f85c4ff9700 1 -- 172.21.15.152:0/3496875806 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85b8057c90 con 0x7f85c80716b0 2023-10-16T20:06:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f85b406af00 msgr2=0x7f85b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f85b406af00 0x7f85b406d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85bc015040 tx=0x7f85bc00a000 comp rx=0 tx=0).stop 2023-10-16T20:06:49.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 msgr2=0x7f85c8071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:49.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 0x7f85c8071b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85b80108f0 tx=0x7f85b8010c00 comp rx=0 tx=0).stop 2023-10-16T20:06:49.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 shutdown_connections 2023-10-16T20:06:49.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f85b406af00 0x7f85b406d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85b0003a00 0x7f85c81565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85c815a710 0x7f85c815aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 --2- 172.21.15.152:0/3496875806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85c80716b0 0x7f85c8071b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:49.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 >> 172.21.15.152:0/3496875806 conn(0x7f85c80ccbe0 msgr2=0x7f85c806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:49.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 shutdown_connections 2023-10-16T20:06:49.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:49.915+0000 7f85ce9bc700 1 -- 172.21.15.152:0/3496875806 wait complete. 2023-10-16T20:06:49.932 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T20:06:49.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:06:50.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.057+0000 7ff3da7d5700 1 Processor -- start 2023-10-16T20:06:50.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.057+0000 7ff3da7d5700 1 -- start start 2023-10-16T20:06:50.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3da7d5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff3d40ca7d0 0x7ff3d40cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3da7d5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff3d415f000 0x7ff3d415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3da7d5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40726b0 con 0x7ff3d406a820 2023-10-16T20:06:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3da7d5700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d415ca20 con 0x7ff3d415f000 2023-10-16T20:06:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3da7d5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d40718f0 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d8d72700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff3d415f000 0x7ff3d415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d3fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff3d406a820 0x7ff3d406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38874/0 (socket says 172.21.15.152:38874) 2023-10-16T20:06:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d3fff700 1 -- 172.21.15.152:0/2822160062 learned_addr learned my addr 172.21.15.152:0/2822160062 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d37fe700 1 --2- 172.21.15.152:0/2822160062 >> v2:172.21.15.163:3300/0 conn(0x7ff3d40ca7d0 0x7ff3d40cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d8d72700 1 -- 172.21.15.152:0/2822160062 >> v2:172.21.15.163:3300/0 conn(0x7ff3d40ca7d0 msgr2=0x7ff3d40cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:50.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d8d72700 1 --2- 172.21.15.152:0/2822160062 >> v2:172.21.15.163:3300/0 conn(0x7ff3d40ca7d0 0x7ff3d40cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d8d72700 1 -- 172.21.15.152:0/2822160062 >> v1:172.21.15.152:6789/0 conn(0x7ff3d406a820 legacy=0x7ff3d406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d8d72700 1 -- 172.21.15.152:0/2822160062 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4071bd0 con 0x7ff3d415f000 2023-10-16T20:06:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d2ffd700 1 -- 172.21.15.152:0/2822160062 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46468439 0 0) 0x7ff3d40726b0 con 0x7ff3d406a820 2023-10-16T20:06:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d8d72700 1 --2- 172.21.15.152:0/2822160062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d415f000 0x7ff3d415f410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40afbb0 tx=0x7ff3cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7303261edb6ca02e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d2ffd700 1 -- 172.21.15.152:0/2822160062 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00e070 con 0x7ff3d415f000 2023-10-16T20:06:50.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d2ffd700 1 -- 172.21.15.152:0/2822160062 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc00bbd0 con 0x7ff3d415f000 2023-10-16T20:06:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.058+0000 7ff3d2ffd700 1 -- 172.21.15.152:0/2822160062 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc012430 con 0x7ff3d415f000 2023-10-16T20:06:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 -- 172.21.15.152:0/2822160062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d415f000 msgr2=0x7ff3d415f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/2822160062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d415f000 0x7ff3d415f410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40afbb0 tx=0x7ff3cc00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 -- 172.21.15.152:0/2822160062 shutdown_connections 2023-10-16T20:06:50.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/2822160062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d415f000 0x7ff3d415f410 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/2822160062 >> v2:172.21.15.163:3300/0 conn(0x7ff3d40ca7d0 0x7ff3d40cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 -- 172.21.15.152:0/2822160062 >> 172.21.15.152:0/2822160062 conn(0x7ff3d40d0180 msgr2=0x7ff3d40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 -- 172.21.15.152:0/2822160062 shutdown_connections 2023-10-16T20:06:50.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.059+0000 7ff3da7d5700 1 -- 172.21.15.152:0/2822160062 wait complete. 2023-10-16T20:06:50.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.060+0000 7ff3da7d5700 1 Processor -- start 2023-10-16T20:06:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.060+0000 7ff3da7d5700 1 -- start start 2023-10-16T20:06:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3da7d5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3d406a820 0x7ff3d41f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3da7d5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 0x7ff3d40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3da7d5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d415f000 0x7ff3d40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3da7d5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c87e0 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3da7d5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c8a40 con 0x7ff3d415f000 2023-10-16T20:06:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3da7d5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c8d20 con 0x7ff3d406a820 2023-10-16T20:06:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 0x7ff3d40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 0x7ff3d40c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58686/0 (socket says 172.21.15.152:58686) 2023-10-16T20:06:50.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d37fe700 1 -- 172.21.15.152:0/3006118512 learned_addr learned my addr 172.21.15.152:0/3006118512 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d8d72700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d415f000 0x7ff3d40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d3fff700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3d406a820 0x7ff3d41f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d37fe700 1 -- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3d406a820 msgr2=0x7ff3d41f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.061+0000 7ff3d37fe700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3d406a820 0x7ff3d41f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d37fe700 1 -- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d415f000 msgr2=0x7ff3d40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d37fe700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d415f000 0x7ff3d40b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d37fe700 1 -- 172.21.15.152:0/3006118512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009a70 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d37fe700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 0x7ff3d40c82a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800e810 tx=0x7ff3c800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800c070 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8013610 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40c9000 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80139c0 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.062+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d40c95c0 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.063+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4067d10 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.063+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3c8013b20 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.064+0000 7ff3d0ff9700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff3c006af00 0x7ff3c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.064+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3c8089620 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.064+0000 7ff3d3fff700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff3c006af00 0x7ff3c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.064+0000 7ff3d3fff700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff3c006af00 0x7ff3c006d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4007fd0 tx=0x7ff3c4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.068+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3c80543f0 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.303+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3d404ebb0 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.303+0000 7ff3d0ff9700 1 -- 172.21.15.152:0/3006118512 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7ff3c8057a10 con 0x7ff3d40ca7d0 2023-10-16T20:06:50.305 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:50.306 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:06:50.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff3c006af00 msgr2=0x7ff3c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff3c006af00 0x7ff3c006d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4007fd0 tx=0x7ff3c4007de0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 msgr2=0x7ff3d40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 0x7ff3d40c82a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800e810 tx=0x7ff3c800eb20 comp rx=0 tx=0).stop 2023-10-16T20:06:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 shutdown_connections 2023-10-16T20:06:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff3c006af00 0x7ff3c006d3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff3d406a820 0x7ff3d41f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d415f000 0x7ff3d40b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 --2- 172.21.15.152:0/3006118512 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3d40ca7d0 0x7ff3d40c82a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 >> 172.21.15.152:0/3006118512 conn(0x7ff3d40d0180 msgr2=0x7ff3d4157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 shutdown_connections 2023-10-16T20:06:50.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.305+0000 7ff3da7d5700 1 -- 172.21.15.152:0/3006118512 wait complete. 2023-10-16T20:06:50.310 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:06:50.319 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.438+0000 7fbd54df7700 1 Processor -- start 2023-10-16T20:06:50.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.438+0000 7fbd54df7700 1 -- start start 2023-10-16T20:06:50.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd54df7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd500ae1c0 0x7fbd500cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd54df7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd5006e290 0x7fbd500cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd54df7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd50161350 con 0x7fbd5006e7e0 2023-10-16T20:06:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd54df7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd501615f0 con 0x7fbd5006e290 2023-10-16T20:06:50.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd54df7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd501618d0 con 0x7fbd500ae1c0 2023-10-16T20:06:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd5006e290 0x7fbd500cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd5006e290 0x7fbd500cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58690/0 (socket says 172.21.15.152:58690) 2023-10-16T20:06:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 -- 172.21.15.152:0/4123688643 learned_addr learned my addr 172.21.15.152:0/4123688643 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4e59c700 1 --2- 172.21.15.152:0/4123688643 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd500ae1c0 0x7fbd500cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 -- 172.21.15.152:0/4123688643 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd500ae1c0 msgr2=0x7fbd500cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 --2- 172.21.15.152:0/4123688643 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd500ae1c0 0x7fbd500cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 -- 172.21.15.152:0/4123688643 >> v1:172.21.15.163:6789/0 conn(0x7fbd5006e7e0 legacy=0x7fbd5006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 -- 172.21.15.152:0/4123688643 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50161bb0 con 0x7fbd5006e290 2023-10-16T20:06:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4dd9b700 1 --2- 172.21.15.152:0/4123688643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd5006e290 0x7fbd500cd9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbd440098f0 tx=0x7fbd44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c8db160c2d42e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4d59a700 1 -- 172.21.15.152:0/4123688643 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44004230 con 0x7fbd5006e290 2023-10-16T20:06:50.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4d59a700 1 -- 172.21.15.152:0/4123688643 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44004390 con 0x7fbd5006e290 2023-10-16T20:06:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.439+0000 7fbd4d59a700 1 -- 172.21.15.152:0/4123688643 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440036a0 con 0x7fbd5006e290 2023-10-16T20:06:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 -- 172.21.15.152:0/4123688643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd5006e290 msgr2=0x7fbd500cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 --2- 172.21.15.152:0/4123688643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd5006e290 0x7fbd500cd9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbd440098f0 tx=0x7fbd44009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 -- 172.21.15.152:0/4123688643 shutdown_connections 2023-10-16T20:06:50.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 --2- 172.21.15.152:0/4123688643 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd500ae1c0 0x7fbd500cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 --2- 172.21.15.152:0/4123688643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd5006e290 0x7fbd500cd9f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 -- 172.21.15.152:0/4123688643 >> 172.21.15.152:0/4123688643 conn(0x7fbd500cfcd0 msgr2=0x7fbd500d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 -- 172.21.15.152:0/4123688643 shutdown_connections 2023-10-16T20:06:50.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.440+0000 7fbd54df7700 1 -- 172.21.15.152:0/4123688643 wait complete. 2023-10-16T20:06:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.441+0000 7fbd54df7700 1 Processor -- start 2023-10-16T20:06:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.441+0000 7fbd54df7700 1 -- start start 2023-10-16T20:06:50.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd54df7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd5006e290 0x7fbd500c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd54df7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd5006e7e0 0x7fbd500c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd54df7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 0x7fbd500c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd54df7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50150420 con 0x7fbd500ae1c0 2023-10-16T20:06:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd54df7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5014fa80 con 0x7fbd5006e290 2023-10-16T20:06:50.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd54df7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5014fd60 con 0x7fbd5006e7e0 2023-10-16T20:06:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd4ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 0x7fbd500c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd4ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 0x7fbd500c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58700/0 (socket says 172.21.15.152:58700) 2023-10-16T20:06:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd4ed9d700 1 -- 172.21.15.152:0/1510954603 learned_addr learned my addr 172.21.15.152:0/1510954603 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.442+0000 7fbd4e59c700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd5006e290 0x7fbd500c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4dd9b700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd5006e7e0 0x7fbd500c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4ed9d700 1 -- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd5006e7e0 msgr2=0x7fbd500c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4ed9d700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd5006e7e0 0x7fbd500c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4ed9d700 1 -- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd5006e290 msgr2=0x7fbd500c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4ed9d700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd5006e290 0x7fbd500c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4ed9d700 1 -- 172.21.15.152:0/1510954603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44009550 con 0x7fbd500ae1c0 2023-10-16T20:06:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4e59c700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd5006e290 0x7fbd500c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd4ed9d700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 0x7fbd500c9000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800cb60 tx=0x7fbd4800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800ab10 con 0x7fbd500ae1c0 2023-10-16T20:06:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800ac70 con 0x7fbd500ae1c0 2023-10-16T20:06:50.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50150040 con 0x7fbd500ae1c0 2023-10-16T20:06:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48012420 con 0x7fbd500ae1c0 2023-10-16T20:06:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.443+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd500c73f0 con 0x7fbd500ae1c0 2023-10-16T20:06:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.444+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5004ebb0 con 0x7fbd500ae1c0 2023-10-16T20:06:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.444+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbd48012580 con 0x7fbd500ae1c0 2023-10-16T20:06:50.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.445+0000 7fbd3effd700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbd3006af00 0x7fbd3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.445+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd48089a00 con 0x7fbd500ae1c0 2023-10-16T20:06:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.445+0000 7fbd4e59c700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbd3006af00 0x7fbd3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.445+0000 7fbd4e59c700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbd3006af00 0x7fbd3006d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000aa50 tx=0x7fbd40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.449+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbd48054850 con 0x7fbd500ae1c0 2023-10-16T20:06:50.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.637+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd500c73f0 con 0x7fbd500ae1c0 2023-10-16T20:06:50.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.638+0000 7fbd3effd700 1 -- 172.21.15.152:0/1510954603 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fbd500c73f0 con 0x7fbd500ae1c0 2023-10-16T20:06:50.640 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:50.640 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbd3006af00 msgr2=0x7fbd3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbd3006af00 0x7fbd3006d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000aa50 tx=0x7fbd40008040 comp rx=0 tx=0).stop 2023-10-16T20:06:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 msgr2=0x7fbd500c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 0x7fbd500c9000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800cb60 tx=0x7fbd4800cf20 comp rx=0 tx=0).stop 2023-10-16T20:06:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 shutdown_connections 2023-10-16T20:06:50.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbd3006af00 0x7fbd3006d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd500ae1c0 0x7fbd500c9000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbd5006e290 0x7fbd500c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 --2- 172.21.15.152:0/1510954603 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbd5006e7e0 0x7fbd500c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 >> 172.21.15.152:0/1510954603 conn(0x7fbd500cfcd0 msgr2=0x7fbd500d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:50.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.640+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 shutdown_connections 2023-10-16T20:06:50.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.641+0000 7fbd54df7700 1 -- 172.21.15.152:0/1510954603 wait complete. 2023-10-16T20:06:50.655 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T20:06:50.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:06:50.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.774+0000 7f9888907700 1 Processor -- start 2023-10-16T20:06:50.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.774+0000 7f9888907700 1 -- start start 2023-10-16T20:06:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f9888907700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f988415d7a0 0x7f98840cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f9888907700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98840ce3c0 con 0x7f98840b5690 2023-10-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f9888907700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98840cf220 con 0x7f98840b8e70 2023-10-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f9888907700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988415db80 con 0x7f988415d7a0 2023-10-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f9882d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f98840b5690 0x7f98840b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38906/0 (socket says 172.21.15.152:38906) 2023-10-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f9882d9d700 1 -- 172.21.15.152:0/4109384418 learned_addr learned my addr 172.21.15.152:0/4109384418 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555501539 0 0) 0x7f98840ce3c0 con 0x7f98840b5690 2023-10-16T20:06:50.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988259c700 1 --2- 172.21.15.152:0/4109384418 >> v2:172.21.15.163:3300/0 conn(0x7f988415d7a0 0x7f98840cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f986c0035b0 con 0x7f98840b5690 2023-10-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327192170 0 0) 0x7f986c0035b0 con 0x7f98840b5690 2023-10-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 >> v2:172.21.15.163:3300/0 conn(0x7f988415d7a0 msgr2=0x7f98840cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 --2- 172.21.15.152:0/4109384418 >> v2:172.21.15.163:3300/0 conn(0x7f988415d7a0 0x7f98840cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 >> v1:172.21.15.163:6789/0 conn(0x7f98840b8e70 legacy=0x7f98840b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840ce610 con 0x7f98840b5690 2023-10-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f987c0019f0 con 0x7f98840b5690 2023-10-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 >> v1:172.21.15.152:6789/0 conn(0x7f98840b5690 legacy=0x7f98840b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c003a00 0x7f986c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c004400 0x7f986c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f986c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c00bf80 con 0x7f986c005100 2023-10-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c00c0f0 con 0x7f986c004400 2023-10-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.775+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c00c2b0 con 0x7f986c003a00 2023-10-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f986c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f988259c700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c003a00 0x7f986c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9881d9b700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c004400 0x7f986c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 -- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c003a00 msgr2=0x7f986c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:50.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f986c003a00 0x7f986c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 -- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c004400 msgr2=0x7f986c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:50.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f986c004400 0x7f986c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 -- 172.21.15.152:0/4109384418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0035b0 con 0x7f986c005100 2023-10-16T20:06:50.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 -- 172.21.15.152:0/4109384418 reap_dead start 2023-10-16T20:06:50.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f9882d9d700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f986c00ba10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f988406c8f0 tx=0x7f986c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd187de0b1917e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00a300 con 0x7f986c005100 2023-10-16T20:06:50.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c012620 con 0x7f986c005100 2023-10-16T20:06:50.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.776+0000 7f988159a700 1 -- 172.21.15.152:0/4109384418 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0129d0 con 0x7f986c005100 2023-10-16T20:06:50.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 -- 172.21.15.152:0/4109384418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 msgr2=0x7f986c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f986c00ba10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f988406c8f0 tx=0x7f986c005880 comp rx=0 tx=0).stop 2023-10-16T20:06:50.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 -- 172.21.15.152:0/4109384418 shutdown_connections 2023-10-16T20:06:50.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 --2- 172.21.15.152:0/4109384418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f986c00ba10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 -- 172.21.15.152:0/4109384418 >> 172.21.15.152:0/4109384418 conn(0x7f98840723a0 msgr2=0x7f98840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:50.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 -- 172.21.15.152:0/4109384418 shutdown_connections 2023-10-16T20:06:50.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.777+0000 7f9888907700 1 -- 172.21.15.152:0/4109384418 wait complete. 2023-10-16T20:06:50.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.778+0000 7f9888907700 1 Processor -- start 2023-10-16T20:06:50.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.778+0000 7f9888907700 1 -- start start 2023-10-16T20:06:50.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9888907700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f9884153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9888907700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98841e6f60 0x7f98840d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9888907700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840d3a10 0x7f98840b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9888907700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9884154380 con 0x7f986c005100 2023-10-16T20:06:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9888907700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840d3e90 con 0x7f98841e6f60 2023-10-16T20:06:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9888907700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840cb9a0 con 0x7f98840d3a10 2023-10-16T20:06:50.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f9884153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f9884153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58716/0 (socket says 172.21.15.152:58716) 2023-10-16T20:06:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 -- 172.21.15.152:0/3974919816 learned_addr learned my addr 172.21.15.152:0/3974919816 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9881d9b700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98841e6f60 0x7f98840d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9882d9d700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840d3a10 0x7f98840b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 -- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840d3a10 msgr2=0x7f98840b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840d3a10 0x7f98840b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 -- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98841e6f60 msgr2=0x7f98840d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98841e6f60 0x7f98840d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 -- 172.21.15.152:0/3974919816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840cbc80 con 0x7f986c005100 2023-10-16T20:06:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f988259c700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f9884153e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98740119a0 tx=0x7f9874011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400f780 con 0x7f986c005100 2023-10-16T20:06:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.779+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987400f8e0 con 0x7f986c005100 2023-10-16T20:06:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.780+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98840cbf60 con 0x7f986c005100 2023-10-16T20:06:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.780+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400fc70 con 0x7f986c005100 2023-10-16T20:06:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.780+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98840cc520 con 0x7f986c005100 2023-10-16T20:06:50.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.780+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988404ebb0 con 0x7f986c005100 2023-10-16T20:06:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.781+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9874014440 con 0x7f986c005100 2023-10-16T20:06:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.781+0000 7f9872ffd700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f986406af00 0x7f986406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.781+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9874089e70 con 0x7f986c005100 2023-10-16T20:06:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.781+0000 7f9881d9b700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f986406af00 0x7f986406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:50.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.782+0000 7f9881d9b700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f986406af00 0x7f986406d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98840d4210 tx=0x7f9878009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:50.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.786+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9874054cc0 con 0x7f986c005100 2023-10-16T20:06:50.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.973+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98840cebd0 con 0x7f986406af00 2023-10-16T20:06:50.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.983+0000 7f9872ffd700 1 -- 172.21.15.152:0/3974919816 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7f9878006860 con 0x7f986406af00 2023-10-16T20:06:50.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:50.992 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f986406af00 msgr2=0x7f986406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f986406af00 0x7f986406d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98840d4210 tx=0x7f9878009040 comp rx=0 tx=0).stop 2023-10-16T20:06:50.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 msgr2=0x7f9884153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:50.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f9884153e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98740119a0 tx=0x7f9874011cb0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 shutdown_connections 2023-10-16T20:06:50.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f986406af00 0x7f986406d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f98840d3a10 0x7f98840b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f986c005100 0x7f9884153e40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 --2- 172.21.15.152:0/3974919816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98841e6f60 0x7f98840d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:50.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 >> 172.21.15.152:0/3974919816 conn(0x7f98840723a0 msgr2=0x7f98840b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:50.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 shutdown_connections 2023-10-16T20:06:50.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:50.987+0000 7f9888907700 1 -- 172.21.15.152:0/3974919816 wait complete. 2023-10-16T20:06:50.995 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:06:51.001 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-16T20:06:50.765371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3416064,"data_stored":2039488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002768"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195372+0000","last_change":"2023-10-16T20:06:32.768697+0000","last_active":"2023-10-16T20:06:37.195372+0000","last_peered":"2023-10-16T20:06:37.195372+0000","last_clean":"2023-10-16T20:06:37.195372+0000","last_became_active":"2023-10-16T20:06:32.768425+0000","last_became_peered":"2023-10-16T20:06:32.768425+0000","last_unstale":"2023-10-16T20:06:37.195372+0000","last_undegraded":"2023-10-16T20:06:37.195372+0000","last_fullsized":"2023-10-16T20:06:37.195372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886277+0000","last_change":"2023-10-16T20:06:32.752823+0000","last_active":"2023-10-16T20:06:36.886277+0000","last_peered":"2023-10-16T20:06:36.886277+0000","last_clean":"2023-10-16T20:06:36.886277+0000","last_became_active":"2023-10-16T20:06:32.752488+0000","last_became_peered":"2023-10-16T20:06:32.752488+0000","last_unstale":"2023-10-16T20:06:36.886277+0000","last_undegraded":"2023-10-16T20:06:36.886277+0000","last_fullsized":"2023-10-16T20:06:36.886277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885188+0000","last_change":"2023-10-16T20:06:32.755212+0000","last_active":"2023-10-16T20:06:36.885188+0000","last_peered":"2023-10-16T20:06:36.885188+0000","last_clean":"2023-10-16T20:06:36.885188+0000","last_became_active":"2023-10-16T20:06:32.754919+0000","last_became_peered":"2023-10-16T20:06:32.754919+0000","last_unstale":"2023-10-16T20:06:36.885188+0000","last_undegraded":"2023-10-16T20:06:36.885188+0000","last_fullsized":"2023-10-16T20:06:36.885188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.761928+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761127+0000","last_became_peered":"2023-10-16T20:06:32.761127+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194887+0000","last_change":"2023-10-16T20:06:32.767050+0000","last_active":"2023-10-16T20:06:37.194887+0000","last_peered":"2023-10-16T20:06:37.194887+0000","last_clean":"2023-10-16T20:06:37.194887+0000","last_became_active":"2023-10-16T20:06:32.766739+0000","last_became_peered":"2023-10-16T20:06:32.766739+0000","last_unstale":"2023-10-16T20:06:37.194887+0000","last_undegraded":"2023-10-16T20:06:37.194887+0000","last_fullsized":"2023-10-16T20:06:37.194887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884978+0000","last_change":"2023-10-16T20:06:32.761991+0000","last_active":"2023-10-16T20:06:36.884978+0000","last_peered":"2023-10-16T20:06:36.884978+0000","last_clean":"2023-10-16T20:06:36.884978+0000","last_became_active":"2023-10-16T20:06:32.761421+0000","last_became_peered":"2023-10-16T20:06:32.761421+0000","last_unstale":"2023-10-16T20:06:36.884978+0000","last_undegraded":"2023-10-16T20:06:36.884978+0000","last_fullsized":"2023-10-16T20:06:36.884978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194866+0000","last_change":"2023-10-16T20:06:32.767492+0000","last_active":"2023-10-16T20:06:37.194866+0000","last_peered":"2023-10-16T20:06:37.194866+0000","last_clean":"2023-10-16T20:06:37.194866+0000","last_became_active":"2023-10-16T20:06:32.767148+0000","last_became_peered":"2023-10-16T20:06:32.767148+0000","last_unstale":"2023-10-16T20:06:37.194866+0000","last_undegraded":"2023-10-16T20:06:37.194866+0000","last_fullsized":"2023-10-16T20:06:37.194866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894286+0000","last_change":"2023-10-16T20:06:32.761690+0000","last_active":"2023-10-16T20:06:36.894286+0000","last_peered":"2023-10-16T20:06:36.894286+0000","last_clean":"2023-10-16T20:06:36.894286+0000","last_became_active":"2023-10-16T20:06:32.761353+0000","last_became_peered":"2023-10-16T20:06:32.761353+0000","last_unstale":"2023-10-16T20:06:36.894286+0000","last_undegraded":"2023-10-16T20:06:36.894286+0000","last_fullsized":"2023-10-16T20:06:36.894286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195306+0000","last_change":"2023-10-16T20:06:32.768700+0000","last_active":"2023-10-16T20:06:37.195306+0000","last_peered":"2023-10-16T20:06:37.195306+0000","last_clean":"2023-10-16T20:06:37.195306+0000","last_became_active":"2023-10-16T20:06:32.768467+0000","last_became_peered":"2023-10-16T20:06:32.768467+0000","last_unstale":"2023-10-16T20:06:37.195306+0000","last_undegraded":"2023-10-16T20:06:37.195306+0000","last_fullsized":"2023-10-16T20:06:37.195306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878795+0000","last_change":"2023-10-16T20:06:32.761708+0000","last_active":"2023-10-16T20:06:36.878795+0000","last_peered":"2023-10-16T20:06:36.878795+0000","last_clean":"2023-10-16T20:06:36.878795+0000","last_became_active":"2023-10-16T20:06:32.761049+0000","last_became_peered":"2023-10-16T20:06:32.761049+0000","last_unstale":"2023-10-16T20:06:36.878795+0000","last_undegraded":"2023-10-16T20:06:36.878795+0000","last_fullsized":"2023-10-16T20:06:36.878795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.879062+0000","last_change":"2023-10-16T20:06:32.763671+0000","last_active":"2023-10-16T20:06:36.879062+0000","last_peered":"2023-10-16T20:06:36.879062+0000","last_clean":"2023-10-16T20:06:36.879062+0000","last_became_active":"2023-10-16T20:06:32.763356+0000","last_became_peered":"2023-10-16T20:06:32.763356+0000","last_unstale":"2023-10-16T20:06:36.879062+0000","last_undegraded":"2023-10-16T20:06:36.879062+0000","last_fullsized":"2023-10-16T20:06:36.879062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:47.470974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876982+0000","last_change":"2023-10-16T20:06:32.750776+0000","last_active":"2023-10-16T20:06:36.876982+0000","last_peered":"2023-10-16T20:06:36.876982+0000","last_clean":"2023-10-16T20:06:36.876982+0000","last_became_active":"2023-10-16T20:06:32.750465+0000","last_became_peered":"2023-10-16T20:06:32.750465+0000","last_unstale":"2023-10-16T20:06:36.876982+0000","last_undegraded":"2023-10-16T20:06:36.876982+0000","last_fullsized":"2023-10-16T20:06:36.876982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:55.631957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893374+0000","last_change":"2023-10-16T20:06:32.759849+0000","last_active":"2023-10-16T20:06:36.893374+0000","last_peered":"2023-10-16T20:06:36.893374+0000","last_clean":"2023-10-16T20:06:36.893374+0000","last_became_active":"2023-10-16T20:06:32.759521+0000","last_became_peered":"2023-10-16T20:06:32.759521+0000","last_unstale":"2023-10-16T20:06:36.893374+0000","last_undegraded":"2023-10-16T20:06:36.893374+0000","last_fullsized":"2023-10-16T20:06:36.893374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881227+0000","last_change":"2023-10-16T20:06:32.758196+0000","last_active":"2023-10-16T20:06:36.881227+0000","last_peered":"2023-10-16T20:06:36.881227+0000","last_clean":"2023-10-16T20:06:36.881227+0000","last_became_active":"2023-10-16T20:06:32.757915+0000","last_became_peered":"2023-10-16T20:06:32.757915+0000","last_unstale":"2023-10-16T20:06:36.881227+0000","last_undegraded":"2023-10-16T20:06:36.881227+0000","last_fullsized":"2023-10-16T20:06:36.881227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882603+0000","last_change":"2023-10-16T20:06:32.745759+0000","last_active":"2023-10-16T20:06:36.882603+0000","last_peered":"2023-10-16T20:06:36.882603+0000","last_clean":"2023-10-16T20:06:36.882603+0000","last_became_active":"2023-10-16T20:06:32.745456+0000","last_became_peered":"2023-10-16T20:06:32.745456+0000","last_unstale":"2023-10-16T20:06:36.882603+0000","last_undegraded":"2023-10-16T20:06:36.882603+0000","last_fullsized":"2023-10-16T20:06:36.882603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884589+0000","last_change":"2023-10-16T20:06:32.762852+0000","last_active":"2023-10-16T20:06:36.884589+0000","last_peered":"2023-10-16T20:06:36.884589+0000","last_clean":"2023-10-16T20:06:36.884589+0000","last_became_active":"2023-10-16T20:06:32.762554+0000","last_became_peered":"2023-10-16T20:06:32.762554+0000","last_unstale":"2023-10-16T20:06:36.884589+0000","last_undegraded":"2023-10-16T20:06:36.884589+0000","last_fullsized":"2023-10-16T20:06:36.884589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885258+0000","last_change":"2023-10-16T20:06:32.769083+0000","last_active":"2023-10-16T20:06:36.885258+0000","last_peered":"2023-10-16T20:06:36.885258+0000","last_clean":"2023-10-16T20:06:36.885258+0000","last_became_active":"2023-10-16T20:06:32.768686+0000","last_became_peered":"2023-10-16T20:06:32.768686+0000","last_unstale":"2023-10-16T20:06:36.885258+0000","last_undegraded":"2023-10-16T20:06:36.885258+0000","last_fullsized":"2023-10-16T20:06:36.885258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876513+0000","last_change":"2023-10-16T20:06:32.756439+0000","last_active":"2023-10-16T20:06:36.876513+0000","last_peered":"2023-10-16T20:06:36.876513+0000","last_clean":"2023-10-16T20:06:36.876513+0000","last_became_active":"2023-10-16T20:06:32.756183+0000","last_became_peered":"2023-10-16T20:06:32.756183+0000","last_unstale":"2023-10-16T20:06:36.876513+0000","last_undegraded":"2023-10-16T20:06:36.876513+0000","last_fullsized":"2023-10-16T20:06:36.876513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:35.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195238+0000","last_change":"2023-10-16T20:06:32.759997+0000","last_active":"2023-10-16T20:06:37.195238+0000","last_peered":"2023-10-16T20:06:37.195238+0000","last_clean":"2023-10-16T20:06:37.195238+0000","last_became_active":"2023-10-16T20:06:32.759616+0000","last_became_peered":"2023-10-16T20:06:32.759616+0000","last_unstale":"2023-10-16T20:06:37.195238+0000","last_undegraded":"2023-10-16T20:06:37.195238+0000","last_fullsized":"2023-10-16T20:06:37.195238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877453+0000","last_change":"2023-10-16T20:06:37.202706+0000","last_active":"2023-10-16T20:06:37.877453+0000","last_peered":"2023-10-16T20:06:37.877453+0000","last_clean":"2023-10-16T20:06:37.877453+0000","last_became_active":"2023-10-16T20:06:37.201561+0000","last_became_peered":"2023-10-16T20:06:37.201561+0000","last_unstale":"2023-10-16T20:06:37.877453+0000","last_undegraded":"2023-10-16T20:06:37.877453+0000","last_fullsized":"2023-10-16T20:06:37.877453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:54.383396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881285+0000","last_change":"2023-10-16T20:06:31.760708+0000","last_active":"2023-10-16T20:06:36.881285+0000","last_peered":"2023-10-16T20:06:36.881285+0000","last_clean":"2023-10-16T20:06:36.881285+0000","last_became_active":"2023-10-16T20:06:31.760372+0000","last_became_peered":"2023-10-16T20:06:31.760372+0000","last_unstale":"2023-10-16T20:06:36.881285+0000","last_undegraded":"2023-10-16T20:06:36.881285+0000","last_fullsized":"2023-10-16T20:06:36.881285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:34.488224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894537+0000","last_change":"2023-10-16T20:06:32.755438+0000","last_active":"2023-10-16T20:06:36.894537+0000","last_peered":"2023-10-16T20:06:36.894537+0000","last_clean":"2023-10-16T20:06:36.894537+0000","last_became_active":"2023-10-16T20:06:32.755151+0000","last_became_peered":"2023-10-16T20:06:32.755151+0000","last_unstale":"2023-10-16T20:06:36.894537+0000","last_undegraded":"2023-10-16T20:06:36.894537+0000","last_fullsized":"2023-10-16T20:06:36.894537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877813+0000","last_change":"2023-10-16T20:06:36.894982+0000","last_active":"2023-10-16T20:06:37.877813+0000","last_peered":"2023-10-16T20:06:37.877813+0000","last_clean":"2023-10-16T20:06:37.877813+0000","last_became_active":"2023-10-16T20:06:36.894580+0000","last_became_peered":"2023-10-16T20:06:36.894580+0000","last_unstale":"2023-10-16T20:06:37.877813+0000","last_undegraded":"2023-10-16T20:06:37.877813+0000","last_fullsized":"2023-10-16T20:06:37.877813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:01.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894628+0000","last_change":"2023-10-16T20:06:31.758252+0000","last_active":"2023-10-16T20:06:36.894628+0000","last_peered":"2023-10-16T20:06:36.894628+0000","last_clean":"2023-10-16T20:06:36.894628+0000","last_became_active":"2023-10-16T20:06:31.758059+0000","last_became_peered":"2023-10-16T20:06:31.758059+0000","last_unstale":"2023-10-16T20:06:36.894628+0000","last_undegraded":"2023-10-16T20:06:36.894628+0000","last_fullsized":"2023-10-16T20:06:36.894628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881181+0000","last_change":"2023-10-16T20:06:32.762874+0000","last_active":"2023-10-16T20:06:36.881181+0000","last_peered":"2023-10-16T20:06:36.881181+0000","last_clean":"2023-10-16T20:06:36.881181+0000","last_became_active":"2023-10-16T20:06:32.762402+0000","last_became_peered":"2023-10-16T20:06:32.762402+0000","last_unstale":"2023-10-16T20:06:36.881181+0000","last_undegraded":"2023-10-16T20:06:36.881181+0000","last_fullsized":"2023-10-16T20:06:36.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877518+0000","last_change":"2023-10-16T20:06:36.898631+0000","last_active":"2023-10-16T20:06:37.877518+0000","last_peered":"2023-10-16T20:06:37.877518+0000","last_clean":"2023-10-16T20:06:37.877518+0000","last_became_active":"2023-10-16T20:06:36.898270+0000","last_became_peered":"2023-10-16T20:06:36.898270+0000","last_unstale":"2023-10-16T20:06:37.877518+0000","last_undegraded":"2023-10-16T20:06:37.877518+0000","last_fullsized":"2023-10-16T20:06:37.877518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:51.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195047+0000","last_change":"2023-10-16T20:06:31.760987+0000","last_active":"2023-10-16T20:06:37.195047+0000","last_peered":"2023-10-16T20:06:37.195047+0000","last_clean":"2023-10-16T20:06:37.195047+0000","last_became_active":"2023-10-16T20:06:31.760689+0000","last_became_peered":"2023-10-16T20:06:31.760689+0000","last_unstale":"2023-10-16T20:06:37.195047+0000","last_undegraded":"2023-10-16T20:06:37.195047+0000","last_fullsized":"2023-10-16T20:06:37.195047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:55.970423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884745+0000","last_change":"2023-10-16T20:06:32.761819+0000","last_active":"2023-10-16T20:06:36.884745+0000","last_peered":"2023-10-16T20:06:36.884745+0000","last_clean":"2023-10-16T20:06:36.884745+0000","last_became_active":"2023-10-16T20:06:32.760684+0000","last_became_peered":"2023-10-16T20:06:32.760684+0000","last_unstale":"2023-10-16T20:06:36.884745+0000","last_undegraded":"2023-10-16T20:06:36.884745+0000","last_fullsized":"2023-10-16T20:06:36.884745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878229+0000","last_change":"2023-10-16T20:06:36.892310+0000","last_active":"2023-10-16T20:06:37.878229+0000","last_peered":"2023-10-16T20:06:37.878229+0000","last_clean":"2023-10-16T20:06:37.878229+0000","last_became_active":"2023-10-16T20:06:36.891929+0000","last_became_peered":"2023-10-16T20:06:36.891929+0000","last_unstale":"2023-10-16T20:06:37.878229+0000","last_undegraded":"2023-10-16T20:06:37.878229+0000","last_fullsized":"2023-10-16T20:06:37.878229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:08.770589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194885+0000","last_change":"2023-10-16T20:06:31.764299+0000","last_active":"2023-10-16T20:06:37.194885+0000","last_peered":"2023-10-16T20:06:37.194885+0000","last_clean":"2023-10-16T20:06:37.194885+0000","last_became_active":"2023-10-16T20:06:31.763992+0000","last_became_peered":"2023-10-16T20:06:31.763992+0000","last_unstale":"2023-10-16T20:06:37.194885+0000","last_undegraded":"2023-10-16T20:06:37.194885+0000","last_fullsized":"2023-10-16T20:06:37.194885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:47.236030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885181+0000","last_change":"2023-10-16T20:06:32.762698+0000","last_active":"2023-10-16T20:06:36.885181+0000","last_peered":"2023-10-16T20:06:36.885181+0000","last_clean":"2023-10-16T20:06:36.885181+0000","last_became_active":"2023-10-16T20:06:32.762260+0000","last_became_peered":"2023-10-16T20:06:32.762260+0000","last_unstale":"2023-10-16T20:06:36.885181+0000","last_undegraded":"2023-10-16T20:06:36.885181+0000","last_fullsized":"2023-10-16T20:06:36.885181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877522+0000","last_change":"2023-10-16T20:06:36.899980+0000","last_active":"2023-10-16T20:06:37.877522+0000","last_peered":"2023-10-16T20:06:37.877522+0000","last_clean":"2023-10-16T20:06:37.877522+0000","last_became_active":"2023-10-16T20:06:36.899573+0000","last_became_peered":"2023-10-16T20:06:36.899573+0000","last_unstale":"2023-10-16T20:06:37.877522+0000","last_undegraded":"2023-10-16T20:06:37.877522+0000","last_fullsized":"2023-10-16T20:06:37.877522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:13.468658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893703+0000","last_change":"2023-10-16T20:06:31.760320+0000","last_active":"2023-10-16T20:06:36.893703+0000","last_peered":"2023-10-16T20:06:36.893703+0000","last_clean":"2023-10-16T20:06:36.893703+0000","last_became_active":"2023-10-16T20:06:31.759976+0000","last_became_peered":"2023-10-16T20:06:31.759976+0000","last_unstale":"2023-10-16T20:06:36.893703+0000","last_undegraded":"2023-10-16T20:06:36.893703+0000","last_fullsized":"2023-10-16T20:06:36.893703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878749+0000","last_change":"2023-10-16T20:06:32.746691+0000","last_active":"2023-10-16T20:06:36.878749+0000","last_peered":"2023-10-16T20:06:36.878749+0000","last_clean":"2023-10-16T20:06:36.878749+0000","last_became_active":"2023-10-16T20:06:32.745389+0000","last_became_peered":"2023-10-16T20:06:32.745389+0000","last_unstale":"2023-10-16T20:06:36.878749+0000","last_undegraded":"2023-10-16T20:06:36.878749+0000","last_fullsized":"2023-10-16T20:06:36.878749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:23:34.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450907+0000","last_change":"2023-10-16T20:06:36.900651+0000","last_active":"2023-10-16T20:06:38.450907+0000","last_peered":"2023-10-16T20:06:38.450907+0000","last_clean":"2023-10-16T20:06:38.450907+0000","last_became_active":"2023-10-16T20:06:36.900236+0000","last_became_peered":"2023-10-16T20:06:36.900236+0000","last_unstale":"2023-10-16T20:06:38.450907+0000","last_undegraded":"2023-10-16T20:06:38.450907+0000","last_fullsized":"2023-10-16T20:06:38.450907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:01.291449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876809+0000","last_change":"2023-10-16T20:06:31.761790+0000","last_active":"2023-10-16T20:06:36.876809+0000","last_peered":"2023-10-16T20:06:36.876809+0000","last_clean":"2023-10-16T20:06:36.876809+0000","last_became_active":"2023-10-16T20:06:31.761519+0000","last_became_peered":"2023-10-16T20:06:31.761519+0000","last_unstale":"2023-10-16T20:06:36.876809+0000","last_undegraded":"2023-10-16T20:06:36.876809+0000","last_fullsized":"2023-10-16T20:06:36.876809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:20.846036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881411+0000","last_change":"2023-10-16T20:06:32.757771+0000","last_active":"2023-10-16T20:06:36.881411+0000","last_peered":"2023-10-16T20:06:36.881411+0000","last_clean":"2023-10-16T20:06:36.881411+0000","last_became_active":"2023-10-16T20:06:32.757124+0000","last_became_peered":"2023-10-16T20:06:32.757124+0000","last_unstale":"2023-10-16T20:06:36.881411+0000","last_undegraded":"2023-10-16T20:06:36.881411+0000","last_fullsized":"2023-10-16T20:06:36.881411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877753+0000","last_change":"2023-10-16T20:06:36.894985+0000","last_active":"2023-10-16T20:06:37.877753+0000","last_peered":"2023-10-16T20:06:37.877753+0000","last_clean":"2023-10-16T20:06:37.877753+0000","last_became_active":"2023-10-16T20:06:36.894583+0000","last_became_peered":"2023-10-16T20:06:36.894583+0000","last_unstale":"2023-10-16T20:06:37.877753+0000","last_undegraded":"2023-10-16T20:06:37.877753+0000","last_fullsized":"2023-10-16T20:06:37.877753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893346+0000","last_change":"2023-10-16T20:06:31.755087+0000","last_active":"2023-10-16T20:06:36.893346+0000","last_peered":"2023-10-16T20:06:36.893346+0000","last_clean":"2023-10-16T20:06:36.893346+0000","last_became_active":"2023-10-16T20:06:31.754799+0000","last_became_peered":"2023-10-16T20:06:31.754799+0000","last_unstale":"2023-10-16T20:06:36.893346+0000","last_undegraded":"2023-10-16T20:06:36.893346+0000","last_fullsized":"2023-10-16T20:06:36.893346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:50.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894075+0000","last_change":"2023-10-16T20:06:32.760484+0000","last_active":"2023-10-16T20:06:36.894075+0000","last_peered":"2023-10-16T20:06:36.894075+0000","last_clean":"2023-10-16T20:06:36.894075+0000","last_became_active":"2023-10-16T20:06:32.759921+0000","last_became_peered":"2023-10-16T20:06:32.759921+0000","last_unstale":"2023-10-16T20:06:36.894075+0000","last_undegraded":"2023-10-16T20:06:36.894075+0000","last_fullsized":"2023-10-16T20:06:36.894075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450546+0000","last_change":"2023-10-16T20:06:37.201860+0000","last_active":"2023-10-16T20:06:38.450546+0000","last_peered":"2023-10-16T20:06:38.450546+0000","last_clean":"2023-10-16T20:06:38.450546+0000","last_became_active":"2023-10-16T20:06:37.201460+0000","last_became_peered":"2023-10-16T20:06:37.201460+0000","last_unstale":"2023-10-16T20:06:38.450546+0000","last_undegraded":"2023-10-16T20:06:38.450546+0000","last_fullsized":"2023-10-16T20:06:38.450546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884636+0000","last_change":"2023-10-16T20:06:31.763472+0000","last_active":"2023-10-16T20:06:36.884636+0000","last_peered":"2023-10-16T20:06:36.884636+0000","last_clean":"2023-10-16T20:06:36.884636+0000","last_became_active":"2023-10-16T20:06:31.763182+0000","last_became_peered":"2023-10-16T20:06:31.763182+0000","last_unstale":"2023-10-16T20:06:36.884636+0000","last_undegraded":"2023-10-16T20:06:36.884636+0000","last_fullsized":"2023-10-16T20:06:36.884636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:36.641784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882893+0000","last_change":"2023-10-16T20:06:32.760456+0000","last_active":"2023-10-16T20:06:36.882893+0000","last_peered":"2023-10-16T20:06:36.882893+0000","last_clean":"2023-10-16T20:06:36.882893+0000","last_became_active":"2023-10-16T20:06:32.760213+0000","last_became_peered":"2023-10-16T20:06:32.760213+0000","last_unstale":"2023-10-16T20:06:36.882893+0000","last_undegraded":"2023-10-16T20:06:36.882893+0000","last_fullsized":"2023-10-16T20:06:36.882893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877007+0000","last_change":"2023-10-16T20:06:37.202225+0000","last_active":"2023-10-16T20:06:37.877007+0000","last_peered":"2023-10-16T20:06:37.877007+0000","last_clean":"2023-10-16T20:06:37.877007+0000","last_became_active":"2023-10-16T20:06:37.201869+0000","last_became_peered":"2023-10-16T20:06:37.201869+0000","last_unstale":"2023-10-16T20:06:37.877007+0000","last_undegraded":"2023-10-16T20:06:37.877007+0000","last_fullsized":"2023-10-16T20:06:37.877007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878662+0000","last_change":"2023-10-16T20:06:31.760996+0000","last_active":"2023-10-16T20:06:36.878662+0000","last_peered":"2023-10-16T20:06:36.878662+0000","last_clean":"2023-10-16T20:06:36.878662+0000","last_became_active":"2023-10-16T20:06:31.760730+0000","last_became_peered":"2023-10-16T20:06:31.760730+0000","last_unstale":"2023-10-16T20:06:36.878662+0000","last_undegraded":"2023-10-16T20:06:36.878662+0000","last_fullsized":"2023-10-16T20:06:36.878662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:41.705266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885662+0000","last_change":"2023-10-16T20:06:32.769034+0000","last_active":"2023-10-16T20:06:36.885662+0000","last_peered":"2023-10-16T20:06:36.885662+0000","last_clean":"2023-10-16T20:06:36.885662+0000","last_became_active":"2023-10-16T20:06:32.768739+0000","last_became_peered":"2023-10-16T20:06:32.768739+0000","last_unstale":"2023-10-16T20:06:36.885662+0000","last_undegraded":"2023-10-16T20:06:36.885662+0000","last_fullsized":"2023-10-16T20:06:36.885662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877177+0000","last_change":"2023-10-16T20:06:36.900254+0000","last_active":"2023-10-16T20:06:37.877177+0000","last_peered":"2023-10-16T20:06:37.877177+0000","last_clean":"2023-10-16T20:06:37.877177+0000","last_became_active":"2023-10-16T20:06:36.899452+0000","last_became_peered":"2023-10-16T20:06:36.899452+0000","last_unstale":"2023-10-16T20:06:37.877177+0000","last_undegraded":"2023-10-16T20:06:37.877177+0000","last_fullsized":"2023-10-16T20:06:37.877177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:44:40.784270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885577+0000","last_change":"2023-10-16T20:06:31.760615+0000","last_active":"2023-10-16T20:06:36.885577+0000","last_peered":"2023-10-16T20:06:36.885577+0000","last_clean":"2023-10-16T20:06:36.885577+0000","last_became_active":"2023-10-16T20:06:31.760334+0000","last_became_peered":"2023-10-16T20:06:31.760334+0000","last_unstale":"2023-10-16T20:06:36.885577+0000","last_undegraded":"2023-10-16T20:06:36.885577+0000","last_fullsized":"2023-10-16T20:06:36.885577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881436+0000","last_change":"2023-10-16T20:06:32.762754+0000","last_active":"2023-10-16T20:06:36.881436+0000","last_peered":"2023-10-16T20:06:36.881436+0000","last_clean":"2023-10-16T20:06:36.881436+0000","last_became_active":"2023-10-16T20:06:32.762465+0000","last_became_peered":"2023-10-16T20:06:32.762465+0000","last_unstale":"2023-10-16T20:06:36.881436+0000","last_undegraded":"2023-10-16T20:06:36.881436+0000","last_fullsized":"2023-10-16T20:06:36.881436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878471+0000","last_change":"2023-10-16T20:06:36.895621+0000","last_active":"2023-10-16T20:06:37.878471+0000","last_peered":"2023-10-16T20:06:37.878471+0000","last_clean":"2023-10-16T20:06:37.878471+0000","last_became_active":"2023-10-16T20:06:36.895207+0000","last_became_peered":"2023-10-16T20:06:36.895207+0000","last_unstale":"2023-10-16T20:06:37.878471+0000","last_undegraded":"2023-10-16T20:06:37.878471+0000","last_fullsized":"2023-10-16T20:06:37.878471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:45.017168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881577+0000","last_change":"2023-10-16T20:06:31.763487+0000","last_active":"2023-10-16T20:06:36.881577+0000","last_peered":"2023-10-16T20:06:36.881577+0000","last_clean":"2023-10-16T20:06:36.881577+0000","last_became_active":"2023-10-16T20:06:31.763173+0000","last_became_peered":"2023-10-16T20:06:31.763173+0000","last_unstale":"2023-10-16T20:06:36.881577+0000","last_undegraded":"2023-10-16T20:06:36.881577+0000","last_fullsized":"2023-10-16T20:06:36.881577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:59.860416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876870+0000","last_change":"2023-10-16T20:06:32.759043+0000","last_active":"2023-10-16T20:06:36.876870+0000","last_peered":"2023-10-16T20:06:36.876870+0000","last_clean":"2023-10-16T20:06:36.876870+0000","last_became_active":"2023-10-16T20:06:32.758748+0000","last_became_peered":"2023-10-16T20:06:32.758748+0000","last_unstale":"2023-10-16T20:06:36.876870+0000","last_undegraded":"2023-10-16T20:06:36.876870+0000","last_fullsized":"2023-10-16T20:06:36.876870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:35.526470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449676+0000","last_change":"2023-10-16T20:06:36.903555+0000","last_active":"2023-10-16T20:06:38.449676+0000","last_peered":"2023-10-16T20:06:38.449676+0000","last_clean":"2023-10-16T20:06:38.449676+0000","last_became_active":"2023-10-16T20:06:36.902883+0000","last_became_peered":"2023-10-16T20:06:36.902883+0000","last_unstale":"2023-10-16T20:06:38.449676+0000","last_undegraded":"2023-10-16T20:06:38.449676+0000","last_fullsized":"2023-10-16T20:06:38.449676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:43.155600+0000","last_change":"2023-10-16T20:06:31.754138+0000","last_active":"2023-10-16T20:06:43.155600+0000","last_peered":"2023-10-16T20:06:43.155600+0000","last_clean":"2023-10-16T20:06:43.155600+0000","last_became_active":"2023-10-16T20:06:31.753853+0000","last_became_peered":"2023-10-16T20:06:31.753853+0000","last_unstale":"2023-10-16T20:06:43.155600+0000","last_undegraded":"2023-10-16T20:06:43.155600+0000","last_fullsized":"2023-10-16T20:06:43.155600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:42.602521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195144+0000","last_change":"2023-10-16T20:06:32.767119+0000","last_active":"2023-10-16T20:06:37.195144+0000","last_peered":"2023-10-16T20:06:37.195144+0000","last_clean":"2023-10-16T20:06:37.195144+0000","last_became_active":"2023-10-16T20:06:32.766833+0000","last_became_peered":"2023-10-16T20:06:32.766833+0000","last_unstale":"2023-10-16T20:06:37.195144+0000","last_undegraded":"2023-10-16T20:06:37.195144+0000","last_fullsized":"2023-10-16T20:06:37.195144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356888+0000","last_change":"2023-10-16T20:06:37.202116+0000","last_active":"2023-10-16T20:06:38.356888+0000","last_peered":"2023-10-16T20:06:38.356888+0000","last_clean":"2023-10-16T20:06:38.356888+0000","last_became_active":"2023-10-16T20:06:37.201629+0000","last_became_peered":"2023-10-16T20:06:37.201629+0000","last_unstale":"2023-10-16T20:06:38.356888+0000","last_undegraded":"2023-10-16T20:06:38.356888+0000","last_fullsized":"2023-10-16T20:06:38.356888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:17.307460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881594+0000","last_change":"2023-10-16T20:06:31.758562+0000","last_active":"2023-10-16T20:06:36.881594+0000","last_peered":"2023-10-16T20:06:36.881594+0000","last_clean":"2023-10-16T20:06:36.881594+0000","last_became_active":"2023-10-16T20:06:31.758280+0000","last_became_peered":"2023-10-16T20:06:31.758280+0000","last_unstale":"2023-10-16T20:06:36.881594+0000","last_undegraded":"2023-10-16T20:06:36.881594+0000","last_fullsized":"2023-10-16T20:06:36.881594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882698+0000","last_change":"2023-10-16T20:06:32.761562+0000","last_active":"2023-10-16T20:06:36.882698+0000","last_peered":"2023-10-16T20:06:36.882698+0000","last_clean":"2023-10-16T20:06:36.882698+0000","last_became_active":"2023-10-16T20:06:32.761271+0000","last_became_peered":"2023-10-16T20:06:32.761271+0000","last_unstale":"2023-10-16T20:06:36.882698+0000","last_undegraded":"2023-10-16T20:06:36.882698+0000","last_fullsized":"2023-10-16T20:06:36.882698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:15.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877847+0000","last_change":"2023-10-16T20:06:37.196752+0000","last_active":"2023-10-16T20:06:37.877847+0000","last_peered":"2023-10-16T20:06:37.877847+0000","last_clean":"2023-10-16T20:06:37.877847+0000","last_became_active":"2023-10-16T20:06:37.196349+0000","last_became_peered":"2023-10-16T20:06:37.196349+0000","last_unstale":"2023-10-16T20:06:37.877847+0000","last_undegraded":"2023-10-16T20:06:37.877847+0000","last_fullsized":"2023-10-16T20:06:37.877847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:44.546135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885198+0000","last_change":"2023-10-16T20:06:31.760198+0000","last_active":"2023-10-16T20:06:36.885198+0000","last_peered":"2023-10-16T20:06:36.885198+0000","last_clean":"2023-10-16T20:06:36.885198+0000","last_became_active":"2023-10-16T20:06:31.759876+0000","last_became_peered":"2023-10-16T20:06:31.759876+0000","last_unstale":"2023-10-16T20:06:36.885198+0000","last_undegraded":"2023-10-16T20:06:36.885198+0000","last_fullsized":"2023-10-16T20:06:36.885198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194983+0000","last_change":"2023-10-16T20:06:32.766888+0000","last_active":"2023-10-16T20:06:37.194983+0000","last_peered":"2023-10-16T20:06:37.194983+0000","last_clean":"2023-10-16T20:06:37.194983+0000","last_became_active":"2023-10-16T20:06:32.766622+0000","last_became_peered":"2023-10-16T20:06:32.766622+0000","last_unstale":"2023-10-16T20:06:37.194983+0000","last_undegraded":"2023-10-16T20:06:37.194983+0000","last_fullsized":"2023-10-16T20:06:37.194983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878288+0000","last_change":"2023-10-16T20:06:37.203326+0000","last_active":"2023-10-16T20:06:37.878288+0000","last_peered":"2023-10-16T20:06:37.878288+0000","last_clean":"2023-10-16T20:06:37.878288+0000","last_became_active":"2023-10-16T20:06:37.202984+0000","last_became_peered":"2023-10-16T20:06:37.202984+0000","last_unstale":"2023-10-16T20:06:37.878288+0000","last_undegraded":"2023-10-16T20:06:37.878288+0000","last_fullsized":"2023-10-16T20:06:37.878288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:14.463170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876269+0000","last_change":"2023-10-16T20:06:31.753359+0000","last_active":"2023-10-16T20:06:36.876269+0000","last_peered":"2023-10-16T20:06:36.876269+0000","last_clean":"2023-10-16T20:06:36.876269+0000","last_became_active":"2023-10-16T20:06:31.753077+0000","last_became_peered":"2023-10-16T20:06:31.753077+0000","last_unstale":"2023-10-16T20:06:36.876269+0000","last_undegraded":"2023-10-16T20:06:36.876269+0000","last_fullsized":"2023-10-16T20:06:36.876269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:33:34.708942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876082+0000","last_change":"2023-10-16T20:06:32.751058+0000","last_active":"2023-10-16T20:06:36.876082+0000","last_peered":"2023-10-16T20:06:36.876082+0000","last_clean":"2023-10-16T20:06:36.876082+0000","last_became_active":"2023-10-16T20:06:32.750777+0000","last_became_peered":"2023-10-16T20:06:32.750777+0000","last_unstale":"2023-10-16T20:06:36.876082+0000","last_undegraded":"2023-10-16T20:06:36.876082+0000","last_fullsized":"2023-10-16T20:06:36.876082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:58.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450353+0000","last_change":"2023-10-16T20:06:36.902623+0000","last_active":"2023-10-16T20:06:38.450353+0000","last_peered":"2023-10-16T20:06:38.450353+0000","last_clean":"2023-10-16T20:06:38.450353+0000","last_became_active":"2023-10-16T20:06:36.902228+0000","last_became_peered":"2023-10-16T20:06:36.902228+0000","last_unstale":"2023-10-16T20:06:38.450353+0000","last_undegraded":"2023-10-16T20:06:38.450353+0000","last_fullsized":"2023-10-16T20:06:38.450353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876268+0000","last_change":"2023-10-16T20:06:31.755895+0000","last_active":"2023-10-16T20:06:36.876268+0000","last_peered":"2023-10-16T20:06:36.876268+0000","last_clean":"2023-10-16T20:06:36.876268+0000","last_became_active":"2023-10-16T20:06:31.753514+0000","last_became_peered":"2023-10-16T20:06:31.753514+0000","last_unstale":"2023-10-16T20:06:36.876268+0000","last_undegraded":"2023-10-16T20:06:36.876268+0000","last_fullsized":"2023-10-16T20:06:36.876268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:56.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194950+0000","last_change":"2023-10-16T20:06:32.761296+0000","last_active":"2023-10-16T20:06:37.194950+0000","last_peered":"2023-10-16T20:06:37.194950+0000","last_clean":"2023-10-16T20:06:37.194950+0000","last_became_active":"2023-10-16T20:06:32.759859+0000","last_became_peered":"2023-10-16T20:06:32.759859+0000","last_unstale":"2023-10-16T20:06:37.194950+0000","last_undegraded":"2023-10-16T20:06:37.194950+0000","last_fullsized":"2023-10-16T20:06:37.194950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:51:31.604677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877930+0000","last_change":"2023-10-16T20:06:36.895213+0000","last_active":"2023-10-16T20:06:37.877930+0000","last_peered":"2023-10-16T20:06:37.877930+0000","last_clean":"2023-10-16T20:06:37.877930+0000","last_became_active":"2023-10-16T20:06:36.894773+0000","last_became_peered":"2023-10-16T20:06:36.894773+0000","last_unstale":"2023-10-16T20:06:37.877930+0000","last_undegraded":"2023-10-16T20:06:37.877930+0000","last_fullsized":"2023-10-16T20:06:37.877930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:27.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876800+0000","last_change":"2023-10-16T20:06:31.757448+0000","last_active":"2023-10-16T20:06:36.876800+0000","last_peered":"2023-10-16T20:06:36.876800+0000","last_clean":"2023-10-16T20:06:36.876800+0000","last_became_active":"2023-10-16T20:06:31.757148+0000","last_became_peered":"2023-10-16T20:06:31.757148+0000","last_unstale":"2023-10-16T20:06:36.876800+0000","last_undegraded":"2023-10-16T20:06:36.876800+0000","last_fullsized":"2023-10-16T20:06:36.876800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:58.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195129+0000","last_change":"2023-10-16T20:06:32.760468+0000","last_active":"2023-10-16T20:06:37.195129+0000","last_peered":"2023-10-16T20:06:37.195129+0000","last_clean":"2023-10-16T20:06:37.195129+0000","last_became_active":"2023-10-16T20:06:32.760170+0000","last_became_peered":"2023-10-16T20:06:32.760170+0000","last_unstale":"2023-10-16T20:06:37.195129+0000","last_undegraded":"2023-10-16T20:06:37.195129+0000","last_fullsized":"2023-10-16T20:06:37.195129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:21:54.422703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449538+0000","last_change":"2023-10-16T20:06:36.903294+0000","last_active":"2023-10-16T20:06:38.449538+0000","last_peered":"2023-10-16T20:06:38.449538+0000","last_clean":"2023-10-16T20:06:38.449538+0000","last_became_active":"2023-10-16T20:06:36.902123+0000","last_became_peered":"2023-10-16T20:06:36.902123+0000","last_unstale":"2023-10-16T20:06:38.449538+0000","last_undegraded":"2023-10-16T20:06:38.449538+0000","last_fullsized":"2023-10-16T20:06:38.449538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885520+0000","last_change":"2023-10-16T20:06:31.754709+0000","last_active":"2023-10-16T20:06:36.885520+0000","last_peered":"2023-10-16T20:06:36.885520+0000","last_clean":"2023-10-16T20:06:36.885520+0000","last_became_active":"2023-10-16T20:06:31.754401+0000","last_became_peered":"2023-10-16T20:06:31.754401+0000","last_unstale":"2023-10-16T20:06:36.885520+0000","last_undegraded":"2023-10-16T20:06:36.885520+0000","last_fullsized":"2023-10-16T20:06:36.885520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.452414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885290+0000","last_change":"2023-10-16T20:06:32.761804+0000","last_active":"2023-10-16T20:06:36.885290+0000","last_peered":"2023-10-16T20:06:36.885290+0000","last_clean":"2023-10-16T20:06:36.885290+0000","last_became_active":"2023-10-16T20:06:32.760958+0000","last_became_peered":"2023-10-16T20:06:32.760958+0000","last_unstale":"2023-10-16T20:06:36.885290+0000","last_undegraded":"2023-10-16T20:06:36.885290+0000","last_fullsized":"2023-10-16T20:06:36.885290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449849+0000","last_change":"2023-10-16T20:06:36.903445+0000","last_active":"2023-10-16T20:06:38.449849+0000","last_peered":"2023-10-16T20:06:38.449849+0000","last_clean":"2023-10-16T20:06:38.449849+0000","last_became_active":"2023-10-16T20:06:36.903063+0000","last_became_peered":"2023-10-16T20:06:36.903063+0000","last_unstale":"2023-10-16T20:06:38.449849+0000","last_undegraded":"2023-10-16T20:06:38.449849+0000","last_fullsized":"2023-10-16T20:06:38.449849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884659+0000","last_change":"2023-10-16T20:06:31.763443+0000","last_active":"2023-10-16T20:06:36.884659+0000","last_peered":"2023-10-16T20:06:36.884659+0000","last_clean":"2023-10-16T20:06:36.884659+0000","last_became_active":"2023-10-16T20:06:31.763163+0000","last_became_peered":"2023-10-16T20:06:31.763163+0000","last_unstale":"2023-10-16T20:06:36.884659+0000","last_undegraded":"2023-10-16T20:06:36.884659+0000","last_fullsized":"2023-10-16T20:06:36.884659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:57.275970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878335+0000","last_change":"2023-10-16T20:06:32.752504+0000","last_active":"2023-10-16T20:06:36.878335+0000","last_peered":"2023-10-16T20:06:36.878335+0000","last_clean":"2023-10-16T20:06:36.878335+0000","last_became_active":"2023-10-16T20:06:32.752221+0000","last_became_peered":"2023-10-16T20:06:32.752221+0000","last_unstale":"2023-10-16T20:06:36.878335+0000","last_undegraded":"2023-10-16T20:06:36.878335+0000","last_fullsized":"2023-10-16T20:06:36.878335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:06.823167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450660+0000","last_change":"2023-10-16T20:06:36.904832+0000","last_active":"2023-10-16T20:06:38.450660+0000","last_peered":"2023-10-16T20:06:38.450660+0000","last_clean":"2023-10-16T20:06:38.450660+0000","last_became_active":"2023-10-16T20:06:36.902946+0000","last_became_peered":"2023-10-16T20:06:36.902946+0000","last_unstale":"2023-10-16T20:06:38.450660+0000","last_undegraded":"2023-10-16T20:06:38.450660+0000","last_fullsized":"2023-10-16T20:06:38.450660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886854+0000","last_change":"2023-10-16T20:06:32.754410+0000","last_active":"2023-10-16T20:06:36.886854+0000","last_peered":"2023-10-16T20:06:36.886854+0000","last_clean":"2023-10-16T20:06:36.886854+0000","last_became_active":"2023-10-16T20:06:32.752138+0000","last_became_peered":"2023-10-16T20:06:32.752138+0000","last_unstale":"2023-10-16T20:06:36.886854+0000","last_undegraded":"2023-10-16T20:06:36.886854+0000","last_fullsized":"2023-10-16T20:06:36.886854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876274+0000","last_change":"2023-10-16T20:06:31.754288+0000","last_active":"2023-10-16T20:06:36.876274+0000","last_peered":"2023-10-16T20:06:36.876274+0000","last_clean":"2023-10-16T20:06:36.876274+0000","last_became_active":"2023-10-16T20:06:31.753897+0000","last_became_peered":"2023-10-16T20:06:31.753897+0000","last_unstale":"2023-10-16T20:06:36.876274+0000","last_undegraded":"2023-10-16T20:06:36.876274+0000","last_fullsized":"2023-10-16T20:06:36.876274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:50.340924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877991+0000","last_change":"2023-10-16T20:06:37.196921+0000","last_active":"2023-10-16T20:06:37.877991+0000","last_peered":"2023-10-16T20:06:37.877991+0000","last_clean":"2023-10-16T20:06:37.877991+0000","last_became_active":"2023-10-16T20:06:37.196485+0000","last_became_peered":"2023-10-16T20:06:37.196485+0000","last_unstale":"2023-10-16T20:06:37.877991+0000","last_undegraded":"2023-10-16T20:06:37.877991+0000","last_fullsized":"2023-10-16T20:06:37.877991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893852+0000","last_change":"2023-10-16T20:06:32.763195+0000","last_active":"2023-10-16T20:06:36.893852+0000","last_peered":"2023-10-16T20:06:36.893852+0000","last_clean":"2023-10-16T20:06:36.893852+0000","last_became_active":"2023-10-16T20:06:32.762891+0000","last_became_peered":"2023-10-16T20:06:32.762891+0000","last_unstale":"2023-10-16T20:06:36.893852+0000","last_undegraded":"2023-10-16T20:06:36.893852+0000","last_fullsized":"2023-10-16T20:06:36.893852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885155+0000","last_change":"2023-10-16T20:06:31.759832+0000","last_active":"2023-10-16T20:06:36.885155+0000","last_peered":"2023-10-16T20:06:36.885155+0000","last_clean":"2023-10-16T20:06:36.885155+0000","last_became_active":"2023-10-16T20:06:31.759343+0000","last_became_peered":"2023-10-16T20:06:31.759343+0000","last_unstale":"2023-10-16T20:06:36.885155+0000","last_undegraded":"2023-10-16T20:06:36.885155+0000","last_fullsized":"2023-10-16T20:06:36.885155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:28.978568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194365+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:06:37.194365+0000","last_peered":"2023-10-16T20:06:37.194365+0000","last_clean":"2023-10-16T20:06:37.194365+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:06:37.194365+0000","last_undegraded":"2023-10-16T20:06:37.194365+0000","last_fullsized":"2023-10-16T20:06:37.194365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450435+0000","last_change":"2023-10-16T20:06:37.201901+0000","last_active":"2023-10-16T20:06:38.450435+0000","last_peered":"2023-10-16T20:06:38.450435+0000","last_clean":"2023-10-16T20:06:38.450435+0000","last_became_active":"2023-10-16T20:06:37.201501+0000","last_became_peered":"2023-10-16T20:06:37.201501+0000","last_unstale":"2023-10-16T20:06:38.450435+0000","last_undegraded":"2023-10-16T20:06:38.450435+0000","last_fullsized":"2023-10-16T20:06:38.450435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.880899+0000","last_change":"2023-10-16T20:06:32.757110+0000","last_active":"2023-10-16T20:06:36.880899+0000","last_peered":"2023-10-16T20:06:36.880899+0000","last_clean":"2023-10-16T20:06:36.880899+0000","last_became_active":"2023-10-16T20:06:32.756814+0000","last_became_peered":"2023-10-16T20:06:32.756814+0000","last_unstale":"2023-10-16T20:06:36.880899+0000","last_undegraded":"2023-10-16T20:06:36.880899+0000","last_fullsized":"2023-10-16T20:06:36.880899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.457314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194766+0000","last_change":"2023-10-16T20:06:31.757582+0000","last_active":"2023-10-16T20:06:37.194766+0000","last_peered":"2023-10-16T20:06:37.194766+0000","last_clean":"2023-10-16T20:06:37.194766+0000","last_became_active":"2023-10-16T20:06:31.757284+0000","last_became_peered":"2023-10-16T20:06:31.757284+0000","last_unstale":"2023-10-16T20:06:37.194766+0000","last_undegraded":"2023-10-16T20:06:37.194766+0000","last_fullsized":"2023-10-16T20:06:37.194766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:34.521571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449383+0000","last_change":"2023-10-16T20:06:37.196738+0000","last_active":"2023-10-16T20:06:38.449383+0000","last_peered":"2023-10-16T20:06:38.449383+0000","last_clean":"2023-10-16T20:06:38.449383+0000","last_became_active":"2023-10-16T20:06:37.196358+0000","last_became_peered":"2023-10-16T20:06:37.196358+0000","last_unstale":"2023-10-16T20:06:38.449383+0000","last_undegraded":"2023-10-16T20:06:38.449383+0000","last_fullsized":"2023-10-16T20:06:38.449383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195027+0000","last_change":"2023-10-16T20:06:31.763235+0000","last_active":"2023-10-16T20:06:37.195027+0000","last_peered":"2023-10-16T20:06:37.195027+0000","last_clean":"2023-10-16T20:06:37.195027+0000","last_became_active":"2023-10-16T20:06:31.762917+0000","last_became_peered":"2023-10-16T20:06:31.762917+0000","last_unstale":"2023-10-16T20:06:37.195027+0000","last_undegraded":"2023-10-16T20:06:37.195027+0000","last_fullsized":"2023-10-16T20:06:37.195027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885559+0000","last_change":"2023-10-16T20:06:32.753815+0000","last_active":"2023-10-16T20:06:36.885559+0000","last_peered":"2023-10-16T20:06:36.885559+0000","last_clean":"2023-10-16T20:06:36.885559+0000","last_became_active":"2023-10-16T20:06:32.753504+0000","last_became_peered":"2023-10-16T20:06:32.753504+0000","last_unstale":"2023-10-16T20:06:36.885559+0000","last_undegraded":"2023-10-16T20:06:36.885559+0000","last_fullsized":"2023-10-16T20:06:36.885559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.876963+0000","last_change":"2023-10-16T20:06:37.202096+0000","last_active":"2023-10-16T20:06:37.876963+0000","last_peered":"2023-10-16T20:06:37.876963+0000","last_clean":"2023-10-16T20:06:37.876963+0000","last_became_active":"2023-10-16T20:06:37.201491+0000","last_became_peered":"2023-10-16T20:06:37.201491+0000","last_unstale":"2023-10-16T20:06:37.876963+0000","last_undegraded":"2023-10-16T20:06:37.876963+0000","last_fullsized":"2023-10-16T20:06:37.876963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886132+0000","last_change":"2023-10-16T20:06:31.757976+0000","last_active":"2023-10-16T20:06:36.886132+0000","last_peered":"2023-10-16T20:06:36.886132+0000","last_clean":"2023-10-16T20:06:36.886132+0000","last_became_active":"2023-10-16T20:06:31.757076+0000","last_became_peered":"2023-10-16T20:06:31.757076+0000","last_unstale":"2023-10-16T20:06:36.886132+0000","last_undegraded":"2023-10-16T20:06:36.886132+0000","last_fullsized":"2023-10-16T20:06:36.886132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:14.095040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893777+0000","last_change":"2023-10-16T20:06:32.762472+0000","last_active":"2023-10-16T20:06:36.893777+0000","last_peered":"2023-10-16T20:06:36.893777+0000","last_clean":"2023-10-16T20:06:36.893777+0000","last_became_active":"2023-10-16T20:06:32.762178+0000","last_became_peered":"2023-10-16T20:06:32.762178+0000","last_unstale":"2023-10-16T20:06:36.893777+0000","last_undegraded":"2023-10-16T20:06:36.893777+0000","last_fullsized":"2023-10-16T20:06:36.893777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878094+0000","last_change":"2023-10-16T20:06:37.197304+0000","last_active":"2023-10-16T20:06:37.878094+0000","last_peered":"2023-10-16T20:06:37.878094+0000","last_clean":"2023-10-16T20:06:37.878094+0000","last_became_active":"2023-10-16T20:06:37.196929+0000","last_became_peered":"2023-10-16T20:06:37.196929+0000","last_unstale":"2023-10-16T20:06:37.878094+0000","last_undegraded":"2023-10-16T20:06:37.878094+0000","last_fullsized":"2023-10-16T20:06:37.878094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:50.138290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878557+0000","last_change":"2023-10-16T20:06:31.757280+0000","last_active":"2023-10-16T20:06:36.878557+0000","last_peered":"2023-10-16T20:06:36.878557+0000","last_clean":"2023-10-16T20:06:36.878557+0000","last_became_active":"2023-10-16T20:06:31.756978+0000","last_became_peered":"2023-10-16T20:06:31.756978+0000","last_unstale":"2023-10-16T20:06:36.878557+0000","last_undegraded":"2023-10-16T20:06:36.878557+0000","last_fullsized":"2023-10-16T20:06:36.878557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:45.721286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886554+0000","last_change":"2023-10-16T20:06:32.758662+0000","last_active":"2023-10-16T20:06:36.886554+0000","last_peered":"2023-10-16T20:06:36.886554+0000","last_clean":"2023-10-16T20:06:36.886554+0000","last_became_active":"2023-10-16T20:06:32.758318+0000","last_became_peered":"2023-10-16T20:06:32.758318+0000","last_unstale":"2023-10-16T20:06:36.886554+0000","last_undegraded":"2023-10-16T20:06:36.886554+0000","last_fullsized":"2023-10-16T20:06:36.886554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878944+0000","last_change":"2023-10-16T20:06:36.898893+0000","last_active":"2023-10-16T20:06:37.878944+0000","last_peered":"2023-10-16T20:06:37.878944+0000","last_clean":"2023-10-16T20:06:37.878944+0000","last_became_active":"2023-10-16T20:06:36.898502+0000","last_became_peered":"2023-10-16T20:06:36.898502+0000","last_unstale":"2023-10-16T20:06:37.878944+0000","last_undegraded":"2023-10-16T20:06:37.878944+0000","last_fullsized":"2023-10-16T20:06:37.878944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194284+0000","last_change":"2023-10-16T20:06:31.763222+0000","last_active":"2023-10-16T20:06:37.194284+0000","last_peered":"2023-10-16T20:06:37.194284+0000","last_clean":"2023-10-16T20:06:37.194284+0000","last_became_active":"2023-10-16T20:06:31.762927+0000","last_became_peered":"2023-10-16T20:06:31.762927+0000","last_unstale":"2023-10-16T20:06:37.194284+0000","last_undegraded":"2023-10-16T20:06:37.194284+0000","last_fullsized":"2023-10-16T20:06:37.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:05.818268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877358+0000","last_change":"2023-10-16T20:06:32.751479+0000","last_active":"2023-10-16T20:06:36.877358+0000","last_peered":"2023-10-16T20:06:36.877358+0000","last_clean":"2023-10-16T20:06:36.877358+0000","last_became_active":"2023-10-16T20:06:32.751190+0000","last_became_peered":"2023-10-16T20:06:32.751190+0000","last_unstale":"2023-10-16T20:06:36.877358+0000","last_undegraded":"2023-10-16T20:06:36.877358+0000","last_fullsized":"2023-10-16T20:06:36.877358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:48:45.349066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450801+0000","last_change":"2023-10-16T20:06:37.197326+0000","last_active":"2023-10-16T20:06:38.450801+0000","last_peered":"2023-10-16T20:06:38.450801+0000","last_clean":"2023-10-16T20:06:38.450801+0000","last_became_active":"2023-10-16T20:06:37.196386+0000","last_became_peered":"2023-10-16T20:06:37.196386+0000","last_unstale":"2023-10-16T20:06:38.450801+0000","last_undegraded":"2023-10-16T20:06:38.450801+0000","last_fullsized":"2023-10-16T20:06:38.450801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882771+0000","last_change":"2023-10-16T20:06:31.758660+0000","last_active":"2023-10-16T20:06:36.882771+0000","last_peered":"2023-10-16T20:06:36.882771+0000","last_clean":"2023-10-16T20:06:36.882771+0000","last_became_active":"2023-10-16T20:06:31.758394+0000","last_became_peered":"2023-10-16T20:06:31.758394+0000","last_unstale":"2023-10-16T20:06:36.882771+0000","last_undegraded":"2023-10-16T20:06:36.882771+0000","last_fullsized":"2023-10-16T20:06:36.882771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:09.405305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894178+0000","last_change":"2023-10-16T20:06:32.755401+0000","last_active":"2023-10-16T20:06:36.894178+0000","last_peered":"2023-10-16T20:06:36.894178+0000","last_clean":"2023-10-16T20:06:36.894178+0000","last_became_active":"2023-10-16T20:06:32.755107+0000","last_became_peered":"2023-10-16T20:06:32.755107+0000","last_unstale":"2023-10-16T20:06:36.894178+0000","last_undegraded":"2023-10-16T20:06:36.894178+0000","last_fullsized":"2023-10-16T20:06:36.894178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878938+0000","last_change":"2023-10-16T20:06:36.896689+0000","last_active":"2023-10-16T20:06:37.878938+0000","last_peered":"2023-10-16T20:06:37.878938+0000","last_clean":"2023-10-16T20:06:37.878938+0000","last_became_active":"2023-10-16T20:06:36.896287+0000","last_became_peered":"2023-10-16T20:06:36.896287+0000","last_unstale":"2023-10-16T20:06:37.878938+0000","last_undegraded":"2023-10-16T20:06:37.878938+0000","last_fullsized":"2023-10-16T20:06:37.878938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:13.728727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.888301+0000","last_change":"2023-10-16T20:06:31.757230+0000","last_active":"2023-10-16T20:06:36.888301+0000","last_peered":"2023-10-16T20:06:36.888301+0000","last_clean":"2023-10-16T20:06:36.888301+0000","last_became_active":"2023-10-16T20:06:31.756944+0000","last_became_peered":"2023-10-16T20:06:31.756944+0000","last_unstale":"2023-10-16T20:06:36.888301+0000","last_undegraded":"2023-10-16T20:06:36.888301+0000","last_fullsized":"2023-10-16T20:06:36.888301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:18.395813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893812+0000","last_change":"2023-10-16T20:06:32.764333+0000","last_active":"2023-10-16T20:06:36.893812+0000","last_peered":"2023-10-16T20:06:36.893812+0000","last_clean":"2023-10-16T20:06:36.893812+0000","last_became_active":"2023-10-16T20:06:32.764136+0000","last_became_peered":"2023-10-16T20:06:32.764136+0000","last_unstale":"2023-10-16T20:06:36.893812+0000","last_undegraded":"2023-10-16T20:06:36.893812+0000","last_fullsized":"2023-10-16T20:06:36.893812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.879154+0000","last_change":"2023-10-16T20:06:36.895534+0000","last_active":"2023-10-16T20:06:37.879154+0000","last_peered":"2023-10-16T20:06:37.879154+0000","last_clean":"2023-10-16T20:06:37.879154+0000","last_became_active":"2023-10-16T20:06:36.895164+0000","last_became_peered":"2023-10-16T20:06:36.895164+0000","last_unstale":"2023-10-16T20:06:37.879154+0000","last_undegraded":"2023-10-16T20:06:37.879154+0000","last_fullsized":"2023-10-16T20:06:37.879154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194973+0000","last_change":"2023-10-16T20:06:31.760505+0000","last_active":"2023-10-16T20:06:37.194973+0000","last_peered":"2023-10-16T20:06:37.194973+0000","last_clean":"2023-10-16T20:06:37.194973+0000","last_became_active":"2023-10-16T20:06:31.760190+0000","last_became_peered":"2023-10-16T20:06:31.760190+0000","last_unstale":"2023-10-16T20:06:37.194973+0000","last_undegraded":"2023-10-16T20:06:37.194973+0000","last_fullsized":"2023-10-16T20:06:37.194973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876944+0000","last_change":"2023-10-16T20:06:32.757975+0000","last_active":"2023-10-16T20:06:36.876944+0000","last_peered":"2023-10-16T20:06:36.876944+0000","last_clean":"2023-10-16T20:06:36.876944+0000","last_became_active":"2023-10-16T20:06:32.757179+0000","last_became_peered":"2023-10-16T20:06:32.757179+0000","last_unstale":"2023-10-16T20:06:36.876944+0000","last_undegraded":"2023-10-16T20:06:36.876944+0000","last_fullsized":"2023-10-16T20:06:36.876944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:29.983467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878473+0000","last_change":"2023-10-16T20:06:37.197542+0000","last_active":"2023-10-16T20:06:37.878473+0000","last_peered":"2023-10-16T20:06:37.878473+0000","last_clean":"2023-10-16T20:06:37.878473+0000","last_became_active":"2023-10-16T20:06:37.196312+0000","last_became_peered":"2023-10-16T20:06:37.196312+0000","last_unstale":"2023-10-16T20:06:37.878473+0000","last_undegraded":"2023-10-16T20:06:37.878473+0000","last_fullsized":"2023-10-16T20:06:37.878473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:40.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876859+0000","last_change":"2023-10-16T20:06:31.763508+0000","last_active":"2023-10-16T20:06:36.876859+0000","last_peered":"2023-10-16T20:06:36.876859+0000","last_clean":"2023-10-16T20:06:36.876859+0000","last_became_active":"2023-10-16T20:06:31.763228+0000","last_became_peered":"2023-10-16T20:06:31.763228+0000","last_unstale":"2023-10-16T20:06:36.876859+0000","last_undegraded":"2023-10-16T20:06:36.876859+0000","last_fullsized":"2023-10-16T20:06:36.876859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:33.157086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195141+0000","last_change":"2023-10-16T20:06:32.767619+0000","last_active":"2023-10-16T20:06:37.195141+0000","last_peered":"2023-10-16T20:06:37.195141+0000","last_clean":"2023-10-16T20:06:37.195141+0000","last_became_active":"2023-10-16T20:06:32.767368+0000","last_became_peered":"2023-10-16T20:06:32.767368+0000","last_unstale":"2023-10-16T20:06:37.195141+0000","last_undegraded":"2023-10-16T20:06:37.195141+0000","last_fullsized":"2023-10-16T20:06:37.195141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449240+0000","last_change":"2023-10-16T20:06:36.896747+0000","last_active":"2023-10-16T20:06:38.449240+0000","last_peered":"2023-10-16T20:06:38.449240+0000","last_clean":"2023-10-16T20:06:38.449240+0000","last_became_active":"2023-10-16T20:06:36.896380+0000","last_became_peered":"2023-10-16T20:06:36.896380+0000","last_unstale":"2023-10-16T20:06:38.449240+0000","last_undegraded":"2023-10-16T20:06:38.449240+0000","last_fullsized":"2023-10-16T20:06:38.449240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:53:20.477418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881480+0000","last_change":"2023-10-16T20:06:31.757781+0000","last_active":"2023-10-16T20:06:36.881480+0000","last_peered":"2023-10-16T20:06:36.881480+0000","last_clean":"2023-10-16T20:06:36.881480+0000","last_became_active":"2023-10-16T20:06:31.757507+0000","last_became_peered":"2023-10-16T20:06:31.757507+0000","last_unstale":"2023-10-16T20:06:36.881480+0000","last_undegraded":"2023-10-16T20:06:36.881480+0000","last_fullsized":"2023-10-16T20:06:36.881480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.762052+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761502+0000","last_became_peered":"2023-10-16T20:06:32.761502+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356361+0000","last_change":"2023-10-16T20:06:37.196931+0000","last_active":"2023-10-16T20:06:38.356361+0000","last_peered":"2023-10-16T20:06:38.356361+0000","last_clean":"2023-10-16T20:06:38.356361+0000","last_became_active":"2023-10-16T20:06:37.196429+0000","last_became_peered":"2023-10-16T20:06:37.196429+0000","last_unstale":"2023-10-16T20:06:38.356361+0000","last_undegraded":"2023-10-16T20:06:38.356361+0000","last_fullsized":"2023-10-16T20:06:38.356361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:39:01.567948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876429+0000","last_change":"2023-10-16T20:06:31.754869+0000","last_active":"2023-10-16T20:06:36.876429+0000","last_peered":"2023-10-16T20:06:36.876429+0000","last_clean":"2023-10-16T20:06:36.876429+0000","last_became_active":"2023-10-16T20:06:31.754563+0000","last_became_peered":"2023-10-16T20:06:31.754563+0000","last_unstale":"2023-10-16T20:06:36.876429+0000","last_undegraded":"2023-10-16T20:06:36.876429+0000","last_fullsized":"2023-10-16T20:06:36.876429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:05.294644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195284+0000","last_change":"2023-10-16T20:06:32.761436+0000","last_active":"2023-10-16T20:06:37.195284+0000","last_peered":"2023-10-16T20:06:37.195284+0000","last_clean":"2023-10-16T20:06:37.195284+0000","last_became_active":"2023-10-16T20:06:32.761077+0000","last_became_peered":"2023-10-16T20:06:32.761077+0000","last_unstale":"2023-10-16T20:06:37.195284+0000","last_undegraded":"2023-10-16T20:06:37.195284+0000","last_fullsized":"2023-10-16T20:06:37.195284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876172+0000","last_change":"2023-10-16T20:06:32.752025+0000","last_active":"2023-10-16T20:06:36.876172+0000","last_peered":"2023-10-16T20:06:36.876172+0000","last_clean":"2023-10-16T20:06:36.876172+0000","last_became_active":"2023-10-16T20:06:32.751719+0000","last_became_peered":"2023-10-16T20:06:32.751719+0000","last_unstale":"2023-10-16T20:06:36.876172+0000","last_undegraded":"2023-10-16T20:06:36.876172+0000","last_fullsized":"2023-10-16T20:06:36.876172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:37.646684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876358+0000","last_change":"2023-10-16T20:06:32.761262+0000","last_active":"2023-10-16T20:06:36.876358+0000","last_peered":"2023-10-16T20:06:36.876358+0000","last_clean":"2023-10-16T20:06:36.876358+0000","last_became_active":"2023-10-16T20:06:32.760953+0000","last_became_peered":"2023-10-16T20:06:32.760953+0000","last_unstale":"2023-10-16T20:06:36.876358+0000","last_undegraded":"2023-10-16T20:06:36.876358+0000","last_fullsized":"2023-10-16T20:06:36.876358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:06.488740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884781+0000","last_change":"2023-10-16T20:06:32.761797+0000","last_active":"2023-10-16T20:06:36.884781+0000","last_peered":"2023-10-16T20:06:36.884781+0000","last_clean":"2023-10-16T20:06:36.884781+0000","last_became_active":"2023-10-16T20:06:32.761070+0000","last_became_peered":"2023-10-16T20:06:32.761070+0000","last_unstale":"2023-10-16T20:06:36.884781+0000","last_undegraded":"2023-10-16T20:06:36.884781+0000","last_fullsized":"2023-10-16T20:06:36.884781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881499+0000","last_change":"2023-10-16T20:06:32.757941+0000","last_active":"2023-10-16T20:06:36.881499+0000","last_peered":"2023-10-16T20:06:36.881499+0000","last_clean":"2023-10-16T20:06:36.881499+0000","last_became_active":"2023-10-16T20:06:32.757491+0000","last_became_peered":"2023-10-16T20:06:32.757491+0000","last_unstale":"2023-10-16T20:06:36.881499+0000","last_undegraded":"2023-10-16T20:06:36.881499+0000","last_fullsized":"2023-10-16T20:06:36.881499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893744+0000","last_change":"2023-10-16T20:06:32.757680+0000","last_active":"2023-10-16T20:06:36.893744+0000","last_peered":"2023-10-16T20:06:36.893744+0000","last_clean":"2023-10-16T20:06:36.893744+0000","last_became_active":"2023-10-16T20:06:32.756906+0000","last_became_peered":"2023-10-16T20:06:32.756906+0000","last_unstale":"2023-10-16T20:06:36.893744+0000","last_undegraded":"2023-10-16T20:06:36.893744+0000","last_fullsized":"2023-10-16T20:06:36.893744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881387+0000","last_change":"2023-10-16T20:06:32.756667+0000","last_active":"2023-10-16T20:06:36.881387+0000","last_peered":"2023-10-16T20:06:36.881387+0000","last_clean":"2023-10-16T20:06:36.881387+0000","last_became_active":"2023-10-16T20:06:32.756338+0000","last_became_peered":"2023-10-16T20:06:32.756338+0000","last_unstale":"2023-10-16T20:06:36.881387+0000","last_undegraded":"2023-10-16T20:06:36.881387+0000","last_fullsized":"2023-10-16T20:06:36.881387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878209+0000","last_change":"2023-10-16T20:06:32.761903+0000","last_active":"2023-10-16T20:06:36.878209+0000","last_peered":"2023-10-16T20:06:36.878209+0000","last_clean":"2023-10-16T20:06:36.878209+0000","last_became_active":"2023-10-16T20:06:32.761404+0000","last_became_peered":"2023-10-16T20:06:32.761404+0000","last_unstale":"2023-10-16T20:06:36.878209+0000","last_undegraded":"2023-10-16T20:06:36.878209+0000","last_fullsized":"2023-10-16T20:06:36.878209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893877+0000","last_change":"2023-10-16T20:06:32.759025+0000","last_active":"2023-10-16T20:06:36.893877+0000","last_peered":"2023-10-16T20:06:36.893877+0000","last_clean":"2023-10-16T20:06:36.893877+0000","last_became_active":"2023-10-16T20:06:32.757378+0000","last_became_peered":"2023-10-16T20:06:32.757378+0000","last_unstale":"2023-10-16T20:06:36.893877+0000","last_undegraded":"2023-10-16T20:06:36.893877+0000","last_fullsized":"2023-10-16T20:06:36.893877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884696+0000","last_change":"2023-10-16T20:06:32.765641+0000","last_active":"2023-10-16T20:06:36.884696+0000","last_peered":"2023-10-16T20:06:36.884696+0000","last_clean":"2023-10-16T20:06:36.884696+0000","last_became_active":"2023-10-16T20:06:32.765108+0000","last_became_peered":"2023-10-16T20:06:32.765108+0000","last_unstale":"2023-10-16T20:06:36.884696+0000","last_undegraded":"2023-10-16T20:06:36.884696+0000","last_fullsized":"2023-10-16T20:06:36.884696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:46.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893441+0000","last_change":"2023-10-16T20:06:32.760384+0000","last_active":"2023-10-16T20:06:36.893441+0000","last_peered":"2023-10-16T20:06:36.893441+0000","last_clean":"2023-10-16T20:06:36.893441+0000","last_became_active":"2023-10-16T20:06:32.760069+0000","last_became_peered":"2023-10-16T20:06:32.760069+0000","last_unstale":"2023-10-16T20:06:36.893441+0000","last_undegraded":"2023-10-16T20:06:36.893441+0000","last_fullsized":"2023-10-16T20:06:36.893441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884891+0000","last_change":"2023-10-16T20:06:32.769882+0000","last_active":"2023-10-16T20:06:36.884891+0000","last_peered":"2023-10-16T20:06:36.884891+0000","last_clean":"2023-10-16T20:06:36.884891+0000","last_became_active":"2023-10-16T20:06:32.769593+0000","last_became_peered":"2023-10-16T20:06:32.769593+0000","last_unstale":"2023-10-16T20:06:36.884891+0000","last_undegraded":"2023-10-16T20:06:36.884891+0000","last_fullsized":"2023-10-16T20:06:36.884891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881557+0000","last_change":"2023-10-16T20:06:32.762249+0000","last_active":"2023-10-16T20:06:36.881557+0000","last_peered":"2023-10-16T20:06:36.881557+0000","last_clean":"2023-10-16T20:06:36.881557+0000","last_became_active":"2023-10-16T20:06:32.761895+0000","last_became_peered":"2023-10-16T20:06:32.761895+0000","last_unstale":"2023-10-16T20:06:36.881557+0000","last_undegraded":"2023-10-16T20:06:36.881557+0000","last_fullsized":"2023-10-16T20:06:36.881557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877279+0000","last_change":"2023-10-16T20:06:32.755725+0000","last_active":"2023-10-16T20:06:36.877279+0000","last_peered":"2023-10-16T20:06:36.877279+0000","last_clean":"2023-10-16T20:06:36.877279+0000","last_became_active":"2023-10-16T20:06:32.755462+0000","last_became_peered":"2023-10-16T20:06:32.755462+0000","last_unstale":"2023-10-16T20:06:36.877279+0000","last_undegraded":"2023-10-16T20:06:36.877279+0000","last_fullsized":"2023-10-16T20:06:36.877279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:22.618540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":697134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":106274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:06:51.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:06:51.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.160+0000 7fcd58b71700 1 Processor -- start 2023-10-16T20:06:51.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.160+0000 7fcd58b71700 1 -- start start 2023-10-16T20:06:51.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd58b71700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd5415daa0 0x7fcd540af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd58b71700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcd54071f60 0x7fcd5406d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd58b71700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5415ed10 con 0x7fcd540af560 2023-10-16T20:06:51.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd58b71700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5415de80 con 0x7fcd54071f60 2023-10-16T20:06:51.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd58b71700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5415e100 con 0x7fcd5415daa0 2023-10-16T20:06:51.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcd54071f60 0x7fcd5406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcd54071f60 0x7fcd5406d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58728/0 (socket says 172.21.15.152:58728) 2023-10-16T20:06:51.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1192573333 learned_addr learned my addr 172.21.15.152:0/1192573333 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:51.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd5259c700 1 --2- 172.21.15.152:0/1192573333 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd5415daa0 0x7fcd540af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1192573333 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd5415daa0 msgr2=0x7fcd540af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:51.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 --2- 172.21.15.152:0/1192573333 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd5415daa0 0x7fcd540af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1192573333 >> v1:172.21.15.163:6789/0 conn(0x7fcd540af560 legacy=0x7fcd54071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1192573333 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5415e3e0 con 0x7fcd54071f60 2023-10-16T20:06:51.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd52d9d700 1 --2- 172.21.15.152:0/1192573333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd54071f60 0x7fcd5406d100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009e50 tx=0x7fcd4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2146d27edc30397f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd5159a700 1 -- 172.21.15.152:0/1192573333 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00e070 con 0x7fcd54071f60 2023-10-16T20:06:51.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd5159a700 1 -- 172.21.15.152:0/1192573333 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00b9c0 con 0x7fcd54071f60 2023-10-16T20:06:51.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.161+0000 7fcd5159a700 1 -- 172.21.15.152:0/1192573333 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00bd70 con 0x7fcd54071f60 2023-10-16T20:06:51.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 -- 172.21.15.152:0/1192573333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd54071f60 msgr2=0x7fcd5406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1192573333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd54071f60 0x7fcd5406d100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009e50 tx=0x7fcd4c00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:51.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 -- 172.21.15.152:0/1192573333 shutdown_connections 2023-10-16T20:06:51.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1192573333 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd5415daa0 0x7fcd540af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1192573333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd54071f60 0x7fcd5406d100 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 -- 172.21.15.152:0/1192573333 >> 172.21.15.152:0/1192573333 conn(0x7fcd540d0180 msgr2=0x7fcd540d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:51.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 -- 172.21.15.152:0/1192573333 shutdown_connections 2023-10-16T20:06:51.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.162+0000 7fcd58b71700 1 -- 172.21.15.152:0/1192573333 wait complete. 2023-10-16T20:06:51.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.163+0000 7fcd58b71700 1 Processor -- start 2023-10-16T20:06:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.163+0000 7fcd58b71700 1 -- start start 2023-10-16T20:06:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd58b71700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd54071f60 0x7fcd5415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd58b71700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd540af560 0x7fcd541f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd58b71700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 0x7fcd540c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd58b71700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd541f1e60 con 0x7fcd5415daa0 2023-10-16T20:06:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd58b71700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5415d060 con 0x7fcd540af560 2023-10-16T20:06:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd58b71700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd541f4470 con 0x7fcd54071f60 2023-10-16T20:06:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 0x7fcd540c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 0x7fcd540c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58734/0 (socket says 172.21.15.152:58734) 2023-10-16T20:06:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1647258113 learned_addr learned my addr 172.21.15.152:0/1647258113 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd5259c700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd54071f60 0x7fcd5415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd51d9b700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd540af560 0x7fcd541f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd54071f60 msgr2=0x7fcd5415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd54071f60 0x7fcd5415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd540af560 msgr2=0x7fcd541f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd540af560 0x7fcd541f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.164+0000 7fcd52d9d700 1 -- 172.21.15.152:0/1647258113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c009b30 con 0x7fcd5415daa0 2023-10-16T20:06:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.165+0000 7fcd52d9d700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 0x7fcd540c96d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00b370 tx=0x7fcd4c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.165+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c004840 con 0x7fcd5415daa0 2023-10-16T20:06:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.165+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c0092e0 con 0x7fcd5415daa0 2023-10-16T20:06:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.165+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd541f4750 con 0x7fcd5415daa0 2023-10-16T20:06:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.165+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0049c0 con 0x7fcd5415daa0 2023-10-16T20:06:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.165+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd541f4d10 con 0x7fcd5415daa0 2023-10-16T20:06:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.166+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5404ebb0 con 0x7fcd5415daa0 2023-10-16T20:06:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.166+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd4c01c680 con 0x7fcd5415daa0 2023-10-16T20:06:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.167+0000 7fcd42ffd700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcd3406af00 0x7fcd3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.167+0000 7fcd5259c700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcd3406af00 0x7fcd3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.167+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd4c08b100 con 0x7fcd5415daa0 2023-10-16T20:06:51.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.167+0000 7fcd5259c700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcd3406af00 0x7fcd3406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd540ca0d0 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.171+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd4c055f50 con 0x7fcd5415daa0 2023-10-16T20:06:51.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.356+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd5415e9a0 con 0x7fcd3406af00 2023-10-16T20:06:51.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.365+0000 7fcd42ffd700 1 -- 172.21.15.152:0/1647258113 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7fcd440076a0 con 0x7fcd3406af00 2023-10-16T20:06:51.371 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:51.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcd3406af00 msgr2=0x7fcd3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcd3406af00 0x7fcd3406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd540ca0d0 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2023-10-16T20:06:51.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 msgr2=0x7fcd540c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 0x7fcd540c96d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00b370 tx=0x7fcd4c004b20 comp rx=0 tx=0).stop 2023-10-16T20:06:51.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 shutdown_connections 2023-10-16T20:06:51.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcd3406af00 0x7fcd3406d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcd54071f60 0x7fcd5415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5415daa0 0x7fcd540c96d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 --2- 172.21.15.152:0/1647258113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcd540af560 0x7fcd541f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 >> 172.21.15.152:0/1647258113 conn(0x7fcd540d0180 msgr2=0x7fcd540b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 shutdown_connections 2023-10-16T20:06:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.369+0000 7fcd58b71700 1 -- 172.21.15.152:0/1647258113 wait complete. 2023-10-16T20:06:51.375 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:06:51.383 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-16T20:06:50.765371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3416064,"data_stored":2039488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002768"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195372+0000","last_change":"2023-10-16T20:06:32.768697+0000","last_active":"2023-10-16T20:06:37.195372+0000","last_peered":"2023-10-16T20:06:37.195372+0000","last_clean":"2023-10-16T20:06:37.195372+0000","last_became_active":"2023-10-16T20:06:32.768425+0000","last_became_peered":"2023-10-16T20:06:32.768425+0000","last_unstale":"2023-10-16T20:06:37.195372+0000","last_undegraded":"2023-10-16T20:06:37.195372+0000","last_fullsized":"2023-10-16T20:06:37.195372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886277+0000","last_change":"2023-10-16T20:06:32.752823+0000","last_active":"2023-10-16T20:06:36.886277+0000","last_peered":"2023-10-16T20:06:36.886277+0000","last_clean":"2023-10-16T20:06:36.886277+0000","last_became_active":"2023-10-16T20:06:32.752488+0000","last_became_peered":"2023-10-16T20:06:32.752488+0000","last_unstale":"2023-10-16T20:06:36.886277+0000","last_undegraded":"2023-10-16T20:06:36.886277+0000","last_fullsized":"2023-10-16T20:06:36.886277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885188+0000","last_change":"2023-10-16T20:06:32.755212+0000","last_active":"2023-10-16T20:06:36.885188+0000","last_peered":"2023-10-16T20:06:36.885188+0000","last_clean":"2023-10-16T20:06:36.885188+0000","last_became_active":"2023-10-16T20:06:32.754919+0000","last_became_peered":"2023-10-16T20:06:32.754919+0000","last_unstale":"2023-10-16T20:06:36.885188+0000","last_undegraded":"2023-10-16T20:06:36.885188+0000","last_fullsized":"2023-10-16T20:06:36.885188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.761928+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761127+0000","last_became_peered":"2023-10-16T20:06:32.761127+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194887+0000","last_change":"2023-10-16T20:06:32.767050+0000","last_active":"2023-10-16T20:06:37.194887+0000","last_peered":"2023-10-16T20:06:37.194887+0000","last_clean":"2023-10-16T20:06:37.194887+0000","last_became_active":"2023-10-16T20:06:32.766739+0000","last_became_peered":"2023-10-16T20:06:32.766739+0000","last_unstale":"2023-10-16T20:06:37.194887+0000","last_undegraded":"2023-10-16T20:06:37.194887+0000","last_fullsized":"2023-10-16T20:06:37.194887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884978+0000","last_change":"2023-10-16T20:06:32.761991+0000","last_active":"2023-10-16T20:06:36.884978+0000","last_peered":"2023-10-16T20:06:36.884978+0000","last_clean":"2023-10-16T20:06:36.884978+0000","last_became_active":"2023-10-16T20:06:32.761421+0000","last_became_peered":"2023-10-16T20:06:32.761421+0000","last_unstale":"2023-10-16T20:06:36.884978+0000","last_undegraded":"2023-10-16T20:06:36.884978+0000","last_fullsized":"2023-10-16T20:06:36.884978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194866+0000","last_change":"2023-10-16T20:06:32.767492+0000","last_active":"2023-10-16T20:06:37.194866+0000","last_peered":"2023-10-16T20:06:37.194866+0000","last_clean":"2023-10-16T20:06:37.194866+0000","last_became_active":"2023-10-16T20:06:32.767148+0000","last_became_peered":"2023-10-16T20:06:32.767148+0000","last_unstale":"2023-10-16T20:06:37.194866+0000","last_undegraded":"2023-10-16T20:06:37.194866+0000","last_fullsized":"2023-10-16T20:06:37.194866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894286+0000","last_change":"2023-10-16T20:06:32.761690+0000","last_active":"2023-10-16T20:06:36.894286+0000","last_peered":"2023-10-16T20:06:36.894286+0000","last_clean":"2023-10-16T20:06:36.894286+0000","last_became_active":"2023-10-16T20:06:32.761353+0000","last_became_peered":"2023-10-16T20:06:32.761353+0000","last_unstale":"2023-10-16T20:06:36.894286+0000","last_undegraded":"2023-10-16T20:06:36.894286+0000","last_fullsized":"2023-10-16T20:06:36.894286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195306+0000","last_change":"2023-10-16T20:06:32.768700+0000","last_active":"2023-10-16T20:06:37.195306+0000","last_peered":"2023-10-16T20:06:37.195306+0000","last_clean":"2023-10-16T20:06:37.195306+0000","last_became_active":"2023-10-16T20:06:32.768467+0000","last_became_peered":"2023-10-16T20:06:32.768467+0000","last_unstale":"2023-10-16T20:06:37.195306+0000","last_undegraded":"2023-10-16T20:06:37.195306+0000","last_fullsized":"2023-10-16T20:06:37.195306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878795+0000","last_change":"2023-10-16T20:06:32.761708+0000","last_active":"2023-10-16T20:06:36.878795+0000","last_peered":"2023-10-16T20:06:36.878795+0000","last_clean":"2023-10-16T20:06:36.878795+0000","last_became_active":"2023-10-16T20:06:32.761049+0000","last_became_peered":"2023-10-16T20:06:32.761049+0000","last_unstale":"2023-10-16T20:06:36.878795+0000","last_undegraded":"2023-10-16T20:06:36.878795+0000","last_fullsized":"2023-10-16T20:06:36.878795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.879062+0000","last_change":"2023-10-16T20:06:32.763671+0000","last_active":"2023-10-16T20:06:36.879062+0000","last_peered":"2023-10-16T20:06:36.879062+0000","last_clean":"2023-10-16T20:06:36.879062+0000","last_became_active":"2023-10-16T20:06:32.763356+0000","last_became_peered":"2023-10-16T20:06:32.763356+0000","last_unstale":"2023-10-16T20:06:36.879062+0000","last_undegraded":"2023-10-16T20:06:36.879062+0000","last_fullsized":"2023-10-16T20:06:36.879062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:47.470974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876982+0000","last_change":"2023-10-16T20:06:32.750776+0000","last_active":"2023-10-16T20:06:36.876982+0000","last_peered":"2023-10-16T20:06:36.876982+0000","last_clean":"2023-10-16T20:06:36.876982+0000","last_became_active":"2023-10-16T20:06:32.750465+0000","last_became_peered":"2023-10-16T20:06:32.750465+0000","last_unstale":"2023-10-16T20:06:36.876982+0000","last_undegraded":"2023-10-16T20:06:36.876982+0000","last_fullsized":"2023-10-16T20:06:36.876982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:55.631957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893374+0000","last_change":"2023-10-16T20:06:32.759849+0000","last_active":"2023-10-16T20:06:36.893374+0000","last_peered":"2023-10-16T20:06:36.893374+0000","last_clean":"2023-10-16T20:06:36.893374+0000","last_became_active":"2023-10-16T20:06:32.759521+0000","last_became_peered":"2023-10-16T20:06:32.759521+0000","last_unstale":"2023-10-16T20:06:36.893374+0000","last_undegraded":"2023-10-16T20:06:36.893374+0000","last_fullsized":"2023-10-16T20:06:36.893374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881227+0000","last_change":"2023-10-16T20:06:32.758196+0000","last_active":"2023-10-16T20:06:36.881227+0000","last_peered":"2023-10-16T20:06:36.881227+0000","last_clean":"2023-10-16T20:06:36.881227+0000","last_became_active":"2023-10-16T20:06:32.757915+0000","last_became_peered":"2023-10-16T20:06:32.757915+0000","last_unstale":"2023-10-16T20:06:36.881227+0000","last_undegraded":"2023-10-16T20:06:36.881227+0000","last_fullsized":"2023-10-16T20:06:36.881227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882603+0000","last_change":"2023-10-16T20:06:32.745759+0000","last_active":"2023-10-16T20:06:36.882603+0000","last_peered":"2023-10-16T20:06:36.882603+0000","last_clean":"2023-10-16T20:06:36.882603+0000","last_became_active":"2023-10-16T20:06:32.745456+0000","last_became_peered":"2023-10-16T20:06:32.745456+0000","last_unstale":"2023-10-16T20:06:36.882603+0000","last_undegraded":"2023-10-16T20:06:36.882603+0000","last_fullsized":"2023-10-16T20:06:36.882603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884589+0000","last_change":"2023-10-16T20:06:32.762852+0000","last_active":"2023-10-16T20:06:36.884589+0000","last_peered":"2023-10-16T20:06:36.884589+0000","last_clean":"2023-10-16T20:06:36.884589+0000","last_became_active":"2023-10-16T20:06:32.762554+0000","last_became_peered":"2023-10-16T20:06:32.762554+0000","last_unstale":"2023-10-16T20:06:36.884589+0000","last_undegraded":"2023-10-16T20:06:36.884589+0000","last_fullsized":"2023-10-16T20:06:36.884589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885258+0000","last_change":"2023-10-16T20:06:32.769083+0000","last_active":"2023-10-16T20:06:36.885258+0000","last_peered":"2023-10-16T20:06:36.885258+0000","last_clean":"2023-10-16T20:06:36.885258+0000","last_became_active":"2023-10-16T20:06:32.768686+0000","last_became_peered":"2023-10-16T20:06:32.768686+0000","last_unstale":"2023-10-16T20:06:36.885258+0000","last_undegraded":"2023-10-16T20:06:36.885258+0000","last_fullsized":"2023-10-16T20:06:36.885258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876513+0000","last_change":"2023-10-16T20:06:32.756439+0000","last_active":"2023-10-16T20:06:36.876513+0000","last_peered":"2023-10-16T20:06:36.876513+0000","last_clean":"2023-10-16T20:06:36.876513+0000","last_became_active":"2023-10-16T20:06:32.756183+0000","last_became_peered":"2023-10-16T20:06:32.756183+0000","last_unstale":"2023-10-16T20:06:36.876513+0000","last_undegraded":"2023-10-16T20:06:36.876513+0000","last_fullsized":"2023-10-16T20:06:36.876513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:35.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195238+0000","last_change":"2023-10-16T20:06:32.759997+0000","last_active":"2023-10-16T20:06:37.195238+0000","last_peered":"2023-10-16T20:06:37.195238+0000","last_clean":"2023-10-16T20:06:37.195238+0000","last_became_active":"2023-10-16T20:06:32.759616+0000","last_became_peered":"2023-10-16T20:06:32.759616+0000","last_unstale":"2023-10-16T20:06:37.195238+0000","last_undegraded":"2023-10-16T20:06:37.195238+0000","last_fullsized":"2023-10-16T20:06:37.195238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877453+0000","last_change":"2023-10-16T20:06:37.202706+0000","last_active":"2023-10-16T20:06:37.877453+0000","last_peered":"2023-10-16T20:06:37.877453+0000","last_clean":"2023-10-16T20:06:37.877453+0000","last_became_active":"2023-10-16T20:06:37.201561+0000","last_became_peered":"2023-10-16T20:06:37.201561+0000","last_unstale":"2023-10-16T20:06:37.877453+0000","last_undegraded":"2023-10-16T20:06:37.877453+0000","last_fullsized":"2023-10-16T20:06:37.877453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:54.383396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881285+0000","last_change":"2023-10-16T20:06:31.760708+0000","last_active":"2023-10-16T20:06:36.881285+0000","last_peered":"2023-10-16T20:06:36.881285+0000","last_clean":"2023-10-16T20:06:36.881285+0000","last_became_active":"2023-10-16T20:06:31.760372+0000","last_became_peered":"2023-10-16T20:06:31.760372+0000","last_unstale":"2023-10-16T20:06:36.881285+0000","last_undegraded":"2023-10-16T20:06:36.881285+0000","last_fullsized":"2023-10-16T20:06:36.881285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:34.488224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894537+0000","last_change":"2023-10-16T20:06:32.755438+0000","last_active":"2023-10-16T20:06:36.894537+0000","last_peered":"2023-10-16T20:06:36.894537+0000","last_clean":"2023-10-16T20:06:36.894537+0000","last_became_active":"2023-10-16T20:06:32.755151+0000","last_became_peered":"2023-10-16T20:06:32.755151+0000","last_unstale":"2023-10-16T20:06:36.894537+0000","last_undegraded":"2023-10-16T20:06:36.894537+0000","last_fullsized":"2023-10-16T20:06:36.894537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877813+0000","last_change":"2023-10-16T20:06:36.894982+0000","last_active":"2023-10-16T20:06:37.877813+0000","last_peered":"2023-10-16T20:06:37.877813+0000","last_clean":"2023-10-16T20:06:37.877813+0000","last_became_active":"2023-10-16T20:06:36.894580+0000","last_became_peered":"2023-10-16T20:06:36.894580+0000","last_unstale":"2023-10-16T20:06:37.877813+0000","last_undegraded":"2023-10-16T20:06:37.877813+0000","last_fullsized":"2023-10-16T20:06:37.877813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:01.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894628+0000","last_change":"2023-10-16T20:06:31.758252+0000","last_active":"2023-10-16T20:06:36.894628+0000","last_peered":"2023-10-16T20:06:36.894628+0000","last_clean":"2023-10-16T20:06:36.894628+0000","last_became_active":"2023-10-16T20:06:31.758059+0000","last_became_peered":"2023-10-16T20:06:31.758059+0000","last_unstale":"2023-10-16T20:06:36.894628+0000","last_undegraded":"2023-10-16T20:06:36.894628+0000","last_fullsized":"2023-10-16T20:06:36.894628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881181+0000","last_change":"2023-10-16T20:06:32.762874+0000","last_active":"2023-10-16T20:06:36.881181+0000","last_peered":"2023-10-16T20:06:36.881181+0000","last_clean":"2023-10-16T20:06:36.881181+0000","last_became_active":"2023-10-16T20:06:32.762402+0000","last_became_peered":"2023-10-16T20:06:32.762402+0000","last_unstale":"2023-10-16T20:06:36.881181+0000","last_undegraded":"2023-10-16T20:06:36.881181+0000","last_fullsized":"2023-10-16T20:06:36.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877518+0000","last_change":"2023-10-16T20:06:36.898631+0000","last_active":"2023-10-16T20:06:37.877518+0000","last_peered":"2023-10-16T20:06:37.877518+0000","last_clean":"2023-10-16T20:06:37.877518+0000","last_became_active":"2023-10-16T20:06:36.898270+0000","last_became_peered":"2023-10-16T20:06:36.898270+0000","last_unstale":"2023-10-16T20:06:37.877518+0000","last_undegraded":"2023-10-16T20:06:37.877518+0000","last_fullsized":"2023-10-16T20:06:37.877518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:51.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195047+0000","last_change":"2023-10-16T20:06:31.760987+0000","last_active":"2023-10-16T20:06:37.195047+0000","last_peered":"2023-10-16T20:06:37.195047+0000","last_clean":"2023-10-16T20:06:37.195047+0000","last_became_active":"2023-10-16T20:06:31.760689+0000","last_became_peered":"2023-10-16T20:06:31.760689+0000","last_unstale":"2023-10-16T20:06:37.195047+0000","last_undegraded":"2023-10-16T20:06:37.195047+0000","last_fullsized":"2023-10-16T20:06:37.195047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:55.970423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884745+0000","last_change":"2023-10-16T20:06:32.761819+0000","last_active":"2023-10-16T20:06:36.884745+0000","last_peered":"2023-10-16T20:06:36.884745+0000","last_clean":"2023-10-16T20:06:36.884745+0000","last_became_active":"2023-10-16T20:06:32.760684+0000","last_became_peered":"2023-10-16T20:06:32.760684+0000","last_unstale":"2023-10-16T20:06:36.884745+0000","last_undegraded":"2023-10-16T20:06:36.884745+0000","last_fullsized":"2023-10-16T20:06:36.884745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878229+0000","last_change":"2023-10-16T20:06:36.892310+0000","last_active":"2023-10-16T20:06:37.878229+0000","last_peered":"2023-10-16T20:06:37.878229+0000","last_clean":"2023-10-16T20:06:37.878229+0000","last_became_active":"2023-10-16T20:06:36.891929+0000","last_became_peered":"2023-10-16T20:06:36.891929+0000","last_unstale":"2023-10-16T20:06:37.878229+0000","last_undegraded":"2023-10-16T20:06:37.878229+0000","last_fullsized":"2023-10-16T20:06:37.878229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:08.770589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194885+0000","last_change":"2023-10-16T20:06:31.764299+0000","last_active":"2023-10-16T20:06:37.194885+0000","last_peered":"2023-10-16T20:06:37.194885+0000","last_clean":"2023-10-16T20:06:37.194885+0000","last_became_active":"2023-10-16T20:06:31.763992+0000","last_became_peered":"2023-10-16T20:06:31.763992+0000","last_unstale":"2023-10-16T20:06:37.194885+0000","last_undegraded":"2023-10-16T20:06:37.194885+0000","last_fullsized":"2023-10-16T20:06:37.194885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:47.236030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885181+0000","last_change":"2023-10-16T20:06:32.762698+0000","last_active":"2023-10-16T20:06:36.885181+0000","last_peered":"2023-10-16T20:06:36.885181+0000","last_clean":"2023-10-16T20:06:36.885181+0000","last_became_active":"2023-10-16T20:06:32.762260+0000","last_became_peered":"2023-10-16T20:06:32.762260+0000","last_unstale":"2023-10-16T20:06:36.885181+0000","last_undegraded":"2023-10-16T20:06:36.885181+0000","last_fullsized":"2023-10-16T20:06:36.885181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877522+0000","last_change":"2023-10-16T20:06:36.899980+0000","last_active":"2023-10-16T20:06:37.877522+0000","last_peered":"2023-10-16T20:06:37.877522+0000","last_clean":"2023-10-16T20:06:37.877522+0000","last_became_active":"2023-10-16T20:06:36.899573+0000","last_became_peered":"2023-10-16T20:06:36.899573+0000","last_unstale":"2023-10-16T20:06:37.877522+0000","last_undegraded":"2023-10-16T20:06:37.877522+0000","last_fullsized":"2023-10-16T20:06:37.877522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:13.468658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893703+0000","last_change":"2023-10-16T20:06:31.760320+0000","last_active":"2023-10-16T20:06:36.893703+0000","last_peered":"2023-10-16T20:06:36.893703+0000","last_clean":"2023-10-16T20:06:36.893703+0000","last_became_active":"2023-10-16T20:06:31.759976+0000","last_became_peered":"2023-10-16T20:06:31.759976+0000","last_unstale":"2023-10-16T20:06:36.893703+0000","last_undegraded":"2023-10-16T20:06:36.893703+0000","last_fullsized":"2023-10-16T20:06:36.893703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878749+0000","last_change":"2023-10-16T20:06:32.746691+0000","last_active":"2023-10-16T20:06:36.878749+0000","last_peered":"2023-10-16T20:06:36.878749+0000","last_clean":"2023-10-16T20:06:36.878749+0000","last_became_active":"2023-10-16T20:06:32.745389+0000","last_became_peered":"2023-10-16T20:06:32.745389+0000","last_unstale":"2023-10-16T20:06:36.878749+0000","last_undegraded":"2023-10-16T20:06:36.878749+0000","last_fullsized":"2023-10-16T20:06:36.878749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:23:34.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450907+0000","last_change":"2023-10-16T20:06:36.900651+0000","last_active":"2023-10-16T20:06:38.450907+0000","last_peered":"2023-10-16T20:06:38.450907+0000","last_clean":"2023-10-16T20:06:38.450907+0000","last_became_active":"2023-10-16T20:06:36.900236+0000","last_became_peered":"2023-10-16T20:06:36.900236+0000","last_unstale":"2023-10-16T20:06:38.450907+0000","last_undegraded":"2023-10-16T20:06:38.450907+0000","last_fullsized":"2023-10-16T20:06:38.450907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:01.291449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876809+0000","last_change":"2023-10-16T20:06:31.761790+0000","last_active":"2023-10-16T20:06:36.876809+0000","last_peered":"2023-10-16T20:06:36.876809+0000","last_clean":"2023-10-16T20:06:36.876809+0000","last_became_active":"2023-10-16T20:06:31.761519+0000","last_became_peered":"2023-10-16T20:06:31.761519+0000","last_unstale":"2023-10-16T20:06:36.876809+0000","last_undegraded":"2023-10-16T20:06:36.876809+0000","last_fullsized":"2023-10-16T20:06:36.876809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:20.846036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881411+0000","last_change":"2023-10-16T20:06:32.757771+0000","last_active":"2023-10-16T20:06:36.881411+0000","last_peered":"2023-10-16T20:06:36.881411+0000","last_clean":"2023-10-16T20:06:36.881411+0000","last_became_active":"2023-10-16T20:06:32.757124+0000","last_became_peered":"2023-10-16T20:06:32.757124+0000","last_unstale":"2023-10-16T20:06:36.881411+0000","last_undegraded":"2023-10-16T20:06:36.881411+0000","last_fullsized":"2023-10-16T20:06:36.881411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877753+0000","last_change":"2023-10-16T20:06:36.894985+0000","last_active":"2023-10-16T20:06:37.877753+0000","last_peered":"2023-10-16T20:06:37.877753+0000","last_clean":"2023-10-16T20:06:37.877753+0000","last_became_active":"2023-10-16T20:06:36.894583+0000","last_became_peered":"2023-10-16T20:06:36.894583+0000","last_unstale":"2023-10-16T20:06:37.877753+0000","last_undegraded":"2023-10-16T20:06:37.877753+0000","last_fullsized":"2023-10-16T20:06:37.877753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893346+0000","last_change":"2023-10-16T20:06:31.755087+0000","last_active":"2023-10-16T20:06:36.893346+0000","last_peered":"2023-10-16T20:06:36.893346+0000","last_clean":"2023-10-16T20:06:36.893346+0000","last_became_active":"2023-10-16T20:06:31.754799+0000","last_became_peered":"2023-10-16T20:06:31.754799+0000","last_unstale":"2023-10-16T20:06:36.893346+0000","last_undegraded":"2023-10-16T20:06:36.893346+0000","last_fullsized":"2023-10-16T20:06:36.893346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:50.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894075+0000","last_change":"2023-10-16T20:06:32.760484+0000","last_active":"2023-10-16T20:06:36.894075+0000","last_peered":"2023-10-16T20:06:36.894075+0000","last_clean":"2023-10-16T20:06:36.894075+0000","last_became_active":"2023-10-16T20:06:32.759921+0000","last_became_peered":"2023-10-16T20:06:32.759921+0000","last_unstale":"2023-10-16T20:06:36.894075+0000","last_undegraded":"2023-10-16T20:06:36.894075+0000","last_fullsized":"2023-10-16T20:06:36.894075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450546+0000","last_change":"2023-10-16T20:06:37.201860+0000","last_active":"2023-10-16T20:06:38.450546+0000","last_peered":"2023-10-16T20:06:38.450546+0000","last_clean":"2023-10-16T20:06:38.450546+0000","last_became_active":"2023-10-16T20:06:37.201460+0000","last_became_peered":"2023-10-16T20:06:37.201460+0000","last_unstale":"2023-10-16T20:06:38.450546+0000","last_undegraded":"2023-10-16T20:06:38.450546+0000","last_fullsized":"2023-10-16T20:06:38.450546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884636+0000","last_change":"2023-10-16T20:06:31.763472+0000","last_active":"2023-10-16T20:06:36.884636+0000","last_peered":"2023-10-16T20:06:36.884636+0000","last_clean":"2023-10-16T20:06:36.884636+0000","last_became_active":"2023-10-16T20:06:31.763182+0000","last_became_peered":"2023-10-16T20:06:31.763182+0000","last_unstale":"2023-10-16T20:06:36.884636+0000","last_undegraded":"2023-10-16T20:06:36.884636+0000","last_fullsized":"2023-10-16T20:06:36.884636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:36.641784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882893+0000","last_change":"2023-10-16T20:06:32.760456+0000","last_active":"2023-10-16T20:06:36.882893+0000","last_peered":"2023-10-16T20:06:36.882893+0000","last_clean":"2023-10-16T20:06:36.882893+0000","last_became_active":"2023-10-16T20:06:32.760213+0000","last_became_peered":"2023-10-16T20:06:32.760213+0000","last_unstale":"2023-10-16T20:06:36.882893+0000","last_undegraded":"2023-10-16T20:06:36.882893+0000","last_fullsized":"2023-10-16T20:06:36.882893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877007+0000","last_change":"2023-10-16T20:06:37.202225+0000","last_active":"2023-10-16T20:06:37.877007+0000","last_peered":"2023-10-16T20:06:37.877007+0000","last_clean":"2023-10-16T20:06:37.877007+0000","last_became_active":"2023-10-16T20:06:37.201869+0000","last_became_peered":"2023-10-16T20:06:37.201869+0000","last_unstale":"2023-10-16T20:06:37.877007+0000","last_undegraded":"2023-10-16T20:06:37.877007+0000","last_fullsized":"2023-10-16T20:06:37.877007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878662+0000","last_change":"2023-10-16T20:06:31.760996+0000","last_active":"2023-10-16T20:06:36.878662+0000","last_peered":"2023-10-16T20:06:36.878662+0000","last_clean":"2023-10-16T20:06:36.878662+0000","last_became_active":"2023-10-16T20:06:31.760730+0000","last_became_peered":"2023-10-16T20:06:31.760730+0000","last_unstale":"2023-10-16T20:06:36.878662+0000","last_undegraded":"2023-10-16T20:06:36.878662+0000","last_fullsized":"2023-10-16T20:06:36.878662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:41.705266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885662+0000","last_change":"2023-10-16T20:06:32.769034+0000","last_active":"2023-10-16T20:06:36.885662+0000","last_peered":"2023-10-16T20:06:36.885662+0000","last_clean":"2023-10-16T20:06:36.885662+0000","last_became_active":"2023-10-16T20:06:32.768739+0000","last_became_peered":"2023-10-16T20:06:32.768739+0000","last_unstale":"2023-10-16T20:06:36.885662+0000","last_undegraded":"2023-10-16T20:06:36.885662+0000","last_fullsized":"2023-10-16T20:06:36.885662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877177+0000","last_change":"2023-10-16T20:06:36.900254+0000","last_active":"2023-10-16T20:06:37.877177+0000","last_peered":"2023-10-16T20:06:37.877177+0000","last_clean":"2023-10-16T20:06:37.877177+0000","last_became_active":"2023-10-16T20:06:36.899452+0000","last_became_peered":"2023-10-16T20:06:36.899452+0000","last_unstale":"2023-10-16T20:06:37.877177+0000","last_undegraded":"2023-10-16T20:06:37.877177+0000","last_fullsized":"2023-10-16T20:06:37.877177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:44:40.784270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885577+0000","last_change":"2023-10-16T20:06:31.760615+0000","last_active":"2023-10-16T20:06:36.885577+0000","last_peered":"2023-10-16T20:06:36.885577+0000","last_clean":"2023-10-16T20:06:36.885577+0000","last_became_active":"2023-10-16T20:06:31.760334+0000","last_became_peered":"2023-10-16T20:06:31.760334+0000","last_unstale":"2023-10-16T20:06:36.885577+0000","last_undegraded":"2023-10-16T20:06:36.885577+0000","last_fullsized":"2023-10-16T20:06:36.885577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881436+0000","last_change":"2023-10-16T20:06:32.762754+0000","last_active":"2023-10-16T20:06:36.881436+0000","last_peered":"2023-10-16T20:06:36.881436+0000","last_clean":"2023-10-16T20:06:36.881436+0000","last_became_active":"2023-10-16T20:06:32.762465+0000","last_became_peered":"2023-10-16T20:06:32.762465+0000","last_unstale":"2023-10-16T20:06:36.881436+0000","last_undegraded":"2023-10-16T20:06:36.881436+0000","last_fullsized":"2023-10-16T20:06:36.881436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878471+0000","last_change":"2023-10-16T20:06:36.895621+0000","last_active":"2023-10-16T20:06:37.878471+0000","last_peered":"2023-10-16T20:06:37.878471+0000","last_clean":"2023-10-16T20:06:37.878471+0000","last_became_active":"2023-10-16T20:06:36.895207+0000","last_became_peered":"2023-10-16T20:06:36.895207+0000","last_unstale":"2023-10-16T20:06:37.878471+0000","last_undegraded":"2023-10-16T20:06:37.878471+0000","last_fullsized":"2023-10-16T20:06:37.878471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:45.017168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881577+0000","last_change":"2023-10-16T20:06:31.763487+0000","last_active":"2023-10-16T20:06:36.881577+0000","last_peered":"2023-10-16T20:06:36.881577+0000","last_clean":"2023-10-16T20:06:36.881577+0000","last_became_active":"2023-10-16T20:06:31.763173+0000","last_became_peered":"2023-10-16T20:06:31.763173+0000","last_unstale":"2023-10-16T20:06:36.881577+0000","last_undegraded":"2023-10-16T20:06:36.881577+0000","last_fullsized":"2023-10-16T20:06:36.881577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:59.860416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876870+0000","last_change":"2023-10-16T20:06:32.759043+0000","last_active":"2023-10-16T20:06:36.876870+0000","last_peered":"2023-10-16T20:06:36.876870+0000","last_clean":"2023-10-16T20:06:36.876870+0000","last_became_active":"2023-10-16T20:06:32.758748+0000","last_became_peered":"2023-10-16T20:06:32.758748+0000","last_unstale":"2023-10-16T20:06:36.876870+0000","last_undegraded":"2023-10-16T20:06:36.876870+0000","last_fullsized":"2023-10-16T20:06:36.876870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:35.526470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449676+0000","last_change":"2023-10-16T20:06:36.903555+0000","last_active":"2023-10-16T20:06:38.449676+0000","last_peered":"2023-10-16T20:06:38.449676+0000","last_clean":"2023-10-16T20:06:38.449676+0000","last_became_active":"2023-10-16T20:06:36.902883+0000","last_became_peered":"2023-10-16T20:06:36.902883+0000","last_unstale":"2023-10-16T20:06:38.449676+0000","last_undegraded":"2023-10-16T20:06:38.449676+0000","last_fullsized":"2023-10-16T20:06:38.449676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:43.155600+0000","last_change":"2023-10-16T20:06:31.754138+0000","last_active":"2023-10-16T20:06:43.155600+0000","last_peered":"2023-10-16T20:06:43.155600+0000","last_clean":"2023-10-16T20:06:43.155600+0000","last_became_active":"2023-10-16T20:06:31.753853+0000","last_became_peered":"2023-10-16T20:06:31.753853+0000","last_unstale":"2023-10-16T20:06:43.155600+0000","last_undegraded":"2023-10-16T20:06:43.155600+0000","last_fullsized":"2023-10-16T20:06:43.155600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:42.602521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195144+0000","last_change":"2023-10-16T20:06:32.767119+0000","last_active":"2023-10-16T20:06:37.195144+0000","last_peered":"2023-10-16T20:06:37.195144+0000","last_clean":"2023-10-16T20:06:37.195144+0000","last_became_active":"2023-10-16T20:06:32.766833+0000","last_became_peered":"2023-10-16T20:06:32.766833+0000","last_unstale":"2023-10-16T20:06:37.195144+0000","last_undegraded":"2023-10-16T20:06:37.195144+0000","last_fullsized":"2023-10-16T20:06:37.195144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356888+0000","last_change":"2023-10-16T20:06:37.202116+0000","last_active":"2023-10-16T20:06:38.356888+0000","last_peered":"2023-10-16T20:06:38.356888+0000","last_clean":"2023-10-16T20:06:38.356888+0000","last_became_active":"2023-10-16T20:06:37.201629+0000","last_became_peered":"2023-10-16T20:06:37.201629+0000","last_unstale":"2023-10-16T20:06:38.356888+0000","last_undegraded":"2023-10-16T20:06:38.356888+0000","last_fullsized":"2023-10-16T20:06:38.356888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:17.307460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881594+0000","last_change":"2023-10-16T20:06:31.758562+0000","last_active":"2023-10-16T20:06:36.881594+0000","last_peered":"2023-10-16T20:06:36.881594+0000","last_clean":"2023-10-16T20:06:36.881594+0000","last_became_active":"2023-10-16T20:06:31.758280+0000","last_became_peered":"2023-10-16T20:06:31.758280+0000","last_unstale":"2023-10-16T20:06:36.881594+0000","last_undegraded":"2023-10-16T20:06:36.881594+0000","last_fullsized":"2023-10-16T20:06:36.881594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882698+0000","last_change":"2023-10-16T20:06:32.761562+0000","last_active":"2023-10-16T20:06:36.882698+0000","last_peered":"2023-10-16T20:06:36.882698+0000","last_clean":"2023-10-16T20:06:36.882698+0000","last_became_active":"2023-10-16T20:06:32.761271+0000","last_became_peered":"2023-10-16T20:06:32.761271+0000","last_unstale":"2023-10-16T20:06:36.882698+0000","last_undegraded":"2023-10-16T20:06:36.882698+0000","last_fullsized":"2023-10-16T20:06:36.882698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:15.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877847+0000","last_change":"2023-10-16T20:06:37.196752+0000","last_active":"2023-10-16T20:06:37.877847+0000","last_peered":"2023-10-16T20:06:37.877847+0000","last_clean":"2023-10-16T20:06:37.877847+0000","last_became_active":"2023-10-16T20:06:37.196349+0000","last_became_peered":"2023-10-16T20:06:37.196349+0000","last_unstale":"2023-10-16T20:06:37.877847+0000","last_undegraded":"2023-10-16T20:06:37.877847+0000","last_fullsized":"2023-10-16T20:06:37.877847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:44.546135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885198+0000","last_change":"2023-10-16T20:06:31.760198+0000","last_active":"2023-10-16T20:06:36.885198+0000","last_peered":"2023-10-16T20:06:36.885198+0000","last_clean":"2023-10-16T20:06:36.885198+0000","last_became_active":"2023-10-16T20:06:31.759876+0000","last_became_peered":"2023-10-16T20:06:31.759876+0000","last_unstale":"2023-10-16T20:06:36.885198+0000","last_undegraded":"2023-10-16T20:06:36.885198+0000","last_fullsized":"2023-10-16T20:06:36.885198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194983+0000","last_change":"2023-10-16T20:06:32.766888+0000","last_active":"2023-10-16T20:06:37.194983+0000","last_peered":"2023-10-16T20:06:37.194983+0000","last_clean":"2023-10-16T20:06:37.194983+0000","last_became_active":"2023-10-16T20:06:32.766622+0000","last_became_peered":"2023-10-16T20:06:32.766622+0000","last_unstale":"2023-10-16T20:06:37.194983+0000","last_undegraded":"2023-10-16T20:06:37.194983+0000","last_fullsized":"2023-10-16T20:06:37.194983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878288+0000","last_change":"2023-10-16T20:06:37.203326+0000","last_active":"2023-10-16T20:06:37.878288+0000","last_peered":"2023-10-16T20:06:37.878288+0000","last_clean":"2023-10-16T20:06:37.878288+0000","last_became_active":"2023-10-16T20:06:37.202984+0000","last_became_peered":"2023-10-16T20:06:37.202984+0000","last_unstale":"2023-10-16T20:06:37.878288+0000","last_undegraded":"2023-10-16T20:06:37.878288+0000","last_fullsized":"2023-10-16T20:06:37.878288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:14.463170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876269+0000","last_change":"2023-10-16T20:06:31.753359+0000","last_active":"2023-10-16T20:06:36.876269+0000","last_peered":"2023-10-16T20:06:36.876269+0000","last_clean":"2023-10-16T20:06:36.876269+0000","last_became_active":"2023-10-16T20:06:31.753077+0000","last_became_peered":"2023-10-16T20:06:31.753077+0000","last_unstale":"2023-10-16T20:06:36.876269+0000","last_undegraded":"2023-10-16T20:06:36.876269+0000","last_fullsized":"2023-10-16T20:06:36.876269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:33:34.708942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876082+0000","last_change":"2023-10-16T20:06:32.751058+0000","last_active":"2023-10-16T20:06:36.876082+0000","last_peered":"2023-10-16T20:06:36.876082+0000","last_clean":"2023-10-16T20:06:36.876082+0000","last_became_active":"2023-10-16T20:06:32.750777+0000","last_became_peered":"2023-10-16T20:06:32.750777+0000","last_unstale":"2023-10-16T20:06:36.876082+0000","last_undegraded":"2023-10-16T20:06:36.876082+0000","last_fullsized":"2023-10-16T20:06:36.876082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:58.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450353+0000","last_change":"2023-10-16T20:06:36.902623+0000","last_active":"2023-10-16T20:06:38.450353+0000","last_peered":"2023-10-16T20:06:38.450353+0000","last_clean":"2023-10-16T20:06:38.450353+0000","last_became_active":"2023-10-16T20:06:36.902228+0000","last_became_peered":"2023-10-16T20:06:36.902228+0000","last_unstale":"2023-10-16T20:06:38.450353+0000","last_undegraded":"2023-10-16T20:06:38.450353+0000","last_fullsized":"2023-10-16T20:06:38.450353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876268+0000","last_change":"2023-10-16T20:06:31.755895+0000","last_active":"2023-10-16T20:06:36.876268+0000","last_peered":"2023-10-16T20:06:36.876268+0000","last_clean":"2023-10-16T20:06:36.876268+0000","last_became_active":"2023-10-16T20:06:31.753514+0000","last_became_peered":"2023-10-16T20:06:31.753514+0000","last_unstale":"2023-10-16T20:06:36.876268+0000","last_undegraded":"2023-10-16T20:06:36.876268+0000","last_fullsized":"2023-10-16T20:06:36.876268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:56.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194950+0000","last_change":"2023-10-16T20:06:32.761296+0000","last_active":"2023-10-16T20:06:37.194950+0000","last_peered":"2023-10-16T20:06:37.194950+0000","last_clean":"2023-10-16T20:06:37.194950+0000","last_became_active":"2023-10-16T20:06:32.759859+0000","last_became_peered":"2023-10-16T20:06:32.759859+0000","last_unstale":"2023-10-16T20:06:37.194950+0000","last_undegraded":"2023-10-16T20:06:37.194950+0000","last_fullsized":"2023-10-16T20:06:37.194950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:51:31.604677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877930+0000","last_change":"2023-10-16T20:06:36.895213+0000","last_active":"2023-10-16T20:06:37.877930+0000","last_peered":"2023-10-16T20:06:37.877930+0000","last_clean":"2023-10-16T20:06:37.877930+0000","last_became_active":"2023-10-16T20:06:36.894773+0000","last_became_peered":"2023-10-16T20:06:36.894773+0000","last_unstale":"2023-10-16T20:06:37.877930+0000","last_undegraded":"2023-10-16T20:06:37.877930+0000","last_fullsized":"2023-10-16T20:06:37.877930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:27.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876800+0000","last_change":"2023-10-16T20:06:31.757448+0000","last_active":"2023-10-16T20:06:36.876800+0000","last_peered":"2023-10-16T20:06:36.876800+0000","last_clean":"2023-10-16T20:06:36.876800+0000","last_became_active":"2023-10-16T20:06:31.757148+0000","last_became_peered":"2023-10-16T20:06:31.757148+0000","last_unstale":"2023-10-16T20:06:36.876800+0000","last_undegraded":"2023-10-16T20:06:36.876800+0000","last_fullsized":"2023-10-16T20:06:36.876800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:58.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195129+0000","last_change":"2023-10-16T20:06:32.760468+0000","last_active":"2023-10-16T20:06:37.195129+0000","last_peered":"2023-10-16T20:06:37.195129+0000","last_clean":"2023-10-16T20:06:37.195129+0000","last_became_active":"2023-10-16T20:06:32.760170+0000","last_became_peered":"2023-10-16T20:06:32.760170+0000","last_unstale":"2023-10-16T20:06:37.195129+0000","last_undegraded":"2023-10-16T20:06:37.195129+0000","last_fullsized":"2023-10-16T20:06:37.195129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:21:54.422703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449538+0000","last_change":"2023-10-16T20:06:36.903294+0000","last_active":"2023-10-16T20:06:38.449538+0000","last_peered":"2023-10-16T20:06:38.449538+0000","last_clean":"2023-10-16T20:06:38.449538+0000","last_became_active":"2023-10-16T20:06:36.902123+0000","last_became_peered":"2023-10-16T20:06:36.902123+0000","last_unstale":"2023-10-16T20:06:38.449538+0000","last_undegraded":"2023-10-16T20:06:38.449538+0000","last_fullsized":"2023-10-16T20:06:38.449538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885520+0000","last_change":"2023-10-16T20:06:31.754709+0000","last_active":"2023-10-16T20:06:36.885520+0000","last_peered":"2023-10-16T20:06:36.885520+0000","last_clean":"2023-10-16T20:06:36.885520+0000","last_became_active":"2023-10-16T20:06:31.754401+0000","last_became_peered":"2023-10-16T20:06:31.754401+0000","last_unstale":"2023-10-16T20:06:36.885520+0000","last_undegraded":"2023-10-16T20:06:36.885520+0000","last_fullsized":"2023-10-16T20:06:36.885520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.452414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885290+0000","last_change":"2023-10-16T20:06:32.761804+0000","last_active":"2023-10-16T20:06:36.885290+0000","last_peered":"2023-10-16T20:06:36.885290+0000","last_clean":"2023-10-16T20:06:36.885290+0000","last_became_active":"2023-10-16T20:06:32.760958+0000","last_became_peered":"2023-10-16T20:06:32.760958+0000","last_unstale":"2023-10-16T20:06:36.885290+0000","last_undegraded":"2023-10-16T20:06:36.885290+0000","last_fullsized":"2023-10-16T20:06:36.885290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449849+0000","last_change":"2023-10-16T20:06:36.903445+0000","last_active":"2023-10-16T20:06:38.449849+0000","last_peered":"2023-10-16T20:06:38.449849+0000","last_clean":"2023-10-16T20:06:38.449849+0000","last_became_active":"2023-10-16T20:06:36.903063+0000","last_became_peered":"2023-10-16T20:06:36.903063+0000","last_unstale":"2023-10-16T20:06:38.449849+0000","last_undegraded":"2023-10-16T20:06:38.449849+0000","last_fullsized":"2023-10-16T20:06:38.449849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884659+0000","last_change":"2023-10-16T20:06:31.763443+0000","last_active":"2023-10-16T20:06:36.884659+0000","last_peered":"2023-10-16T20:06:36.884659+0000","last_clean":"2023-10-16T20:06:36.884659+0000","last_became_active":"2023-10-16T20:06:31.763163+0000","last_became_peered":"2023-10-16T20:06:31.763163+0000","last_unstale":"2023-10-16T20:06:36.884659+0000","last_undegraded":"2023-10-16T20:06:36.884659+0000","last_fullsized":"2023-10-16T20:06:36.884659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:57.275970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878335+0000","last_change":"2023-10-16T20:06:32.752504+0000","last_active":"2023-10-16T20:06:36.878335+0000","last_peered":"2023-10-16T20:06:36.878335+0000","last_clean":"2023-10-16T20:06:36.878335+0000","last_became_active":"2023-10-16T20:06:32.752221+0000","last_became_peered":"2023-10-16T20:06:32.752221+0000","last_unstale":"2023-10-16T20:06:36.878335+0000","last_undegraded":"2023-10-16T20:06:36.878335+0000","last_fullsized":"2023-10-16T20:06:36.878335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:06.823167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450660+0000","last_change":"2023-10-16T20:06:36.904832+0000","last_active":"2023-10-16T20:06:38.450660+0000","last_peered":"2023-10-16T20:06:38.450660+0000","last_clean":"2023-10-16T20:06:38.450660+0000","last_became_active":"2023-10-16T20:06:36.902946+0000","last_became_peered":"2023-10-16T20:06:36.902946+0000","last_unstale":"2023-10-16T20:06:38.450660+0000","last_undegraded":"2023-10-16T20:06:38.450660+0000","last_fullsized":"2023-10-16T20:06:38.450660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886854+0000","last_change":"2023-10-16T20:06:32.754410+0000","last_active":"2023-10-16T20:06:36.886854+0000","last_peered":"2023-10-16T20:06:36.886854+0000","last_clean":"2023-10-16T20:06:36.886854+0000","last_became_active":"2023-10-16T20:06:32.752138+0000","last_became_peered":"2023-10-16T20:06:32.752138+0000","last_unstale":"2023-10-16T20:06:36.886854+0000","last_undegraded":"2023-10-16T20:06:36.886854+0000","last_fullsized":"2023-10-16T20:06:36.886854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876274+0000","last_change":"2023-10-16T20:06:31.754288+0000","last_active":"2023-10-16T20:06:36.876274+0000","last_peered":"2023-10-16T20:06:36.876274+0000","last_clean":"2023-10-16T20:06:36.876274+0000","last_became_active":"2023-10-16T20:06:31.753897+0000","last_became_peered":"2023-10-16T20:06:31.753897+0000","last_unstale":"2023-10-16T20:06:36.876274+0000","last_undegraded":"2023-10-16T20:06:36.876274+0000","last_fullsized":"2023-10-16T20:06:36.876274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:50.340924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877991+0000","last_change":"2023-10-16T20:06:37.196921+0000","last_active":"2023-10-16T20:06:37.877991+0000","last_peered":"2023-10-16T20:06:37.877991+0000","last_clean":"2023-10-16T20:06:37.877991+0000","last_became_active":"2023-10-16T20:06:37.196485+0000","last_became_peered":"2023-10-16T20:06:37.196485+0000","last_unstale":"2023-10-16T20:06:37.877991+0000","last_undegraded":"2023-10-16T20:06:37.877991+0000","last_fullsized":"2023-10-16T20:06:37.877991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893852+0000","last_change":"2023-10-16T20:06:32.763195+0000","last_active":"2023-10-16T20:06:36.893852+0000","last_peered":"2023-10-16T20:06:36.893852+0000","last_clean":"2023-10-16T20:06:36.893852+0000","last_became_active":"2023-10-16T20:06:32.762891+0000","last_became_peered":"2023-10-16T20:06:32.762891+0000","last_unstale":"2023-10-16T20:06:36.893852+0000","last_undegraded":"2023-10-16T20:06:36.893852+0000","last_fullsized":"2023-10-16T20:06:36.893852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885155+0000","last_change":"2023-10-16T20:06:31.759832+0000","last_active":"2023-10-16T20:06:36.885155+0000","last_peered":"2023-10-16T20:06:36.885155+0000","last_clean":"2023-10-16T20:06:36.885155+0000","last_became_active":"2023-10-16T20:06:31.759343+0000","last_became_peered":"2023-10-16T20:06:31.759343+0000","last_unstale":"2023-10-16T20:06:36.885155+0000","last_undegraded":"2023-10-16T20:06:36.885155+0000","last_fullsized":"2023-10-16T20:06:36.885155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:28.978568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194365+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:06:37.194365+0000","last_peered":"2023-10-16T20:06:37.194365+0000","last_clean":"2023-10-16T20:06:37.194365+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:06:37.194365+0000","last_undegraded":"2023-10-16T20:06:37.194365+0000","last_fullsized":"2023-10-16T20:06:37.194365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450435+0000","last_change":"2023-10-16T20:06:37.201901+0000","last_active":"2023-10-16T20:06:38.450435+0000","last_peered":"2023-10-16T20:06:38.450435+0000","last_clean":"2023-10-16T20:06:38.450435+0000","last_became_active":"2023-10-16T20:06:37.201501+0000","last_became_peered":"2023-10-16T20:06:37.201501+0000","last_unstale":"2023-10-16T20:06:38.450435+0000","last_undegraded":"2023-10-16T20:06:38.450435+0000","last_fullsized":"2023-10-16T20:06:38.450435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.880899+0000","last_change":"2023-10-16T20:06:32.757110+0000","last_active":"2023-10-16T20:06:36.880899+0000","last_peered":"2023-10-16T20:06:36.880899+0000","last_clean":"2023-10-16T20:06:36.880899+0000","last_became_active":"2023-10-16T20:06:32.756814+0000","last_became_peered":"2023-10-16T20:06:32.756814+0000","last_unstale":"2023-10-16T20:06:36.880899+0000","last_undegraded":"2023-10-16T20:06:36.880899+0000","last_fullsized":"2023-10-16T20:06:36.880899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.457314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194766+0000","last_change":"2023-10-16T20:06:31.757582+0000","last_active":"2023-10-16T20:06:37.194766+0000","last_peered":"2023-10-16T20:06:37.194766+0000","last_clean":"2023-10-16T20:06:37.194766+0000","last_became_active":"2023-10-16T20:06:31.757284+0000","last_became_peered":"2023-10-16T20:06:31.757284+0000","last_unstale":"2023-10-16T20:06:37.194766+0000","last_undegraded":"2023-10-16T20:06:37.194766+0000","last_fullsized":"2023-10-16T20:06:37.194766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:34.521571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449383+0000","last_change":"2023-10-16T20:06:37.196738+0000","last_active":"2023-10-16T20:06:38.449383+0000","last_peered":"2023-10-16T20:06:38.449383+0000","last_clean":"2023-10-16T20:06:38.449383+0000","last_became_active":"2023-10-16T20:06:37.196358+0000","last_became_peered":"2023-10-16T20:06:37.196358+0000","last_unstale":"2023-10-16T20:06:38.449383+0000","last_undegraded":"2023-10-16T20:06:38.449383+0000","last_fullsized":"2023-10-16T20:06:38.449383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195027+0000","last_change":"2023-10-16T20:06:31.763235+0000","last_active":"2023-10-16T20:06:37.195027+0000","last_peered":"2023-10-16T20:06:37.195027+0000","last_clean":"2023-10-16T20:06:37.195027+0000","last_became_active":"2023-10-16T20:06:31.762917+0000","last_became_peered":"2023-10-16T20:06:31.762917+0000","last_unstale":"2023-10-16T20:06:37.195027+0000","last_undegraded":"2023-10-16T20:06:37.195027+0000","last_fullsized":"2023-10-16T20:06:37.195027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885559+0000","last_change":"2023-10-16T20:06:32.753815+0000","last_active":"2023-10-16T20:06:36.885559+0000","last_peered":"2023-10-16T20:06:36.885559+0000","last_clean":"2023-10-16T20:06:36.885559+0000","last_became_active":"2023-10-16T20:06:32.753504+0000","last_became_peered":"2023-10-16T20:06:32.753504+0000","last_unstale":"2023-10-16T20:06:36.885559+0000","last_undegraded":"2023-10-16T20:06:36.885559+0000","last_fullsized":"2023-10-16T20:06:36.885559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.876963+0000","last_change":"2023-10-16T20:06:37.202096+0000","last_active":"2023-10-16T20:06:37.876963+0000","last_peered":"2023-10-16T20:06:37.876963+0000","last_clean":"2023-10-16T20:06:37.876963+0000","last_became_active":"2023-10-16T20:06:37.201491+0000","last_became_peered":"2023-10-16T20:06:37.201491+0000","last_unstale":"2023-10-16T20:06:37.876963+0000","last_undegraded":"2023-10-16T20:06:37.876963+0000","last_fullsized":"2023-10-16T20:06:37.876963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886132+0000","last_change":"2023-10-16T20:06:31.757976+0000","last_active":"2023-10-16T20:06:36.886132+0000","last_peered":"2023-10-16T20:06:36.886132+0000","last_clean":"2023-10-16T20:06:36.886132+0000","last_became_active":"2023-10-16T20:06:31.757076+0000","last_became_peered":"2023-10-16T20:06:31.757076+0000","last_unstale":"2023-10-16T20:06:36.886132+0000","last_undegraded":"2023-10-16T20:06:36.886132+0000","last_fullsized":"2023-10-16T20:06:36.886132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:14.095040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893777+0000","last_change":"2023-10-16T20:06:32.762472+0000","last_active":"2023-10-16T20:06:36.893777+0000","last_peered":"2023-10-16T20:06:36.893777+0000","last_clean":"2023-10-16T20:06:36.893777+0000","last_became_active":"2023-10-16T20:06:32.762178+0000","last_became_peered":"2023-10-16T20:06:32.762178+0000","last_unstale":"2023-10-16T20:06:36.893777+0000","last_undegraded":"2023-10-16T20:06:36.893777+0000","last_fullsized":"2023-10-16T20:06:36.893777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878094+0000","last_change":"2023-10-16T20:06:37.197304+0000","last_active":"2023-10-16T20:06:37.878094+0000","last_peered":"2023-10-16T20:06:37.878094+0000","last_clean":"2023-10-16T20:06:37.878094+0000","last_became_active":"2023-10-16T20:06:37.196929+0000","last_became_peered":"2023-10-16T20:06:37.196929+0000","last_unstale":"2023-10-16T20:06:37.878094+0000","last_undegraded":"2023-10-16T20:06:37.878094+0000","last_fullsized":"2023-10-16T20:06:37.878094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:50.138290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878557+0000","last_change":"2023-10-16T20:06:31.757280+0000","last_active":"2023-10-16T20:06:36.878557+0000","last_peered":"2023-10-16T20:06:36.878557+0000","last_clean":"2023-10-16T20:06:36.878557+0000","last_became_active":"2023-10-16T20:06:31.756978+0000","last_became_peered":"2023-10-16T20:06:31.756978+0000","last_unstale":"2023-10-16T20:06:36.878557+0000","last_undegraded":"2023-10-16T20:06:36.878557+0000","last_fullsized":"2023-10-16T20:06:36.878557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:45.721286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886554+0000","last_change":"2023-10-16T20:06:32.758662+0000","last_active":"2023-10-16T20:06:36.886554+0000","last_peered":"2023-10-16T20:06:36.886554+0000","last_clean":"2023-10-16T20:06:36.886554+0000","last_became_active":"2023-10-16T20:06:32.758318+0000","last_became_peered":"2023-10-16T20:06:32.758318+0000","last_unstale":"2023-10-16T20:06:36.886554+0000","last_undegraded":"2023-10-16T20:06:36.886554+0000","last_fullsized":"2023-10-16T20:06:36.886554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878944+0000","last_change":"2023-10-16T20:06:36.898893+0000","last_active":"2023-10-16T20:06:37.878944+0000","last_peered":"2023-10-16T20:06:37.878944+0000","last_clean":"2023-10-16T20:06:37.878944+0000","last_became_active":"2023-10-16T20:06:36.898502+0000","last_became_peered":"2023-10-16T20:06:36.898502+0000","last_unstale":"2023-10-16T20:06:37.878944+0000","last_undegraded":"2023-10-16T20:06:37.878944+0000","last_fullsized":"2023-10-16T20:06:37.878944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194284+0000","last_change":"2023-10-16T20:06:31.763222+0000","last_active":"2023-10-16T20:06:37.194284+0000","last_peered":"2023-10-16T20:06:37.194284+0000","last_clean":"2023-10-16T20:06:37.194284+0000","last_became_active":"2023-10-16T20:06:31.762927+0000","last_became_peered":"2023-10-16T20:06:31.762927+0000","last_unstale":"2023-10-16T20:06:37.194284+0000","last_undegraded":"2023-10-16T20:06:37.194284+0000","last_fullsized":"2023-10-16T20:06:37.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:05.818268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877358+0000","last_change":"2023-10-16T20:06:32.751479+0000","last_active":"2023-10-16T20:06:36.877358+0000","last_peered":"2023-10-16T20:06:36.877358+0000","last_clean":"2023-10-16T20:06:36.877358+0000","last_became_active":"2023-10-16T20:06:32.751190+0000","last_became_peered":"2023-10-16T20:06:32.751190+0000","last_unstale":"2023-10-16T20:06:36.877358+0000","last_undegraded":"2023-10-16T20:06:36.877358+0000","last_fullsized":"2023-10-16T20:06:36.877358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:48:45.349066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450801+0000","last_change":"2023-10-16T20:06:37.197326+0000","last_active":"2023-10-16T20:06:38.450801+0000","last_peered":"2023-10-16T20:06:38.450801+0000","last_clean":"2023-10-16T20:06:38.450801+0000","last_became_active":"2023-10-16T20:06:37.196386+0000","last_became_peered":"2023-10-16T20:06:37.196386+0000","last_unstale":"2023-10-16T20:06:38.450801+0000","last_undegraded":"2023-10-16T20:06:38.450801+0000","last_fullsized":"2023-10-16T20:06:38.450801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882771+0000","last_change":"2023-10-16T20:06:31.758660+0000","last_active":"2023-10-16T20:06:36.882771+0000","last_peered":"2023-10-16T20:06:36.882771+0000","last_clean":"2023-10-16T20:06:36.882771+0000","last_became_active":"2023-10-16T20:06:31.758394+0000","last_became_peered":"2023-10-16T20:06:31.758394+0000","last_unstale":"2023-10-16T20:06:36.882771+0000","last_undegraded":"2023-10-16T20:06:36.882771+0000","last_fullsized":"2023-10-16T20:06:36.882771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:09.405305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894178+0000","last_change":"2023-10-16T20:06:32.755401+0000","last_active":"2023-10-16T20:06:36.894178+0000","last_peered":"2023-10-16T20:06:36.894178+0000","last_clean":"2023-10-16T20:06:36.894178+0000","last_became_active":"2023-10-16T20:06:32.755107+0000","last_became_peered":"2023-10-16T20:06:32.755107+0000","last_unstale":"2023-10-16T20:06:36.894178+0000","last_undegraded":"2023-10-16T20:06:36.894178+0000","last_fullsized":"2023-10-16T20:06:36.894178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878938+0000","last_change":"2023-10-16T20:06:36.896689+0000","last_active":"2023-10-16T20:06:37.878938+0000","last_peered":"2023-10-16T20:06:37.878938+0000","last_clean":"2023-10-16T20:06:37.878938+0000","last_became_active":"2023-10-16T20:06:36.896287+0000","last_became_peered":"2023-10-16T20:06:36.896287+0000","last_unstale":"2023-10-16T20:06:37.878938+0000","last_undegraded":"2023-10-16T20:06:37.878938+0000","last_fullsized":"2023-10-16T20:06:37.878938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:13.728727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.888301+0000","last_change":"2023-10-16T20:06:31.757230+0000","last_active":"2023-10-16T20:06:36.888301+0000","last_peered":"2023-10-16T20:06:36.888301+0000","last_clean":"2023-10-16T20:06:36.888301+0000","last_became_active":"2023-10-16T20:06:31.756944+0000","last_became_peered":"2023-10-16T20:06:31.756944+0000","last_unstale":"2023-10-16T20:06:36.888301+0000","last_undegraded":"2023-10-16T20:06:36.888301+0000","last_fullsized":"2023-10-16T20:06:36.888301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:18.395813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893812+0000","last_change":"2023-10-16T20:06:32.764333+0000","last_active":"2023-10-16T20:06:36.893812+0000","last_peered":"2023-10-16T20:06:36.893812+0000","last_clean":"2023-10-16T20:06:36.893812+0000","last_became_active":"2023-10-16T20:06:32.764136+0000","last_became_peered":"2023-10-16T20:06:32.764136+0000","last_unstale":"2023-10-16T20:06:36.893812+0000","last_undegraded":"2023-10-16T20:06:36.893812+0000","last_fullsized":"2023-10-16T20:06:36.893812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.879154+0000","last_change":"2023-10-16T20:06:36.895534+0000","last_active":"2023-10-16T20:06:37.879154+0000","last_peered":"2023-10-16T20:06:37.879154+0000","last_clean":"2023-10-16T20:06:37.879154+0000","last_became_active":"2023-10-16T20:06:36.895164+0000","last_became_peered":"2023-10-16T20:06:36.895164+0000","last_unstale":"2023-10-16T20:06:37.879154+0000","last_undegraded":"2023-10-16T20:06:37.879154+0000","last_fullsized":"2023-10-16T20:06:37.879154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194973+0000","last_change":"2023-10-16T20:06:31.760505+0000","last_active":"2023-10-16T20:06:37.194973+0000","last_peered":"2023-10-16T20:06:37.194973+0000","last_clean":"2023-10-16T20:06:37.194973+0000","last_became_active":"2023-10-16T20:06:31.760190+0000","last_became_peered":"2023-10-16T20:06:31.760190+0000","last_unstale":"2023-10-16T20:06:37.194973+0000","last_undegraded":"2023-10-16T20:06:37.194973+0000","last_fullsized":"2023-10-16T20:06:37.194973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876944+0000","last_change":"2023-10-16T20:06:32.757975+0000","last_active":"2023-10-16T20:06:36.876944+0000","last_peered":"2023-10-16T20:06:36.876944+0000","last_clean":"2023-10-16T20:06:36.876944+0000","last_became_active":"2023-10-16T20:06:32.757179+0000","last_became_peered":"2023-10-16T20:06:32.757179+0000","last_unstale":"2023-10-16T20:06:36.876944+0000","last_undegraded":"2023-10-16T20:06:36.876944+0000","last_fullsized":"2023-10-16T20:06:36.876944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:29.983467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878473+0000","last_change":"2023-10-16T20:06:37.197542+0000","last_active":"2023-10-16T20:06:37.878473+0000","last_peered":"2023-10-16T20:06:37.878473+0000","last_clean":"2023-10-16T20:06:37.878473+0000","last_became_active":"2023-10-16T20:06:37.196312+0000","last_became_peered":"2023-10-16T20:06:37.196312+0000","last_unstale":"2023-10-16T20:06:37.878473+0000","last_undegraded":"2023-10-16T20:06:37.878473+0000","last_fullsized":"2023-10-16T20:06:37.878473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:40.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876859+0000","last_change":"2023-10-16T20:06:31.763508+0000","last_active":"2023-10-16T20:06:36.876859+0000","last_peered":"2023-10-16T20:06:36.876859+0000","last_clean":"2023-10-16T20:06:36.876859+0000","last_became_active":"2023-10-16T20:06:31.763228+0000","last_became_peered":"2023-10-16T20:06:31.763228+0000","last_unstale":"2023-10-16T20:06:36.876859+0000","last_undegraded":"2023-10-16T20:06:36.876859+0000","last_fullsized":"2023-10-16T20:06:36.876859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:33.157086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195141+0000","last_change":"2023-10-16T20:06:32.767619+0000","last_active":"2023-10-16T20:06:37.195141+0000","last_peered":"2023-10-16T20:06:37.195141+0000","last_clean":"2023-10-16T20:06:37.195141+0000","last_became_active":"2023-10-16T20:06:32.767368+0000","last_became_peered":"2023-10-16T20:06:32.767368+0000","last_unstale":"2023-10-16T20:06:37.195141+0000","last_undegraded":"2023-10-16T20:06:37.195141+0000","last_fullsized":"2023-10-16T20:06:37.195141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449240+0000","last_change":"2023-10-16T20:06:36.896747+0000","last_active":"2023-10-16T20:06:38.449240+0000","last_peered":"2023-10-16T20:06:38.449240+0000","last_clean":"2023-10-16T20:06:38.449240+0000","last_became_active":"2023-10-16T20:06:36.896380+0000","last_became_peered":"2023-10-16T20:06:36.896380+0000","last_unstale":"2023-10-16T20:06:38.449240+0000","last_undegraded":"2023-10-16T20:06:38.449240+0000","last_fullsized":"2023-10-16T20:06:38.449240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:53:20.477418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881480+0000","last_change":"2023-10-16T20:06:31.757781+0000","last_active":"2023-10-16T20:06:36.881480+0000","last_peered":"2023-10-16T20:06:36.881480+0000","last_clean":"2023-10-16T20:06:36.881480+0000","last_became_active":"2023-10-16T20:06:31.757507+0000","last_became_peered":"2023-10-16T20:06:31.757507+0000","last_unstale":"2023-10-16T20:06:36.881480+0000","last_undegraded":"2023-10-16T20:06:36.881480+0000","last_fullsized":"2023-10-16T20:06:36.881480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.762052+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761502+0000","last_became_peered":"2023-10-16T20:06:32.761502+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356361+0000","last_change":"2023-10-16T20:06:37.196931+0000","last_active":"2023-10-16T20:06:38.356361+0000","last_peered":"2023-10-16T20:06:38.356361+0000","last_clean":"2023-10-16T20:06:38.356361+0000","last_became_active":"2023-10-16T20:06:37.196429+0000","last_became_peered":"2023-10-16T20:06:37.196429+0000","last_unstale":"2023-10-16T20:06:38.356361+0000","last_undegraded":"2023-10-16T20:06:38.356361+0000","last_fullsized":"2023-10-16T20:06:38.356361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:39:01.567948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876429+0000","last_change":"2023-10-16T20:06:31.754869+0000","last_active":"2023-10-16T20:06:36.876429+0000","last_peered":"2023-10-16T20:06:36.876429+0000","last_clean":"2023-10-16T20:06:36.876429+0000","last_became_active":"2023-10-16T20:06:31.754563+0000","last_became_peered":"2023-10-16T20:06:31.754563+0000","last_unstale":"2023-10-16T20:06:36.876429+0000","last_undegraded":"2023-10-16T20:06:36.876429+0000","last_fullsized":"2023-10-16T20:06:36.876429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:05.294644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195284+0000","last_change":"2023-10-16T20:06:32.761436+0000","last_active":"2023-10-16T20:06:37.195284+0000","last_peered":"2023-10-16T20:06:37.195284+0000","last_clean":"2023-10-16T20:06:37.195284+0000","last_became_active":"2023-10-16T20:06:32.761077+0000","last_became_peered":"2023-10-16T20:06:32.761077+0000","last_unstale":"2023-10-16T20:06:37.195284+0000","last_undegraded":"2023-10-16T20:06:37.195284+0000","last_fullsized":"2023-10-16T20:06:37.195284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876172+0000","last_change":"2023-10-16T20:06:32.752025+0000","last_active":"2023-10-16T20:06:36.876172+0000","last_peered":"2023-10-16T20:06:36.876172+0000","last_clean":"2023-10-16T20:06:36.876172+0000","last_became_active":"2023-10-16T20:06:32.751719+0000","last_became_peered":"2023-10-16T20:06:32.751719+0000","last_unstale":"2023-10-16T20:06:36.876172+0000","last_undegraded":"2023-10-16T20:06:36.876172+0000","last_fullsized":"2023-10-16T20:06:36.876172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:37.646684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876358+0000","last_change":"2023-10-16T20:06:32.761262+0000","last_active":"2023-10-16T20:06:36.876358+0000","last_peered":"2023-10-16T20:06:36.876358+0000","last_clean":"2023-10-16T20:06:36.876358+0000","last_became_active":"2023-10-16T20:06:32.760953+0000","last_became_peered":"2023-10-16T20:06:32.760953+0000","last_unstale":"2023-10-16T20:06:36.876358+0000","last_undegraded":"2023-10-16T20:06:36.876358+0000","last_fullsized":"2023-10-16T20:06:36.876358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:06.488740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884781+0000","last_change":"2023-10-16T20:06:32.761797+0000","last_active":"2023-10-16T20:06:36.884781+0000","last_peered":"2023-10-16T20:06:36.884781+0000","last_clean":"2023-10-16T20:06:36.884781+0000","last_became_active":"2023-10-16T20:06:32.761070+0000","last_became_peered":"2023-10-16T20:06:32.761070+0000","last_unstale":"2023-10-16T20:06:36.884781+0000","last_undegraded":"2023-10-16T20:06:36.884781+0000","last_fullsized":"2023-10-16T20:06:36.884781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881499+0000","last_change":"2023-10-16T20:06:32.757941+0000","last_active":"2023-10-16T20:06:36.881499+0000","last_peered":"2023-10-16T20:06:36.881499+0000","last_clean":"2023-10-16T20:06:36.881499+0000","last_became_active":"2023-10-16T20:06:32.757491+0000","last_became_peered":"2023-10-16T20:06:32.757491+0000","last_unstale":"2023-10-16T20:06:36.881499+0000","last_undegraded":"2023-10-16T20:06:36.881499+0000","last_fullsized":"2023-10-16T20:06:36.881499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893744+0000","last_change":"2023-10-16T20:06:32.757680+0000","last_active":"2023-10-16T20:06:36.893744+0000","last_peered":"2023-10-16T20:06:36.893744+0000","last_clean":"2023-10-16T20:06:36.893744+0000","last_became_active":"2023-10-16T20:06:32.756906+0000","last_became_peered":"2023-10-16T20:06:32.756906+0000","last_unstale":"2023-10-16T20:06:36.893744+0000","last_undegraded":"2023-10-16T20:06:36.893744+0000","last_fullsized":"2023-10-16T20:06:36.893744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881387+0000","last_change":"2023-10-16T20:06:32.756667+0000","last_active":"2023-10-16T20:06:36.881387+0000","last_peered":"2023-10-16T20:06:36.881387+0000","last_clean":"2023-10-16T20:06:36.881387+0000","last_became_active":"2023-10-16T20:06:32.756338+0000","last_became_peered":"2023-10-16T20:06:32.756338+0000","last_unstale":"2023-10-16T20:06:36.881387+0000","last_undegraded":"2023-10-16T20:06:36.881387+0000","last_fullsized":"2023-10-16T20:06:36.881387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878209+0000","last_change":"2023-10-16T20:06:32.761903+0000","last_active":"2023-10-16T20:06:36.878209+0000","last_peered":"2023-10-16T20:06:36.878209+0000","last_clean":"2023-10-16T20:06:36.878209+0000","last_became_active":"2023-10-16T20:06:32.761404+0000","last_became_peered":"2023-10-16T20:06:32.761404+0000","last_unstale":"2023-10-16T20:06:36.878209+0000","last_undegraded":"2023-10-16T20:06:36.878209+0000","last_fullsized":"2023-10-16T20:06:36.878209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893877+0000","last_change":"2023-10-16T20:06:32.759025+0000","last_active":"2023-10-16T20:06:36.893877+0000","last_peered":"2023-10-16T20:06:36.893877+0000","last_clean":"2023-10-16T20:06:36.893877+0000","last_became_active":"2023-10-16T20:06:32.757378+0000","last_became_peered":"2023-10-16T20:06:32.757378+0000","last_unstale":"2023-10-16T20:06:36.893877+0000","last_undegraded":"2023-10-16T20:06:36.893877+0000","last_fullsized":"2023-10-16T20:06:36.893877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884696+0000","last_change":"2023-10-16T20:06:32.765641+0000","last_active":"2023-10-16T20:06:36.884696+0000","last_peered":"2023-10-16T20:06:36.884696+0000","last_clean":"2023-10-16T20:06:36.884696+0000","last_became_active":"2023-10-16T20:06:32.765108+0000","last_became_peered":"2023-10-16T20:06:32.765108+0000","last_unstale":"2023-10-16T20:06:36.884696+0000","last_undegraded":"2023-10-16T20:06:36.884696+0000","last_fullsized":"2023-10-16T20:06:36.884696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:46.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893441+0000","last_change":"2023-10-16T20:06:32.760384+0000","last_active":"2023-10-16T20:06:36.893441+0000","last_peered":"2023-10-16T20:06:36.893441+0000","last_clean":"2023-10-16T20:06:36.893441+0000","last_became_active":"2023-10-16T20:06:32.760069+0000","last_became_peered":"2023-10-16T20:06:32.760069+0000","last_unstale":"2023-10-16T20:06:36.893441+0000","last_undegraded":"2023-10-16T20:06:36.893441+0000","last_fullsized":"2023-10-16T20:06:36.893441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884891+0000","last_change":"2023-10-16T20:06:32.769882+0000","last_active":"2023-10-16T20:06:36.884891+0000","last_peered":"2023-10-16T20:06:36.884891+0000","last_clean":"2023-10-16T20:06:36.884891+0000","last_became_active":"2023-10-16T20:06:32.769593+0000","last_became_peered":"2023-10-16T20:06:32.769593+0000","last_unstale":"2023-10-16T20:06:36.884891+0000","last_undegraded":"2023-10-16T20:06:36.884891+0000","last_fullsized":"2023-10-16T20:06:36.884891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881557+0000","last_change":"2023-10-16T20:06:32.762249+0000","last_active":"2023-10-16T20:06:36.881557+0000","last_peered":"2023-10-16T20:06:36.881557+0000","last_clean":"2023-10-16T20:06:36.881557+0000","last_became_active":"2023-10-16T20:06:32.761895+0000","last_became_peered":"2023-10-16T20:06:32.761895+0000","last_unstale":"2023-10-16T20:06:36.881557+0000","last_undegraded":"2023-10-16T20:06:36.881557+0000","last_fullsized":"2023-10-16T20:06:36.881557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877279+0000","last_change":"2023-10-16T20:06:32.755725+0000","last_active":"2023-10-16T20:06:36.877279+0000","last_peered":"2023-10-16T20:06:36.877279+0000","last_clean":"2023-10-16T20:06:36.877279+0000","last_became_active":"2023-10-16T20:06:32.755462+0000","last_became_peered":"2023-10-16T20:06:32.755462+0000","last_unstale":"2023-10-16T20:06:36.877279+0000","last_undegraded":"2023-10-16T20:06:36.877279+0000","last_fullsized":"2023-10-16T20:06:36.877279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:22.618540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":697134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":106274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:06:51.390 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T20:06:51.390 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T20:06:51.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T20:06:51.391 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T20:06:51.391 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T20:06:51.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.541+0000 7f14e4cbd700 1 Processor -- start 2023-10-16T20:06:51.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.541+0000 7f14e4cbd700 1 -- start start 2023-10-16T20:06:51.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14e4cbd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e00cf7d0 0x7f14e015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14e4cbd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f14e00ca7d0 0x7f14e0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14e4cbd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00cfeb0 con 0x7f14e006a820 2023-10-16T20:06:51.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14e4cbd700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00ce410 con 0x7f14e00ca7d0 2023-10-16T20:06:51.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14e4cbd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00cfc30 con 0x7f14e00cf7d0 2023-10-16T20:06:51.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14ded9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f14e00ca7d0 0x7f14e0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14de59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f14e006a820 0x7f14e006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38936/0 (socket says 172.21.15.152:38936) 2023-10-16T20:06:51.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.542+0000 7f14de59c700 1 -- 172.21.15.152:0/1230052052 learned_addr learned my addr 172.21.15.152:0/1230052052 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:51.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14ddd9b700 1 --2- 172.21.15.152:0/1230052052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e00cf7d0 0x7f14e015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14ded9d700 1 -- 172.21.15.152:0/1230052052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e00cf7d0 msgr2=0x7f14e015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:51.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14ded9d700 1 --2- 172.21.15.152:0/1230052052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e00cf7d0 0x7f14e015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14ded9d700 1 -- 172.21.15.152:0/1230052052 >> v1:172.21.15.152:6789/0 conn(0x7f14e006a820 legacy=0x7f14e006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14ded9d700 1 -- 172.21.15.152:0/1230052052 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00af9d0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14ded9d700 1 --2- 172.21.15.152:0/1230052052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e0071ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009d90 tx=0x7f14d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2eaa46849fff93 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14dd59a700 1 -- 172.21.15.152:0/1230052052 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800e070 con 0x7f14e00ca7d0 2023-10-16T20:06:51.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14dd59a700 1 -- 172.21.15.152:0/1230052052 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800bbd0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.543+0000 7f14dd59a700 1 -- 172.21.15.152:0/1230052052 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8012430 con 0x7f14e00ca7d0 2023-10-16T20:06:51.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1230052052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 msgr2=0x7f14e0071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1230052052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e0071ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009d90 tx=0x7f14d800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:51.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1230052052 shutdown_connections 2023-10-16T20:06:51.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1230052052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e0071ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1230052052 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e00cf7d0 0x7f14e015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1230052052 >> 172.21.15.152:0/1230052052 conn(0x7f14e00d0180 msgr2=0x7f14e00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:51.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1230052052 shutdown_connections 2023-10-16T20:06:51.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.544+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1230052052 wait complete. 2023-10-16T20:06:51.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.545+0000 7f14e4cbd700 1 Processor -- start 2023-10-16T20:06:51.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.545+0000 7f14e4cbd700 1 -- start start 2023-10-16T20:06:51.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14e4cbd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e006a820 0x7f14e01f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14e4cbd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14e4cbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14e00cf7d0 0x7f14e00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14e4cbd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e01f2fb0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14e4cbd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c7f30 con 0x7f14e00cf7d0 2023-10-16T20:06:51.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14e4cbd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c8210 con 0x7f14e006a820 2023-10-16T20:06:51.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e00c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58746/0 (socket says 172.21.15.152:58746) 2023-10-16T20:06:51.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14de59c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e006a820 0x7f14e01f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 -- 172.21.15.152:0/1279171162 learned_addr learned my addr 172.21.15.152:0/1279171162 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:51.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ded9d700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14e00cf7d0 0x7f14e00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 -- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e006a820 msgr2=0x7f14e01f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e006a820 0x7f14e01f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 -- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14e00cf7d0 msgr2=0x7f14e00c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14e00cf7d0 0x7f14e00c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 -- 172.21.15.152:0/1279171162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8009a70 con 0x7f14e00ca7d0 2023-10-16T20:06:51.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.546+0000 7f14ddd9b700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e00c42c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14d000d800 tx=0x7f14d000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.547+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00125f0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.547+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0012750 con 0x7f14e00ca7d0 2023-10-16T20:06:51.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.547+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e00c84f0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.547+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0012b00 con 0x7f14e00ca7d0 2023-10-16T20:06:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.547+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e00c8ab0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.548+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e004ebb0 con 0x7f14e00ca7d0 2023-10-16T20:06:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.548+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14d0012c60 con 0x7f14e00ca7d0 2023-10-16T20:06:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.548+0000 7f14ceffd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14c006af00 0x7f14c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.548+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f14d0089900 con 0x7f14e00ca7d0 2023-10-16T20:06:51.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.548+0000 7f14de59c700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14c006af00 0x7f14c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.549+0000 7f14de59c700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14c006af00 0x7f14c006d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005910 tx=0x7f14d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.553+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14d0054770 con 0x7f14e00ca7d0 2023-10-16T20:06:51.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.798+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f14e00b0600 con 0x7f14e00ca7d0 2023-10-16T20:06:51.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.801+0000 7f14ceffd700 1 -- 172.21.15.152:0/1279171162 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171037 (secure 0 0 0) 0x7f14d0057d90 con 0x7f14e00ca7d0 2023-10-16T20:06:51.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:51.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14c006af00 msgr2=0x7f14c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14c006af00 0x7f14c006d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005910 tx=0x7f14d4009040 comp rx=0 tx=0).stop 2023-10-16T20:06:51.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 msgr2=0x7f14e00c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e00c42c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14d000d800 tx=0x7f14d000db10 comp rx=0 tx=0).stop 2023-10-16T20:06:51.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 shutdown_connections 2023-10-16T20:06:51.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14c006af00 0x7f14c006d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14e006a820 0x7f14e01f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14e00cf7d0 0x7f14e00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 --2- 172.21.15.152:0/1279171162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14e00ca7d0 0x7f14e00c42c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 >> 172.21.15.152:0/1279171162 conn(0x7f14e00d0180 msgr2=0x7f14e00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:51.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 shutdown_connections 2023-10-16T20:06:51.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.804+0000 7f14e4cbd700 1 -- 172.21.15.152:0/1279171162 wait complete. 2023-10-16T20:06:51.818 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1955925781},{"type":"v1","addr":"172.21.15.152:6833","nonce":1955925781}]},"active_addr":"172.21.15.152:6833/1955925781","active_change":"2023-10-16T20:06:12.751518+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3320348503}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3215677394}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2535162479}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3721317335}]}]} 2023-10-16T20:06:51.822 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T20:06:51.823 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T20:06:51.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:51.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.943+0000 7f0ea5fe8700 1 Processor -- start 2023-10-16T20:06:51.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.943+0000 7f0ea5fe8700 1 -- start start 2023-10-16T20:06:51.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0ea5fe8700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0ea0071850 0x7f0ea0071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0ea5fe8700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 0x7f0ea006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0ea5fe8700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00721f0 con 0x7f0ea015daa0 2023-10-16T20:06:51.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0ea5fe8700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea015ed10 con 0x7f0ea0071850 2023-10-16T20:06:51.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0ea5fe8700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015de80 con 0x7f0ea006d100 2023-10-16T20:06:51.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 0x7f0ea006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0e9effd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0ea0071850 0x7f0ea0071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 0x7f0ea006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47404/0 (socket says 172.21.15.152:47404) 2023-10-16T20:06:51.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.944+0000 7f0e9ffff700 1 -- 172.21.15.152:0/3550484686 learned_addr learned my addr 172.21.15.152:0/3550484686 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:51.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9ffff700 1 -- 172.21.15.152:0/3550484686 >> v2:172.21.15.163:3300/0 conn(0x7f0ea0071850 msgr2=0x7f0ea0071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:51.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9ffff700 1 --2- 172.21.15.152:0/3550484686 >> v2:172.21.15.163:3300/0 conn(0x7f0ea0071850 0x7f0ea0071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9ffff700 1 -- 172.21.15.152:0/3550484686 >> v1:172.21.15.163:6789/0 conn(0x7f0ea015daa0 legacy=0x7f0ea00af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9ffff700 1 -- 172.21.15.152:0/3550484686 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea015e100 con 0x7f0ea006d100 2023-10-16T20:06:51.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9effd700 1 --2- 172.21.15.152:0/3550484686 >> v2:172.21.15.163:3300/0 conn(0x7f0ea0071850 0x7f0ea0071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:51.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9ffff700 1 --2- 172.21.15.152:0/3550484686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 0x7f0ea006d550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e980098f0 tx=0x7f0e98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8e0dab3e11d4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9e7fc700 1 -- 172.21.15.152:0/3550484686 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98005e80 con 0x7f0ea006d100 2023-10-16T20:06:51.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9e7fc700 1 -- 172.21.15.152:0/3550484686 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98006030 con 0x7f0ea006d100 2023-10-16T20:06:51.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.945+0000 7f0e9e7fc700 1 -- 172.21.15.152:0/3550484686 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980063a0 con 0x7f0ea006d100 2023-10-16T20:06:51.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/3550484686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 msgr2=0x7f0ea006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/3550484686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 0x7f0ea006d550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e980098f0 tx=0x7f0e98009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:51.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/3550484686 shutdown_connections 2023-10-16T20:06:51.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/3550484686 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea006d100 0x7f0ea006d550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/3550484686 >> v2:172.21.15.163:3300/0 conn(0x7f0ea0071850 0x7f0ea0071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/3550484686 >> 172.21.15.152:0/3550484686 conn(0x7f0ea00d0180 msgr2=0x7f0ea00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:51.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/3550484686 shutdown_connections 2023-10-16T20:06:51.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.946+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/3550484686 wait complete. 2023-10-16T20:06:51.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.947+0000 7f0ea5fe8700 1 Processor -- start 2023-10-16T20:06:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.947+0000 7f0ea5fe8700 1 -- start start 2023-10-16T20:06:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0ea5fe8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 0x7f0ea01579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0ea5fe8700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea0071850 0x7f0ea00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0ea5fe8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea015daa0 0x7f0ea00afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0ea5fe8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00c48a0 con 0x7f0ea006d100 2023-10-16T20:06:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0ea5fe8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00c3c90 con 0x7f0ea015daa0 2023-10-16T20:06:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0ea5fe8700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00c3f70 con 0x7f0ea0071850 2023-10-16T20:06:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 0x7f0ea01579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 0x7f0ea01579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58756/0 (socket says 172.21.15.152:58756) 2023-10-16T20:06:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 -- 172.21.15.152:0/1221700479 learned_addr learned my addr 172.21.15.152:0/1221700479 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9effd700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea0071850 0x7f0ea00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9ffff700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea015daa0 0x7f0ea00afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 -- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea0071850 msgr2=0x7f0ea00c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea0071850 0x7f0ea00c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 -- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea015daa0 msgr2=0x7f0ea00afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea015daa0 0x7f0ea00afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.948+0000 7f0e9f7fe700 1 -- 172.21.15.152:0/1221700479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880094a0 con 0x7f0ea006d100 2023-10-16T20:06:51.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.949+0000 7f0e9f7fe700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 0x7f0ea01579b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000cbd0 tx=0x7f0e9000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.949+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90003c00 con 0x7f0ea006d100 2023-10-16T20:06:51.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.949+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90003d60 con 0x7f0ea006d100 2023-10-16T20:06:51.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.949+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e98009550 con 0x7f0ea006d100 2023-10-16T20:06:51.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.949+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000aae0 con 0x7f0ea006d100 2023-10-16T20:06:51.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.949+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea00c4530 con 0x7f0ea006d100 2023-10-16T20:06:51.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.950+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea004ebb0 con 0x7f0ea006d100 2023-10-16T20:06:51.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.950+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e9000ac40 con 0x7f0ea006d100 2023-10-16T20:06:51.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.951+0000 7f0e97fff700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0e8006af00 0x7f0e8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:51.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.951+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e900897f0 con 0x7f0ea006d100 2023-10-16T20:06:51.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.951+0000 7f0e9effd700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0e8006af00 0x7f0e8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:51.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.951+0000 7f0e9effd700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0e8006af00 0x7f0e8006d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00c31a0 tx=0x7f0e88009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:51.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:51.955+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e90054640 con 0x7f0ea006d100 2023-10-16T20:06:52.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.158+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ea0072690 con 0x7f0ea006d100 2023-10-16T20:06:52.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.159+0000 7f0e97fff700 1 -- 172.21.15.152:0/1221700479 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f0e90057c60 con 0x7f0ea006d100 2023-10-16T20:06:52.161 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:52.162 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:52.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0e8006af00 msgr2=0x7f0e8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0e8006af00 0x7f0e8006d3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00c31a0 tx=0x7f0e88009210 comp rx=0 tx=0).stop 2023-10-16T20:06:52.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 msgr2=0x7f0ea01579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 0x7f0ea01579b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000cbd0 tx=0x7f0e9000cee0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 shutdown_connections 2023-10-16T20:06:52.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0e8006af00 0x7f0e8006d3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ea015daa0 0x7f0ea00afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ea006d100 0x7f0ea01579b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 --2- 172.21.15.152:0/1221700479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ea0071850 0x7f0ea00c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 >> 172.21.15.152:0/1221700479 conn(0x7f0ea00d0180 msgr2=0x7f0ea00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 shutdown_connections 2023-10-16T20:06:52.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.161+0000 7f0ea5fe8700 1 -- 172.21.15.152:0/1221700479 wait complete. 2023-10-16T20:06:52.175 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T20:06:52.176 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:52.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.295+0000 7fd21c76f700 1 Processor -- start 2023-10-16T20:06:52.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.295+0000 7fd21c76f700 1 -- start start 2023-10-16T20:06:52.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21c76f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd2140ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21c76f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd21415ec60 0x7fd2140c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21c76f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd2140cab90 0x7fd2140c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21c76f700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140ccb90 con 0x7fd2140cab90 2023-10-16T20:06:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21c76f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140cce70 con 0x7fd21415ec60 2023-10-16T20:06:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21c76f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140cb0c0 con 0x7fd214143c50 2023-10-16T20:06:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd2140cab90 0x7fd2140c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd2140cab90 0x7fd2140c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58768/0 (socket says 172.21.15.152:58768) 2023-10-16T20:06:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 -- 172.21.15.152:0/536393527 learned_addr learned my addr 172.21.15.152:0/536393527 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21a50b700 1 --2- 172.21.15.152:0/536393527 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd2140ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd219d0a700 1 --2- 172.21.15.152:0/536393527 >> v2:172.21.15.163:3300/0 conn(0x7fd21415ec60 0x7fd2140c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 -- 172.21.15.152:0/536393527 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 msgr2=0x7fd2140ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 --2- 172.21.15.152:0/536393527 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd2140ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 -- 172.21.15.152:0/536393527 >> v2:172.21.15.163:3300/0 conn(0x7fd21415ec60 msgr2=0x7fd2140c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 --2- 172.21.15.152:0/536393527 >> v2:172.21.15.163:3300/0 conn(0x7fd21415ec60 0x7fd2140c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.296+0000 7fd21ad0c700 1 -- 172.21.15.152:0/536393527 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140cb3a0 con 0x7fd2140cab90 2023-10-16T20:06:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd219d0a700 1 --2- 172.21.15.152:0/536393527 >> v2:172.21.15.163:3300/0 conn(0x7fd21415ec60 0x7fd2140c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21ad0c700 1 --2- 172.21.15.152:0/536393527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2140c5560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd21406c2b0 tx=0x7fd20c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff375cbf1a7aa5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd219509700 1 -- 172.21.15.152:0/536393527 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c010070 con 0x7fd2140cab90 2023-10-16T20:06:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd219509700 1 -- 172.21.15.152:0/536393527 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00dce0 con 0x7fd2140cab90 2023-10-16T20:06:52.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd219509700 1 -- 172.21.15.152:0/536393527 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00b310 con 0x7fd2140cab90 2023-10-16T20:06:52.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 -- 172.21.15.152:0/536393527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 msgr2=0x7fd2140c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 --2- 172.21.15.152:0/536393527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2140c5560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd21406c2b0 tx=0x7fd20c00d430 comp rx=0 tx=0).stop 2023-10-16T20:06:52.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 -- 172.21.15.152:0/536393527 shutdown_connections 2023-10-16T20:06:52.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 --2- 172.21.15.152:0/536393527 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd2140ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 --2- 172.21.15.152:0/536393527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2140c5560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 --2- 172.21.15.152:0/536393527 >> v2:172.21.15.163:3300/0 conn(0x7fd21415ec60 0x7fd2140c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 -- 172.21.15.152:0/536393527 >> 172.21.15.152:0/536393527 conn(0x7fd21406c850 msgr2=0x7fd21406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 -- 172.21.15.152:0/536393527 shutdown_connections 2023-10-16T20:06:52.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.297+0000 7fd21c76f700 1 -- 172.21.15.152:0/536393527 wait complete. 2023-10-16T20:06:52.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 Processor -- start 2023-10-16T20:06:52.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 -- start start 2023-10-16T20:06:52.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2141ee690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd21413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd21415ec60 0x7fd21413d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21413c760 con 0x7fd2140cab90 2023-10-16T20:06:52.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21413b6c0 con 0x7fd21415ec60 2023-10-16T20:06:52.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21c76f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21413b9a0 con 0x7fd214143c50 2023-10-16T20:06:52.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21a50b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2141ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21a50b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2141ee690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58770/0 (socket says 172.21.15.152:58770) 2023-10-16T20:06:52.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.299+0000 7fd21a50b700 1 -- 172.21.15.152:0/555196089 learned_addr learned my addr 172.21.15.152:0/555196089 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21ad0c700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd21415ec60 0x7fd21413d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd219d0a700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd21413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21a50b700 1 -- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 msgr2=0x7fd21413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21a50b700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd21413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21a50b700 1 -- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd21415ec60 msgr2=0x7fd21413d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21a50b700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd21415ec60 0x7fd21413d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21a50b700 1 -- 172.21.15.152:0/555196089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c00bd40 con 0x7fd2140cab90 2023-10-16T20:06:52.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21ad0c700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd21415ec60 0x7fd21413d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:52.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd219d0a700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd21413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:52.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21a50b700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2141ee690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd20400e9b0 tx=0x7fd20400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040096b0 con 0x7fd2140cab90 2023-10-16T20:06:52.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400c7f0 con 0x7fd2140cab90 2023-10-16T20:06:52.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21413bc80 con 0x7fd2140cab90 2023-10-16T20:06:52.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400cb80 con 0x7fd2140cab90 2023-10-16T20:06:52.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.300+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21413c240 con 0x7fd2140cab90 2023-10-16T20:06:52.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.301+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21404f400 con 0x7fd2140cab90 2023-10-16T20:06:52.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.301+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd20400cce0 con 0x7fd2140cab90 2023-10-16T20:06:52.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.302+0000 7fd20affd700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd1f806af00 0x7fd1f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.302+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd204089960 con 0x7fd2140cab90 2023-10-16T20:06:52.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.302+0000 7fd219d0a700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd1f806af00 0x7fd1f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.302+0000 7fd219d0a700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd1f806af00 0x7fd1f806d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd214139480 tx=0x7fd210008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.306+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd2040547b0 con 0x7fd2140cab90 2023-10-16T20:06:52.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.498+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd21404ebb0 con 0x7fd2140cab90 2023-10-16T20:06:52.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.499+0000 7fd20affd700 1 -- 172.21.15.152:0/555196089 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fd204057dd0 con 0x7fd2140cab90 2023-10-16T20:06:52.502 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:52.502 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:52.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.501+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd1f806af00 msgr2=0x7fd1f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.501+0000 7fd21c76f700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd1f806af00 0x7fd1f806d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd214139480 tx=0x7fd210008040 comp rx=0 tx=0).stop 2023-10-16T20:06:52.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.501+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 msgr2=0x7fd2141ee690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.501+0000 7fd21c76f700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2141ee690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd20400e9b0 tx=0x7fd20400ed70 comp rx=0 tx=0).stop 2023-10-16T20:06:52.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 shutdown_connections 2023-10-16T20:06:52.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd1f806af00 0x7fd1f806d3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd21415ec60 0x7fd21413d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2140cab90 0x7fd2141ee690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 --2- 172.21.15.152:0/555196089 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd214143c50 0x7fd21413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 >> 172.21.15.152:0/555196089 conn(0x7fd21406c850 msgr2=0x7fd214141770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 shutdown_connections 2023-10-16T20:06:52.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.502+0000 7fd21c76f700 1 -- 172.21.15.152:0/555196089 wait complete. 2023-10-16T20:06:52.516 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T20:06:52.516 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T20:06:52.517 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T20:06:52.517 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T20:06:52.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T20:06:52.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T20:06:52.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T20:06:52.520 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T20:06:52.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.728+0000 7fd8a35c3700 1 Processor -- start 2023-10-16T20:06:52.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.729+0000 7fd8a35c3700 1 -- start start 2023-10-16T20:06:52.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.729+0000 7ffa3b193700 1 Processor -- start 2023-10-16T20:06:52.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.729+0000 7ffa3b193700 1 -- start start 2023-10-16T20:06:52.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fca34aac700 1 Processor -- start 2023-10-16T20:06:52.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.729+0000 7ff583547700 1 Processor -- start 2023-10-16T20:06:52.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7ff583547700 1 -- start start 2023-10-16T20:06:52.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fd8a35c3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fd8a35c3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd89c144de0 0x7fd89c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fd8a35c3700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c06e410 con 0x7fd89c0710e0 2023-10-16T20:06:52.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fd8a35c3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c0c54e0 con 0x7fd89c144de0 2023-10-16T20:06:52.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fd8a35c3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0c57c0 con 0x7fd89c06daf0 2023-10-16T20:06:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7ffa3b193700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa340cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7ffa3b193700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa340b9000 0x7ffa340ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7ffa3b193700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340b94b0 con 0x7ffa34160b50 2023-10-16T20:06:52.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7ffa3b193700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340d0010 con 0x7ffa340b9000 2023-10-16T20:06:52.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa3b193700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340d02f0 con 0x7ffa340b5700 2023-10-16T20:06:52.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa340cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa340cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47436/0 (socket says 172.21.15.152:47436) 2023-10-16T20:06:52.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 -- 172.21.15.152:0/3593084828 learned_addr learned my addr 172.21.15.152:0/3593084828 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa39730700 1 --2- 172.21.15.152:0/3593084828 >> v2:172.21.15.152:3300/0 conn(0x7ffa340b9000 0x7ffa340ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 -- 172.21.15.152:0/3593084828 >> v2:172.21.15.152:3300/0 conn(0x7ffa340b9000 msgr2=0x7ffa340ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 --2- 172.21.15.152:0/3593084828 >> v2:172.21.15.152:3300/0 conn(0x7ffa340b9000 0x7ffa340ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 -- 172.21.15.152:0/3593084828 >> v1:172.21.15.152:6789/0 conn(0x7ffa34160b50 legacy=0x7ffa340b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ffa33fff700 1 -- 172.21.15.152:0/3593084828 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340d05d0 con 0x7ffa340b5700 2023-10-16T20:06:52.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ffa33fff700 1 --2- 172.21.15.152:0/3593084828 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa340cf980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa280098f0 tx=0x7ffa28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1698175fdbed3a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a0b5e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd89c144de0 0x7fd89c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a135f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a1b60700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fd89c0710e0 0x7fd89c071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54158/0 (socket says 172.21.15.152:54158) 2023-10-16T20:06:52.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a1b60700 1 -- 172.21.15.152:0/3364251185 learned_addr learned my addr 172.21.15.152:0/3364251185 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:52.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fca34aac700 1 -- start start 2023-10-16T20:06:52.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca34aac700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fca3006daf0 0x7fca3006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca34aac700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300cb210 0x7fca300705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca34aac700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300c9a30 con 0x7fca3006eb10 2023-10-16T20:06:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca34aac700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3006e410 con 0x7fca3006daf0 2023-10-16T20:06:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca34aac700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c9cd0 con 0x7fca300cb210 2023-10-16T20:06:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ff583547700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff57c0cd5a0 0x7ff57c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ff583547700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0c4970 con 0x7ff57c06daf0 2023-10-16T20:06:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ff583547700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0c4040 con 0x7ff57c0cb230 2023-10-16T20:06:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ff583547700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0c4320 con 0x7ff57c0cd5a0 2023-10-16T20:06:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ff5812e3700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff57c06daf0 0x7ff57c06ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38988/0 (socket says 172.21.15.152:38988) 2023-10-16T20:06:52.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7ff5812e3700 1 -- 172.21.15.152:0/2591647919 learned_addr learned my addr 172.21.15.152:0/2591647919 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:52.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2591647919 >> v2:172.21.15.163:3300/0 conn(0x7ff57c0cd5a0 0x7ff57c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271661787 0 0) 0x7ff57c0c4970 con 0x7ff57c06daf0 2023-10-16T20:06:52.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5680035b0 con 0x7ff57c06daf0 2023-10-16T20:06:52.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca2ed9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fca3006eb10 0x7fca30070b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38994/0 (socket says 172.21.15.152:38994) 2023-10-16T20:06:52.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fca2ed9d700 1 -- 172.21.15.152:0/4038581092 learned_addr learned my addr 172.21.15.152:0/4038581092 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:52.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.730+0000 7fb9127bc700 1 Processor -- start 2023-10-16T20:06:52.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.731+0000 7fb9127bc700 1 -- start start 2023-10-16T20:06:52.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb9127bc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb9127bc700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c15e1b0 con 0x7fb90c0cb400 2023-10-16T20:06:52.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb9127bc700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c15de60 con 0x7fb90c15a240 2023-10-16T20:06:52.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb9127bc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0af980 con 0x7fb90c0aefb0 2023-10-16T20:06:52.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ffa337fe700 1 -- 172.21.15.152:0/3593084828 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800b8a0 con 0x7ffa340b5700 2023-10-16T20:06:52.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ffa337fe700 1 -- 172.21.15.152:0/3593084828 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800ba00 con 0x7ffa340b5700 2023-10-16T20:06:52.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd88ffff700 1 -- 172.21.15.152:0/3364251185 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353996822 0 0) 0x7fd89c06e410 con 0x7fd89c0710e0 2023-10-16T20:06:52.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd88ffff700 1 -- 172.21.15.152:0/3364251185 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8880035b0 con 0x7fd89c0710e0 2023-10-16T20:06:52.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520455670 0 0) 0x7fca300c9a30 con 0x7fca3006eb10 2023-10-16T20:06:52.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca180035b0 con 0x7fca3006eb10 2023-10-16T20:06:52.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579509485 0 0) 0x7ff57c0c4040 con 0x7ff57c0cb230 2023-10-16T20:06:52.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff57c0c4970 con 0x7ff57c0cb230 2023-10-16T20:06:52.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182620870 0 0) 0x7ff5680035b0 con 0x7ff57c06daf0 2023-10-16T20:06:52.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 >> v2:172.21.15.163:3300/0 conn(0x7ff57c0cd5a0 msgr2=0x7ff57c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 --2- 172.21.15.152:0/2591647919 >> v2:172.21.15.163:3300/0 conn(0x7ff57c0cd5a0 0x7ff57c0c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 >> v1:172.21.15.163:6789/0 conn(0x7ff57c0cb230 legacy=0x7ff57c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0c4600 con 0x7ff57c06daf0 2023-10-16T20:06:52.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7ff5780019f0 con 0x7ff57c06daf0 2023-10-16T20:06:52.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 >> v1:172.21.15.152:6789/0 conn(0x7ff57c06daf0 legacy=0x7ff57c06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff568003b90 0x7ff568003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff568004850 0x7ff568004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568005210 0x7ff56800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0c4320 con 0x7ff568005210 2023-10-16T20:06:52.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56800c110 con 0x7ff568004850 2023-10-16T20:06:52.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56800c2d0 con 0x7ff568003b90 2023-10-16T20:06:52.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa337fe700 1 -- 172.21.15.152:0/3593084828 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800bd90 con 0x7ffa340b5700 2023-10-16T20:06:52.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a135f700 1 -- 172.21.15.152:0/3364251185 >> v2:172.21.15.163:3300/0 conn(0x7fd89c144de0 msgr2=0x7fd89c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a135f700 1 --2- 172.21.15.152:0/3364251185 >> v2:172.21.15.163:3300/0 conn(0x7fd89c144de0 0x7fd89c070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a135f700 1 -- 172.21.15.152:0/3364251185 >> v1:172.21.15.163:6789/0 conn(0x7fd89c0710e0 legacy=0x7fd89c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fd8a135f700 1 -- 172.21.15.152:0/3364251185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0c5aa0 con 0x7fd89c06daf0 2023-10-16T20:06:52.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fd8a135f700 1 --2- 172.21.15.152:0/3364251185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c06ded0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd890009840 tx=0x7fd890009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797dea3f8d45f9b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 -- 172.21.15.152:0/3593084828 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 msgr2=0x7ffa340cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 --2- 172.21.15.152:0/3593084828 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa340cf980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa280098f0 tx=0x7ffa28009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:52.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff581ae4700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568005210 0x7ff56800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff568004850 0x7ff568004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb90b7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb90c0cb400 0x7fb90c15e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39000/0 (socket says 172.21.15.152:39000) 2023-10-16T20:06:52.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb90b7fe700 1 -- 172.21.15.152:0/1169767117 learned_addr learned my addr 172.21.15.152:0/1169767117 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:52.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.732+0000 7fb910d59700 1 --2- 172.21.15.152:0/1169767117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fb910d59700 1 -- 172.21.15.152:0/1169767117 >> v1:172.21.15.163:6789/0 conn(0x7fb90c15a240 legacy=0x7fb90c0caa20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:52.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fb910d59700 1 -- 172.21.15.152:0/1169767117 >> v1:172.21.15.152:6789/0 conn(0x7fb90c0cb400 legacy=0x7fb90c15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fb910d59700 1 -- 172.21.15.152:0/1169767117 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0cb9c0 con 0x7fb90c0aefb0 2023-10-16T20:06:52.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ff5812e3700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff568003b90 0x7ff568003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fb910d59700 1 --2- 172.21.15.152:0/1169767117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c0af440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb900010be0 tx=0x7fb900010ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b620ffc2086cfc16 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 -- 172.21.15.152:0/3593084828 shutdown_connections 2023-10-16T20:06:52.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 --2- 172.21.15.152:0/3593084828 >> v2:172.21.15.152:3300/0 conn(0x7ffa340b9000 0x7ffa340ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 --2- 172.21.15.152:0/3593084828 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa340cf980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 -- 172.21.15.152:0/3593084828 >> 172.21.15.152:0/3593084828 conn(0x7ffa3406bc70 msgr2=0x7ffa3406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7f9d7e630700 1 Processor -- start 2023-10-16T20:06:52.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fd88ffff700 1 -- 172.21.15.152:0/3364251185 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890004230 con 0x7fd89c06daf0 2023-10-16T20:06:52.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7ffa3b193700 1 -- 172.21.15.152:0/3593084828 shutdown_connections 2023-10-16T20:06:52.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3356927753 0 0) 0x7fca180035b0 con 0x7fca3006eb10 2023-10-16T20:06:52.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300cb210 msgr2=0x7fca300705e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:52.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300cb210 0x7fca300705e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 >> v2:172.21.15.163:3300/0 conn(0x7fca3006daf0 msgr2=0x7fca3006ded0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:52.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 --2- 172.21.15.152:0/4038581092 >> v2:172.21.15.163:3300/0 conn(0x7fca3006daf0 0x7fca3006ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300c9fb0 con 0x7fca3006eb10 2023-10-16T20:06:52.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fca280019f0 con 0x7fca3006eb10 2023-10-16T20:06:52.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 >> v1:172.21.15.152:6789/0 conn(0x7fca3006eb10 legacy=0x7fca30070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18003a00 0x7fca18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca18004850 0x7fca18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca18005330 0x7fca1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3006e410 con 0x7fca18003a00 2023-10-16T20:06:52.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c9cd0 con 0x7fca18005330 2023-10-16T20:06:52.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.733+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800c290 con 0x7fca18004850 2023-10-16T20:06:52.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7fd88ffff700 1 -- 172.21.15.152:0/3364251185 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890004390 con 0x7fd89c06daf0 2023-10-16T20:06:52.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7fd88ffff700 1 -- 172.21.15.152:0/3364251185 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900036a0 con 0x7fd89c06daf0 2023-10-16T20:06:52.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff580ae2700 1 -- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff568003b90 msgr2=0x7ff568003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff568003b90 0x7ff568003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff580ae2700 1 -- 172.21.15.152:0/2591647919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568005210 msgr2=0x7ff56800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568005210 0x7ff56800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff580ae2700 1 -- 172.21.15.152:0/2591647919 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680035b0 con 0x7ff568004850 2023-10-16T20:06:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff581ae4700 1 -- 172.21.15.152:0/2591647919 reap_dead start 2023-10-16T20:06:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff568004850 0x7ff568004cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009b60 tx=0x7ff568005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22df02ceb2e72242 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7fb90affd700 1 -- 172.21.15.152:0/1169767117 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000bee0 con 0x7fb90c0aefb0 2023-10-16T20:06:52.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7fb90affd700 1 -- 172.21.15.152:0/1169767117 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900004030 con 0x7fb90c0aefb0 2023-10-16T20:06:52.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7fb90affd700 1 -- 172.21.15.152:0/1169767117 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000043a0 con 0x7fb90c0aefb0 2023-10-16T20:06:52.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7fca2ed9d700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca18005330 0x7fca1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ffa3b193700 1 -- 172.21.15.152:0/3593084828 wait complete. 2023-10-16T20:06:52.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 -- 172.21.15.152:0/3364251185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 msgr2=0x7fd89c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 --2- 172.21.15.152:0/3364251185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c06ded0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd890009840 tx=0x7fd890009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:52.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 -- 172.21.15.152:0/3364251185 shutdown_connections 2023-10-16T20:06:52.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 --2- 172.21.15.152:0/3364251185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c06ded0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 --2- 172.21.15.152:0/3364251185 >> v2:172.21.15.163:3300/0 conn(0x7fd89c144de0 0x7fd89c070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 -- 172.21.15.152:0/3364251185 >> 172.21.15.152:0/3364251185 conn(0x7fd89c0cbad0 msgr2=0x7fd89c0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00e6c0 con 0x7ff568004850 2023-10-16T20:06:52.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c00e820 con 0x7ff568004850 2023-10-16T20:06:52.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.734+0000 7ff573fff700 1 -- 172.21.15.152:0/2591647919 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00eb90 con 0x7ff568004850 2023-10-16T20:06:52.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fb9127bc700 1 -- 172.21.15.152:0/1169767117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 msgr2=0x7fb90c0af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fb9127bc700 1 --2- 172.21.15.152:0/1169767117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c0af440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb900010be0 tx=0x7fb900010ef0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7ffa3b193700 1 Processor -- start 2023-10-16T20:06:52.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fb9127bc700 1 -- 172.21.15.152:0/1169767117 shutdown_connections 2023-10-16T20:06:52.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fb9127bc700 1 --2- 172.21.15.152:0/1169767117 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c0af440 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 -- 172.21.15.152:0/3364251185 shutdown_connections 2023-10-16T20:06:52.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fb9127bc700 1 -- 172.21.15.152:0/1169767117 >> 172.21.15.152:0/1169767117 conn(0x7fb90c0ccbd0 msgr2=0x7fb90c0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7ffa3b193700 1 -- start start 2023-10-16T20:06:52.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7ff583547700 1 -- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff568004850 msgr2=0x7ff568004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7ff583547700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff568004850 0x7ff568004cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009b60 tx=0x7ff568005880 comp rx=0 tx=0).stop 2023-10-16T20:06:52.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fd8a35c3700 1 -- 172.21.15.152:0/3364251185 wait complete. 2023-10-16T20:06:52.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ff583547700 1 -- 172.21.15.152:0/2591647919 shutdown_connections 2023-10-16T20:06:52.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ff583547700 1 --2- 172.21.15.152:0/2591647919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff568004850 0x7ff568004cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ff583547700 1 -- 172.21.15.152:0/2591647919 >> 172.21.15.152:0/2591647919 conn(0x7ff57c0cbad0 msgr2=0x7ff57c0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7fb9127bc700 1 -- 172.21.15.152:0/1169767117 shutdown_connections 2023-10-16T20:06:52.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ff583547700 1 -- 172.21.15.152:0/2591647919 shutdown_connections 2023-10-16T20:06:52.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ff583547700 1 -- 172.21.15.152:0/2591647919 wait complete. 2023-10-16T20:06:52.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa3b193700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa3415f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa3b193700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa340b9000 0x7ffa34154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa3b193700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa34160b50 0x7ffa340ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa3b193700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3415f520 con 0x7ffa34160b50 2023-10-16T20:06:52.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa3b193700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3415e8a0 con 0x7ffa340b9000 2023-10-16T20:06:52.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa3b193700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3415eb80 con 0x7ffa340b5700 2023-10-16T20:06:52.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fca2ed9d700 1 -- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca18004850 msgr2=0x7fca18004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:52.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fca2ed9d700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca18004850 0x7fca18004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fca2ed9d700 1 -- 172.21.15.152:0/4038581092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18003a00 msgr2=0x7fca18003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:52.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fca2ed9d700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18003a00 0x7fca18003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.735+0000 7fca2ed9d700 1 -- 172.21.15.152:0/4038581092 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300c9fb0 con 0x7fca18005330 2023-10-16T20:06:52.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7fca2ed9d700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca18005330 0x7fca1800ba10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca28008640 tx=0x7fca18005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2c8598173ba8ca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28008310 con 0x7fca18005330 2023-10-16T20:06:52.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca28006570 con 0x7fca18005330 2023-10-16T20:06:52.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7fca2d59a700 1 -- 172.21.15.152:0/4038581092 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28006920 con 0x7fca18005330 2023-10-16T20:06:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.736+0000 7ffa38f2f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa3415f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa38f2f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa3415f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47468/0 (socket says 172.21.15.152:47468) 2023-10-16T20:06:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa38f2f700 1 -- 172.21.15.152:0/3156951849 learned_addr learned my addr 172.21.15.152:0/3156951849 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa34160b50 0x7ffa340ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa33fff700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa340b9000 0x7ffa34154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 -- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 msgr2=0x7ffa3415f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa340b5700 0x7ffa3415f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 -- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa340b9000 msgr2=0x7ffa34154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa340b9000 0x7ffa34154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 -- 172.21.15.152:0/3156951849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009550 con 0x7ffa34160b50 2023-10-16T20:06:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa39730700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa34160b50 0x7ffa340ce580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c007d90 tx=0x7ffa2c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c018070 con 0x7ffa34160b50 2023-10-16T20:06:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3415ee60 con 0x7ffa34160b50 2023-10-16T20:06:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7ff583547700 1 Processor -- start 2023-10-16T20:06:52.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa34155180 con 0x7ffa34160b50 2023-10-16T20:06:52.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7fd8a35c3700 1 Processor -- start 2023-10-16T20:06:52.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.737+0000 7fd8a35c3700 1 -- start start 2023-10-16T20:06:52.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a35c3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c1fa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a35c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd89c0710e0 0x7fd89c1f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a35c3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd89c144de0 0x7fd89c1f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a35c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c15c780 con 0x7fd89c0710e0 2023-10-16T20:06:52.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a35c3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c15ca60 con 0x7fd89c144de0 2023-10-16T20:06:52.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a35c3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c15cd40 con 0x7fd89c06daf0 2023-10-16T20:06:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd89c144de0 0x7fd89c1f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd89c144de0 0x7fd89c1f9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59822/0 (socket says 172.21.15.152:59822) 2023-10-16T20:06:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 -- 172.21.15.152:0/1067862403 learned_addr learned my addr 172.21.15.152:0/1067862403 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 -- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 msgr2=0x7fd89c1fa7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd89c06daf0 0x7fd89c1fa7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 -- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd89c0710e0 msgr2=0x7fd89c1f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd89c0710e0 0x7fd89c1f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fd8a1b60700 1 -- 172.21.15.152:0/1067862403 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900094a0 con 0x7fd89c144de0 2023-10-16T20:06:52.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7fd8a1b60700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd89c144de0 0x7fd89c1f9e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd89400cca0 tx=0x7fd89400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7fb9127bc700 1 -- 172.21.15.152:0/1169767117 wait complete. 2023-10-16T20:06:52.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7ff583547700 1 -- start start 2023-10-16T20:06:52.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff583547700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568004850 0x7ff57c15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff583547700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c14a3b0 0x7ff57c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff583547700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff57c0c4d00 0x7ff57c0c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff583547700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0c56c0 con 0x7ff568004850 2023-10-16T20:06:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff583547700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c14a830 con 0x7ff57c14a3b0 2023-10-16T20:06:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff583547700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c15ced0 con 0x7ff57c0c4d00 2023-10-16T20:06:52.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400cea0 con 0x7fd89c144de0 2023-10-16T20:06:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400ade0 con 0x7fd89c144de0 2023-10-16T20:06:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894007310 con 0x7fd89c144de0 2023-10-16T20:06:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff581ae4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff57c0c4d00 0x7ff57c0c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff581ae4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff57c0c4d00 0x7ff57c0c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47484/0 (socket says 172.21.15.152:47484) 2023-10-16T20:06:52.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff581ae4700 1 -- 172.21.15.152:0/2735052077 learned_addr learned my addr 172.21.15.152:0/2735052077 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7f9d7e630700 1 -- start start 2023-10-16T20:06:52.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c00eb30 con 0x7ffa34160b50 2023-10-16T20:06:52.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.738+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00eea0 con 0x7ffa34160b50 2023-10-16T20:06:52.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.739+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c14a3b0 0x7ff57c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7ff580ae2700 1 -- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff57c0c4d00 msgr2=0x7ff57c0c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff57c0c4d00 0x7ff57c0c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7ff580ae2700 1 -- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568004850 msgr2=0x7ff57c15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff568004850 0x7ff57c15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7ff580ae2700 1 -- 172.21.15.152:0/2735052077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c15ba10 con 0x7ff57c14a3b0 2023-10-16T20:06:52.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fb9127bc700 1 Processor -- start 2023-10-16T20:06:52.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fca34aac700 1 -- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca18005330 msgr2=0x7fca1800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fca34aac700 1 --2- 172.21.15.152:0/4038581092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca18005330 0x7fca1800ba10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca28008640 tx=0x7fca18005880 comp rx=0 tx=0).stop 2023-10-16T20:06:52.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fca2ed9d700 1 -- 172.21.15.152:0/4038581092 reap_dead start 2023-10-16T20:06:52.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fb9127bc700 1 -- start start 2023-10-16T20:06:52.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c15d020 con 0x7fd89c144de0 2023-10-16T20:06:52.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c1facf0 con 0x7fd89c144de0 2023-10-16T20:06:52.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa14000fc0 con 0x7ffa34160b50 2023-10-16T20:06:52.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7f9d7e630700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9d78160b50 0x7f9d780cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.740+0000 7f9d7e630700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9d780b9000 0x7f9d780b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d7e630700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d780b5980 con 0x7f9d780b5530 2023-10-16T20:06:52.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d7e630700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d780b94b0 con 0x7f9d78160b50 2023-10-16T20:06:52.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d7e630700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d780d0010 con 0x7f9d780b9000 2023-10-16T20:06:52.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb9127bc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb9127bc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb90c0cb400 0x7fb90c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb9127bc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c15a240 0x7fb90c1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb9127bc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0ad790 con 0x7fb90c15a240 2023-10-16T20:06:52.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb9127bc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c1532c0 con 0x7fb90c0cb400 2023-10-16T20:06:52.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb9127bc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c155f70 con 0x7fb90c0aefb0 2023-10-16T20:06:52.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd89c070680 con 0x7fd89c144de0 2023-10-16T20:06:52.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7fb90b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb90c0cb400 0x7fb90c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb90c0cb400 0x7fb90c0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59842/0 (socket says 172.21.15.152:59842) 2023-10-16T20:06:52.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 -- 172.21.15.152:0/1718648768 learned_addr learned my addr 172.21.15.152:0/1718648768 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa2c003a20 con 0x7ffa34160b50 2023-10-16T20:06:52.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ff580ae2700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c14a3b0 0x7ff57c15b4d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff56c019000 tx=0x7ff56c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 -- 172.21.15.152:0/1718648768 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 msgr2=0x7fb90c155870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T20:06:52.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb90c0aefb0 0x7fb90c155870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 -- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c15a240 msgr2=0x7fb90c1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb90c15a240 0x7fb90c1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 -- 172.21.15.152:0/1718648768 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900010810 con 0x7fb90c0cb400 2023-10-16T20:06:52.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9d780b9000 0x7f9d780b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9d780b9000 0x7f9d780b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59838/0 (socket says 172.21.15.152:59838) 2023-10-16T20:06:52.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 -- 172.21.15.152:0/1051924419 learned_addr learned my addr 172.21.15.152:0/1051924419 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d7cbcd700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f9d780b5530 0x7f9d781611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54214/0 (socket says 172.21.15.152:54214) 2023-10-16T20:06:52.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 -- 172.21.15.152:0/1051924419 >> v2:172.21.15.152:3300/0 conn(0x7f9d78160b50 msgr2=0x7f9d780cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 --2- 172.21.15.152:0/1051924419 >> v2:172.21.15.152:3300/0 conn(0x7f9d78160b50 0x7f9d780cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 -- 172.21.15.152:0/1051924419 >> v1:172.21.15.163:6789/0 conn(0x7f9d780b5530 legacy=0x7f9d781611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.741+0000 7f9d777fe700 1 -- 172.21.15.152:0/1051924419 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780d02f0 con 0x7f9d780b9000 2023-10-16T20:06:52.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7f9d777fe700 1 --2- 172.21.15.152:0/1051924419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b9000 0x7f9d780b4ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0098f0 tx=0x7f9d6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b441018d5f4a58 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd894007470 con 0x7fd89c144de0 2023-10-16T20:06:52.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fd88dffb700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd88006af00 0x7fd88006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd894089630 con 0x7fd89c144de0 2023-10-16T20:06:52.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7fd88dffb700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fd880074440 0x7fd880076880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 --> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd880076f50 con 0x7fd880074440 2023-10-16T20:06:52.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb90b7fe700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb90c0cb400 0x7fb90c0afbb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb904002080 tx=0x7fb90400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90400ae00 con 0x7fb90c0cb400 2023-10-16T20:06:52.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904001ed0 con 0x7fb90c0cb400 2023-10-16T20:06:52.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040072f0 con 0x7fb90c0cb400 2023-10-16T20:06:52.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c1568d0 con 0x7fb90c0cb400 2023-10-16T20:06:52.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c156e90 con 0x7fb90c0cb400 2023-10-16T20:06:52.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa317fa700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa2006af00 0x7ffa2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa2c089770 con 0x7ffa34160b50 2023-10-16T20:06:52.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa317fa700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7ffa20074440 0x7ffa20076880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 --> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa20076f50 con 0x7ffa20074440 2023-10-16T20:06:52.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa2c0545c0 con 0x7ffa34160b50 2023-10-16T20:06:52.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.742+0000 7ffa38f2f700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa2006af00 0x7ffa2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7ffa33fff700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7ffa20074440 0x7ffa20076880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7fd8a135f700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd88006af00 0x7fd88006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7ffa38f2f700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa2006af00 0x7ffa2006d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa24001880 tx=0x7ffa24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7f9d76ffd700 1 -- 172.21.15.152:0/1051924419 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c014e90 con 0x7f9d780b9000 2023-10-16T20:06:52.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7f9d76ffd700 1 -- 172.21.15.152:0/1051924419 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c01c440 con 0x7f9d780b9000 2023-10-16T20:06:52.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7f9d76ffd700 1 -- 172.21.15.152:0/1051924419 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c01c7d0 con 0x7f9d780b9000 2023-10-16T20:06:52.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fd8a135f700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd88006af00 0x7fd88006d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd89c071b60 tx=0x7fd890010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd894001c90 con 0x7fd89c144de0 2023-10-16T20:06:52.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7f9d7e630700 1 -- 172.21.15.152:0/1051924419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b9000 msgr2=0x7f9d780b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1051924419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b9000 0x7f9d780b4ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0098f0 tx=0x7f9d6c009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:52.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7ffa33fff700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7ffa20074440 0x7ffa20076880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7f9d7e630700 1 -- 172.21.15.152:0/1051924419 shutdown_connections 2023-10-16T20:06:52.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1051924419 >> v2:172.21.15.152:3300/0 conn(0x7f9d78160b50 0x7f9d780cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1051924419 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b9000 0x7f9d780b4ff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7f9d7e630700 1 -- 172.21.15.152:0/1051924419 >> 172.21.15.152:0/1051924419 conn(0x7f9d7806bc70 msgr2=0x7f9d7806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7f9d7e630700 1 -- 172.21.15.152:0/1051924419 shutdown_connections 2023-10-16T20:06:52.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7f9d7e630700 1 -- 172.21.15.152:0/1051924419 wait complete. 2023-10-16T20:06:52.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fca34aac700 1 -- 172.21.15.152:0/4038581092 shutdown_connections 2023-10-16T20:06:52.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fca34aac700 1 -- 172.21.15.152:0/4038581092 >> 172.21.15.152:0/4038581092 conn(0x7fca300cbad0 msgr2=0x7fca300cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fca34aac700 1 -- 172.21.15.152:0/4038581092 shutdown_connections 2023-10-16T20:06:52.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fca34aac700 1 -- 172.21.15.152:0/4038581092 wait complete. 2023-10-16T20:06:52.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb904007450 con 0x7fb90c0cb400 2023-10-16T20:06:52.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8ec000fc0 con 0x7fb90c0cb400 2023-10-16T20:06:52.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7fb908ff9700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb8f806af30 0x7fb8f806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb904089430 con 0x7fb90c0cb400 2023-10-16T20:06:52.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00e6c0 con 0x7ff57c14a3b0 2023-10-16T20:06:52.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c003b10 con 0x7ff57c14a3b0 2023-10-16T20:06:52.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.743+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c004590 con 0x7ff57c14a3b0 2023-10-16T20:06:52.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c15c2c0 con 0x7ff57c14a3b0 2023-10-16T20:06:52.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c15c880 con 0x7ff57c14a3b0 2023-10-16T20:06:52.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.744+0000 7fd8a0b5e700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fd880074440 0x7fd880076880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7fb908ff9700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7fb8f8074470 0x7fb8f80768b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.745+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 --> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8f8076f80 con 0x7fb8f8074470 2023-10-16T20:06:52.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9040541f0 con 0x7fb90c0cb400 2023-10-16T20:06:52.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== osd.5 v2:172.21.15.163:6808/792269555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ffa20076f50 con 0x7ffa20074440 2023-10-16T20:06:52.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7fb90bfff700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb8f806af30 0x7fb8f806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff56c013470 con 0x7ff57c14a3b0 2023-10-16T20:06:52.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7fca34aac700 1 Processor -- start 2023-10-16T20:06:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7f9d7e630700 1 Processor -- start 2023-10-16T20:06:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7fb910d59700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7fb8f8074470 0x7fb8f80768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7ff571ffb700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff56006af20 0x7ff56006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff56c08b160 con 0x7ff57c14a3b0 2023-10-16T20:06:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7ff5812e3700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff56006af20 0x7ff56006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7f9d7e630700 1 -- start start 2023-10-16T20:06:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7fb90bfff700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb8f806af30 0x7fb8f806d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009710 tx=0x7fb8fc006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7fb910d59700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7fb8f8074470 0x7fb8f80768b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7ff583547700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7ff57c15ca10 0x7ff57c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.747+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 --> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff57c0cda80 con 0x7ff57c15ca10 2023-10-16T20:06:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.746+0000 7fca34aac700 1 -- start start 2023-10-16T20:06:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca34aac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18005330 0x7fca30152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca34aac700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca300a9e40 0x7fca300c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca34aac700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300aa2c0 0x7fca300c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca34aac700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300a8b00 con 0x7fca18005330 2023-10-16T20:06:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca34aac700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300a8da0 con 0x7fca300a9e40 2023-10-16T20:06:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca34aac700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300a9080 con 0x7fca300aa2c0 2023-10-16T20:06:52.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7ff5812e3700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff56006af20 0x7ff56006d3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff578001ed0 tx=0x7ff578001e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fd8a0b5e700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fd880074440 0x7fd880076880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7e630700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b5530 0x7f9d7815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7e630700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d780b9000 0x7f9d78200060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7e630700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d78160b50 0x7f9d780b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7e630700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d781515c0 con 0x7f9d78160b50 2023-10-16T20:06:52.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18005330 0x7fca30152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18005330 0x7fca30152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58864/0 (socket says 172.21.15.152:58864) 2023-10-16T20:06:52.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2e59c700 1 -- 172.21.15.152:0/4218974640 learned_addr learned my addr 172.21.15.152:0/4218974640 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7e630700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7815b100 con 0x7f9d780b5530 2023-10-16T20:06:52.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7e630700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d78151810 con 0x7f9d780b9000 2023-10-16T20:06:52.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2dd9b700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca300a9e40 0x7fca300c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b5530 0x7f9d7815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7ff581ae4700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7ff57c15ca10 0x7ff57c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b5530 0x7f9d7815abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59868/0 (socket says 172.21.15.152:59868) 2023-10-16T20:06:52.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d77fff700 1 -- 172.21.15.152:0/1547152338 learned_addr learned my addr 172.21.15.152:0/1547152338 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d7cbcd700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d78160b50 0x7f9d780b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7f9d777fe700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d780b9000 0x7f9d78200060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f9d77fff700 1 -- 172.21.15.152:0/1547152338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d780b9000 msgr2=0x7f9d78200060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f9d77fff700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9d780b9000 0x7f9d78200060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f9d77fff700 1 -- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d78160b50 msgr2=0x7f9d780b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f9d77fff700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d78160b50 0x7f9d780b7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f9d77fff700 1 -- 172.21.15.152:0/1547152338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c009550 con 0x7f9d780b5530 2023-10-16T20:06:52.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f14c185b700 1 Processor -- start 2023-10-16T20:06:52.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2ed9d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300aa2c0 0x7fca300c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2dd9b700 1 -- 172.21.15.152:0/4218974640 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300aa2c0 msgr2=0x7fca300c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2dd9b700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fca300aa2c0 0x7fca300c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2dd9b700 1 -- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18005330 msgr2=0x7fca30152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.748+0000 7fca2dd9b700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca18005330 0x7fca30152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca2dd9b700 1 -- 172.21.15.152:0/4218974640 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300a9360 con 0x7fca300a9e40 2023-10-16T20:06:52.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== osd.3 v2:172.21.15.152:6817/2264394599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb8f8076f80 con 0x7fb8f8074470 2023-10-16T20:06:52.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== osd.6 v2:172.21.15.163:6800/2738585885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd880076f50 con 0x7fd880074440 2023-10-16T20:06:52.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca2dd9b700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca300a9e40 0x7fca300c86e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca300672a0 tx=0x7fca2400b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24011620 con 0x7fca300a9e40 2023-10-16T20:06:52.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca240117a0 con 0x7fca300a9e40 2023-10-16T20:06:52.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24011b30 con 0x7fca300a9e40 2023-10-16T20:06:52.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca300a9640 con 0x7fca300a9e40 2023-10-16T20:06:52.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300ab6d0 con 0x7fca300a9e40 2023-10-16T20:06:52.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7ff581ae4700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7ff57c15ca10 0x7ff57c159de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca300a91f0 con 0x7fca300a9e40 2023-10-16T20:06:52.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f9d77fff700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b5530 0x7f9d7815abc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800b4a0 tx=0x7f9d6800b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.749+0000 7f14c185b700 1 -- start start 2023-10-16T20:06:52.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c185b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f14b40df680 0x7f14b40542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c185b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f14b40060f0 0x7f14b4007690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c185b700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40065f0 con 0x7f14b404fd80 2023-10-16T20:06:52.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c185b700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40068d0 con 0x7f14b40060f0 2023-10-16T20:06:52.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c185b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b4006bb0 con 0x7f14b40df680 2023-10-16T20:06:52.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c0859700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f14b404fd80 0x7f14b4050160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39070/0 (socket says 172.21.15.152:39070) 2023-10-16T20:06:52.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.750+0000 7f14c0859700 1 -- 172.21.15.152:0/3671292625 learned_addr learned my addr 172.21.15.152:0/3671292625 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:52.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011830 con 0x7f9d780b5530 2023-10-16T20:06:52.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== osd.4 v2:172.21.15.163:6816/1994135539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff5740052f0 con 0x7ff57c15ca10 2023-10-16T20:06:52.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14c105a700 1 --2- 172.21.15.152:0/3671292625 >> v2:172.21.15.152:3300/0 conn(0x7f14b40060f0 0x7f14b4007690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14bb7fe700 1 -- 172.21.15.152:0/3671292625 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220270569 0 0) 0x7f14b40065f0 con 0x7f14b404fd80 2023-10-16T20:06:52.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14bb7fe700 1 -- 172.21.15.152:0/3671292625 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ac0046c0 con 0x7f14b404fd80 2023-10-16T20:06:52.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14c105a700 1 -- 172.21.15.152:0/3671292625 >> v2:172.21.15.163:3300/0 conn(0x7f14b40df680 msgr2=0x7f14b40542a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:52.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14c105a700 1 --2- 172.21.15.152:0/3671292625 >> v2:172.21.15.163:3300/0 conn(0x7f14b40df680 0x7f14b40542a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14c105a700 1 -- 172.21.15.152:0/3671292625 >> v1:172.21.15.152:6789/0 conn(0x7f14b404fd80 legacy=0x7f14b4050160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14c105a700 1 -- 172.21.15.152:0/3671292625 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4006e90 con 0x7f14b40060f0 2023-10-16T20:06:52.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f14c105a700 1 --2- 172.21.15.152:0/3671292625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 0x7f14b4007690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000eb0 tx=0x7f14bc068470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20308a87a4ec05fc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d78151af0 con 0x7f9d780b5530 2023-10-16T20:06:52.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.751+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d782005a0 con 0x7f9d780b5530 2023-10-16T20:06:52.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.752+0000 7f14bb7fe700 1 -- 172.21.15.152:0/3671292625 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc06bba0 con 0x7f14b40060f0 2023-10-16T20:06:52.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.752+0000 7f14bb7fe700 1 -- 172.21.15.152:0/3671292625 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc06bd00 con 0x7f14b40060f0 2023-10-16T20:06:52.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.752+0000 7f14bb7fe700 1 -- 172.21.15.152:0/3671292625 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc067a70 con 0x7f14b40060f0 2023-10-16T20:06:52.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.752+0000 7f14c185b700 1 -- 172.21.15.152:0/3671292625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 msgr2=0x7f14b4007690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.752+0000 7f14c185b700 1 --2- 172.21.15.152:0/3671292625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 0x7f14b4007690 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000eb0 tx=0x7f14bc068470 comp rx=0 tx=0).stop 2023-10-16T20:06:52.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f14c185b700 1 -- 172.21.15.152:0/3671292625 shutdown_connections 2023-10-16T20:06:52.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f14c185b700 1 --2- 172.21.15.152:0/3671292625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 0x7f14b4007690 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f14c185b700 1 --2- 172.21.15.152:0/3671292625 >> v2:172.21.15.163:3300/0 conn(0x7f14b40df680 0x7f14b40542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f14c185b700 1 -- 172.21.15.152:0/3671292625 >> 172.21.15.152:0/3671292625 conn(0x7f14b4054d20 msgr2=0x7f14b4055130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca24011c90 con 0x7fca300a9e40 2023-10-16T20:06:52.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68011990 con 0x7f9d780b5530 2023-10-16T20:06:52.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68011d40 con 0x7f9d780b5530 2023-10-16T20:06:52.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d6801a400 con 0x7f9d780b5530 2023-10-16T20:06:52.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7fca1effd700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca1006af00 0x7fca1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca24089d40 con 0x7fca300a9e40 2023-10-16T20:06:52.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7fca1effd700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7fca100744c0 0x7fca10076900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.753+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 --> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca10076fd0 con 0x7fca100744c0 2023-10-16T20:06:52.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca2408a190 con 0x7fca300a9e40 2023-10-16T20:06:52.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7fca2e59c700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca1006af00 0x7fca1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7f9d74ff9700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9d6406af00 0x7f9d6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7f14c185b700 1 -- 172.21.15.152:0/3671292625 shutdown_connections 2023-10-16T20:06:52.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7f14c185b700 1 -- 172.21.15.152:0/3671292625 wait complete. 2023-10-16T20:06:52.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d68089890 con 0x7f9d780b5530 2023-10-16T20:06:52.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7f9d777fe700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9d6406af00 0x7f9d6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.755+0000 7f9d777fe700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9d6406af00 0x7f9d6406d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c000c00 tx=0x7f9d6c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f9d580015e0 0x7f9d58003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 --> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d58006bd0 con 0x7f9d580015e0 2023-10-16T20:06:52.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7f14c185b700 1 Processor -- start 2023-10-16T20:06:52.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7fca2e59c700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca1006af00 0x7fca1006d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca20009a50 tx=0x7fca20009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7f14c185b700 1 -- start start 2023-10-16T20:06:52.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.754+0000 7ff7ffe88700 1 Processor -- start 2023-10-16T20:06:52.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.755+0000 7ff7ffe88700 1 -- start start 2023-10-16T20:06:52.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7ffe88700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f81598f0 0x7ff7f80cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7ffe88700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff7f80cd920 0x7ff7f815d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7ffe88700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f80c98f0 con 0x7ff7f8159510 2023-10-16T20:06:52.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7ffe88700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f815e200 con 0x7ff7f80cd920 2023-10-16T20:06:52.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7ffe88700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f815d960 con 0x7ff7f81598f0 2023-10-16T20:06:52.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7fdc24700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff7f8159510 0x7ff7f80cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54264/0 (socket says 172.21.15.152:54264) 2023-10-16T20:06:52.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7fdc24700 1 -- 172.21.15.152:0/1750836464 learned_addr learned my addr 172.21.15.152:0/1750836464 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:52.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7ff7fd423700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f81598f0 0x7ff7f80cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.756+0000 7f9d7cbcd700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f9d580015e0 0x7f9d58003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fe425700 1 --2- 172.21.15.152:0/1750836464 >> v2:172.21.15.163:3300/0 conn(0x7ff7f80cd920 0x7ff7f815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302254433 0 0) 0x7ff7f80c98f0 con 0x7ff7f8159510 2023-10-16T20:06:52.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e40035b0 con 0x7ff7f8159510 2023-10-16T20:06:52.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f9d7cbcd700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f9d580015e0 0x7f9d58003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f14c185b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 0x7f14b4175970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f14c185b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14b404fd80 0x7f14b41747c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f14c185b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14b4175eb0 0x7f14b40e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f14c185b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4175270 con 0x7f14b40060f0 2023-10-16T20:06:52.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f14c185b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4175550 con 0x7f14b404fd80 2023-10-16T20:06:52.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7f14c185b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40489d0 con 0x7f14b4175eb0 2023-10-16T20:06:52.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 <== mon.1 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1382976328 0 0) 0x7ff7e40035b0 con 0x7ff7f8159510 2023-10-16T20:06:52.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f81598f0 msgr2=0x7ff7f80cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f81598f0 0x7ff7f80cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 >> v2:172.21.15.163:3300/0 conn(0x7ff7f80cd920 msgr2=0x7ff7f815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 --2- 172.21.15.152:0/1750836464 >> v2:172.21.15.163:3300/0 conn(0x7ff7f80cd920 0x7ff7f815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 --> v1:172.21.15.163:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f815dc40 con 0x7ff7f8159510 2023-10-16T20:06:52.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 <== mon.1 v1:172.21.15.163:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7ff7f4004d40 con 0x7ff7f8159510 2023-10-16T20:06:52.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 >> v1:172.21.15.163:6789/0 conn(0x7ff7f8159510 legacy=0x7ff7f80cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7e4003a00 0x7ff7e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7e40043f0 0x7ff7e40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7e4004ff0 0x7ff7e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f815e200 con 0x7ff7e4004ff0 2023-10-16T20:06:52.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f815d960 con 0x7ff7e40043f0 2023-10-16T20:06:52.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.757+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4014810 con 0x7ff7e4003a00 2023-10-16T20:06:52.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14b4175eb0 0x7f14b40e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14b4175eb0 0x7f14b40e0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47544/0 (socket says 172.21.15.152:47544) 2023-10-16T20:06:52.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 -- 172.21.15.152:0/492463276 learned_addr learned my addr 172.21.15.152:0/492463276 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fe425700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7e4004ff0 0x7ff7e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fd423700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7e40043f0 0x7ff7e40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14bbfff700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14b404fd80 0x7f14b41747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 -- 172.21.15.152:0/492463276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14b404fd80 msgr2=0x7f14b41747c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14b404fd80 0x7f14b41747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 -- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 msgr2=0x7f14b4175970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T20:06:52.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b40060f0 0x7f14b4175970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7f14c105a700 1 -- 172.21.15.152:0/492463276 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc04f120 con 0x7f14b4175eb0 2023-10-16T20:06:52.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fdc24700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7e4003a00 0x7ff7e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fd423700 1 -- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7e4003a00 msgr2=0x7ff7e4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fd423700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7e4003a00 0x7ff7e4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fd423700 1 -- 172.21.15.152:0/1750836464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7e4004ff0 msgr2=0x7ff7e400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:52.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fd423700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7e4004ff0 0x7ff7e400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.758+0000 7ff7fd423700 1 -- 172.21.15.152:0/1750836464 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f815dc40 con 0x7ff7e40043f0 2023-10-16T20:06:52.860 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.759+0000 7f14c105a700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14b4175eb0 0x7f14b40e0e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14bc06a070 tx=0x7f14bc068b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.860 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.759+0000 7ff7fd423700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7e40043f0 0x7ff7e40048d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80b5260 tx=0x7ff7e4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8457e3753d937d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.860 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.759+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== osd.0 v2:172.21.15.152:6808/648653376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9d58006bd0 con 0x7f9d580015e0 2023-10-16T20:06:52.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.759+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0007dc0 con 0x7ff7e40043f0 2023-10-16T20:06:52.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.760+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0014400 con 0x7ff7e40043f0 2023-10-16T20:06:52.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.760+0000 7ff7fcc22700 1 -- 172.21.15.152:0/1750836464 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0014790 con 0x7ff7e40043f0 2023-10-16T20:06:52.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.760+0000 7fca2ed9d700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7fca100744c0 0x7fca10076900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.760+0000 7fca2ed9d700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7fca100744c0 0x7fca10076900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.761+0000 7ff7ffe88700 1 -- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7e40043f0 msgr2=0x7ff7e40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.761+0000 7ff7ffe88700 1 --2- 172.21.15.152:0/1750836464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7e40043f0 0x7ff7e40048d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80b5260 tx=0x7ff7e4005880 comp rx=0 tx=0).stop 2023-10-16T20:06:52.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7ff7fe425700 1 -- 172.21.15.152:0/1750836464 reap_dead start 2023-10-16T20:06:52.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== osd.2 v2:172.21.15.152:6800/4291228321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fca10076fd0 con 0x7fca100744c0 2023-10-16T20:06:52.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7ff7ffe88700 1 -- 172.21.15.152:0/1750836464 shutdown_connections 2023-10-16T20:06:52.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7ff7ffe88700 1 -- 172.21.15.152:0/1750836464 >> 172.21.15.152:0/1750836464 conn(0x7ff7f806c850 msgr2=0x7ff7f806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc04f4c0 con 0x7f14b4175eb0 2023-10-16T20:06:52.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc067d40 con 0x7f14b4175eb0 2023-10-16T20:06:52.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.762+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0741f0 con 0x7f14b4175eb0 2023-10-16T20:06:52.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.763+0000 7ff7ffe88700 1 -- 172.21.15.152:0/1750836464 shutdown_connections 2023-10-16T20:06:52.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.763+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b4048cb0 con 0x7f14b4175eb0 2023-10-16T20:06:52.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.763+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b404ec00 con 0x7f14b4175eb0 2023-10-16T20:06:52.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.763+0000 7ff7ffe88700 1 -- 172.21.15.152:0/1750836464 wait complete. 2023-10-16T20:06:52.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.765+0000 7ff7ffe88700 1 Processor -- start 2023-10-16T20:06:52.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.765+0000 7ff7ffe88700 1 -- start start 2023-10-16T20:06:52.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.766+0000 7ff7ffe88700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f80c88d0 0x7ff7f8150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.766+0000 7ff7ffe88700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7f81507a0 0x7ff7f80c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.766+0000 7ff7ffe88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f80c6640 0x7ff7f8157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.766+0000 7ff7ffe88700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81ef540 con 0x7ff7f80c6640 2023-10-16T20:06:52.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.766+0000 7ff7ffe88700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8150c20 con 0x7ff7f81507a0 2023-10-16T20:06:52.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.766+0000 7ff7ffe88700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81eeba0 con 0x7ff7f80c88d0 2023-10-16T20:06:52.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f80c88d0 0x7ff7f8150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f80c88d0 0x7ff7f8150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47554/0 (socket says 172.21.15.152:47554) 2023-10-16T20:06:52.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 -- 172.21.15.152:0/4108261172 learned_addr learned my addr 172.21.15.152:0/4108261172 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:52.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fe425700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f80c6640 0x7ff7f8157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 -- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7f81507a0 msgr2=0x7ff7f80c6100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:52.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff7f81507a0 0x7ff7f80c6100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 -- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f80c6640 msgr2=0x7ff7f8157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f80c6640 0x7ff7f8157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 -- 172.21.15.152:0/4108261172 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f81eee80 con 0x7ff7f80c88d0 2023-10-16T20:06:52.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7fdc24700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f80c88d0 0x7ff7f8150260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400fa40 tx=0x7ff7f400fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.767+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400da20 con 0x7ff7f80c88d0 2023-10-16T20:06:52.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.768+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400db80 con 0x7ff7f80c88d0 2023-10-16T20:06:52.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.768+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4019420 con 0x7ff7f80c88d0 2023-10-16T20:06:52.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.768+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f81ef160 con 0x7ff7f80c88d0 2023-10-16T20:06:52.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.769+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f81ef960 con 0x7ff7f80c88d0 2023-10-16T20:06:52.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.770+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7f80c9b20 con 0x7ff7f80c88d0 2023-10-16T20:06:52.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.771+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff7f4016020 con 0x7ff7f80c88d0 2023-10-16T20:06:52.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.771+0000 7ff7ee7fc700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff7e407d930 0x7ff7e407fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.771+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7f4089fb0 con 0x7ff7f80c88d0 2023-10-16T20:06:52.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.771+0000 7ff7ee7fc700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7ff7e4086df0 0x7ff7e4089230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.771+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 --> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7e4089900 con 0x7ff7e4086df0 2023-10-16T20:06:52.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.772+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f4054d70 con 0x7ff7f80c88d0 2023-10-16T20:06:52.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.772+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 --> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa14002d40 con 0x7ffa20074440 2023-10-16T20:06:52.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.772+0000 7ff7fe425700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7ff7e4086df0 0x7ff7e4089230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.772+0000 7ff7fe425700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7ff7e4086df0 0x7ff7e4089230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.772+0000 7ffa317fa700 1 -- 172.21.15.152:0/3156951849 <== osd.5 v2:172.21.15.163:6808/792269555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa14002d40 con 0x7ffa20074440 2023-10-16T20:06:52.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7ffa20074440 msgr2=0x7ffa20076880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7ffa20074440 0x7ffa20076880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa2006af00 msgr2=0x7ffa2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa2006af00 0x7ffa2006d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa24001880 tx=0x7ffa24009040 comp rx=0 tx=0).stop 2023-10-16T20:06:52.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa34160b50 msgr2=0x7ffa340ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 --2- 172.21.15.152:0/3156951849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa34160b50 0x7ffa340ce580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c007d90 tx=0x7ffa2c00e3c0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== osd.7 v2:172.21.15.163:6824/3318028264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff7e4089900 con 0x7ff7e4086df0 2023-10-16T20:06:52.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa39730700 1 -- 172.21.15.152:0/3156951849 reap_dead start 2023-10-16T20:06:52.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 shutdown_connections 2023-10-16T20:06:52.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 >> 172.21.15.152:0/3156951849 conn(0x7ffa3406bc70 msgr2=0x7ffa34155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 shutdown_connections 2023-10-16T20:06:52.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.773+0000 7ffa3b193700 1 -- 172.21.15.152:0/3156951849 wait complete. 2023-10-16T20:06:52.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.776+0000 7ff7fd423700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff7e407d930 0x7ff7e407fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.777+0000 7ff7fd423700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff7e407d930 0x7ff7e407fdf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40047d0 tx=0x7ff7f000b030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.777+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14bc0733c0 con 0x7f14b4175eb0 2023-10-16T20:06:52.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.777+0000 7f14b97fa700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14ac06f830 0x7f14ac071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.777+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f14bc103ff0 con 0x7f14b4175eb0 2023-10-16T20:06:52.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.778+0000 7f14c0859700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14ac06f830 0x7f14ac071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.778+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 --> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8ec002d40 con 0x7fb8f8074470 2023-10-16T20:06:52.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.779+0000 7f14c0859700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14ac06f830 0x7f14ac071cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14b404f570 tx=0x7f14b00079f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.779+0000 7fb908ff9700 1 -- 172.21.15.152:0/1718648768 <== osd.3 v2:172.21.15.152:6817/2264394599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8ec002d40 con 0x7fb8f8074470 2023-10-16T20:06:52.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7fb8f8074470 msgr2=0x7fb8f80768b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7fb8f8074470 0x7fb8f80768b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb8f806af30 msgr2=0x7fb8f806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb8f806af30 0x7fb8f806d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009710 tx=0x7fb8fc006c60 comp rx=0 tx=0).stop 2023-10-16T20:06:52.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb90c0cb400 msgr2=0x7fb90c0afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 --2- 172.21.15.152:0/1718648768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb90c0cb400 0x7fb90c0afbb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb904002080 tx=0x7fb90400a340 comp rx=0 tx=0).stop 2023-10-16T20:06:52.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb910d59700 1 -- 172.21.15.152:0/1718648768 reap_dead start 2023-10-16T20:06:52.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 shutdown_connections 2023-10-16T20:06:52.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 >> 172.21.15.152:0/1718648768 conn(0x7fb90c0ccbd0 msgr2=0x7fb90c1572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 shutdown_connections 2023-10-16T20:06:52.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.780+0000 7fb9127bc700 1 -- 172.21.15.152:0/1718648768 wait complete. 2023-10-16T20:06:52.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.781+0000 7f14c185b700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f14b4174d00 0x7f14b40e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:52.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.781+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 --> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14b40535d0 con 0x7f14b4174d00 2023-10-16T20:06:52.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.781+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 --> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd89c0c5d80 con 0x7fd880074440 2023-10-16T20:06:52.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.782+0000 7f14bbfff700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f14b4174d00 0x7f14b40e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:52.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.782+0000 7fd88dffb700 1 -- 172.21.15.152:0/1067862403 <== osd.6 v2:172.21.15.163:6800/2738585885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd8980096c0 con 0x7fd880074440 2023-10-16T20:06:52.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.783+0000 7f14bbfff700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f14b4174d00 0x7f14b40e13c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.783+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fd880074440 msgr2=0x7fd880076880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.783+0000 7fd8a35c3700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fd880074440 0x7fd880076880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.783+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 --> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff57c06ead0 con 0x7ff57c15ca10 2023-10-16T20:06:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.784+0000 7ff571ffb700 1 -- 172.21.15.152:0/2735052077 <== osd.4 v2:172.21.15.163:6816/1994135539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff574003680 con 0x7ff57c15ca10 2023-10-16T20:06:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.785+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== osd.1 v2:172.21.15.152:6816/3247585045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f14a800a840 con 0x7f14b4174d00 2023-10-16T20:06:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.786+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd88006af00 msgr2=0x7fd88006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.786+0000 7fd8a35c3700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd88006af00 0x7fd88006d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd89c071b60 tx=0x7fd890010000 comp rx=0 tx=0).stop 2023-10-16T20:06:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.786+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd89c144de0 msgr2=0x7fd89c1f9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.786+0000 7fd8a35c3700 1 --2- 172.21.15.152:0/1067862403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd89c144de0 0x7fd89c1f9e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd89400cca0 tx=0x7fd89400a340 comp rx=0 tx=0).stop 2023-10-16T20:06:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7ff57c15ca10 msgr2=0x7ff57c159de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7ff57c15ca10 0x7ff57c159de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff56006af20 msgr2=0x7ff56006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff56006af20 0x7ff56006d3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff578001ed0 tx=0x7ff578001e20 comp rx=0 tx=0).stop 2023-10-16T20:06:52.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c14a3b0 msgr2=0x7ff57c15b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 --2- 172.21.15.152:0/2735052077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c14a3b0 0x7ff57c15b4d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff56c019000 tx=0x7ff56c0047c0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff581ae4700 1 -- 172.21.15.152:0/2735052077 reap_dead start 2023-10-16T20:06:52.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 shutdown_connections 2023-10-16T20:06:52.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.788+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 >> 172.21.15.152:0/2735052077 conn(0x7ff57c0cbad0 msgr2=0x7ff57c160e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.789+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 --> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d58005cb0 con 0x7f9d580015e0 2023-10-16T20:06:52.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d74ff9700 1 -- 172.21.15.152:0/1547152338 <== osd.0 v2:172.21.15.152:6808/648653376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d58005cb0 con 0x7f9d580015e0 2023-10-16T20:06:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f9d580015e0 msgr2=0x7f9d58003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f9d580015e0 0x7f9d58003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9d6406af00 msgr2=0x7f9d6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9d6406af00 0x7f9d6406d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c000c00 tx=0x7f9d6c018000 comp rx=0 tx=0).stop 2023-10-16T20:06:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b5530 msgr2=0x7f9d7815abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7e630700 1 --2- 172.21.15.152:0/1547152338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d780b5530 0x7f9d7815abc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d6800b4a0 tx=0x7f9d6800b7b0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.790+0000 7f9d7cbcd700 1 -- 172.21.15.152:0/1547152338 reap_dead start 2023-10-16T20:06:52.896 INFO:teuthology.orchestra.run.smithi152.stdout:64424509450 2023-10-16T20:06:52.896 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T20:06:52.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.793+0000 7fd8a1b60700 1 -- 172.21.15.152:0/1067862403 reap_dead start 2023-10-16T20:06:52.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.793+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 shutdown_connections 2023-10-16T20:06:52.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.793+0000 7ff583547700 1 -- 172.21.15.152:0/2735052077 wait complete. 2023-10-16T20:06:52.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.793+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 shutdown_connections 2023-10-16T20:06:52.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.793+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 >> 172.21.15.152:0/1067862403 conn(0x7fd89c0cbad0 msgr2=0x7fd89c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.793+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 shutdown_connections 2023-10-16T20:06:52.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.795+0000 7fd8a35c3700 1 -- 172.21.15.152:0/1067862403 wait complete. 2023-10-16T20:06:52.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.796+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 shutdown_connections 2023-10-16T20:06:52.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.796+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 >> 172.21.15.152:0/1547152338 conn(0x7f9d7806bc70 msgr2=0x7f9d7815e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.796+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 shutdown_connections 2023-10-16T20:06:52.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.796+0000 7f9d7e630700 1 -- 172.21.15.152:0/1547152338 wait complete. 2023-10-16T20:06:52.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.797+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 --> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca300ca570 con 0x7fca100744c0 2023-10-16T20:06:52.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.797+0000 7fca1effd700 1 -- 172.21.15.152:0/4218974640 <== osd.2 v2:172.21.15.152:6800/4291228321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca280066e0 con 0x7fca100744c0 2023-10-16T20:06:52.902 INFO:teuthology.orchestra.run.smithi152.stdout:60129542155 2023-10-16T20:06:52.903 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T20:06:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.803+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 --> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7f815df20 con 0x7ff7e4086df0 2023-10-16T20:06:52.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.803+0000 7ff7ee7fc700 1 -- 172.21.15.152:0/4108261172 <== osd.7 v2:172.21.15.163:6824/3318028264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7e800ac10 con 0x7ff7e4086df0 2023-10-16T20:06:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7ff7e4086df0 msgr2=0x7ff7e4089230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7ff7e4086df0 0x7ff7e4089230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff7e407d930 msgr2=0x7ff7e407fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff7e407d930 0x7ff7e407fdf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40047d0 tx=0x7ff7f000b030 comp rx=0 tx=0).stop 2023-10-16T20:06:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f80c88d0 msgr2=0x7ff7f8150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 --2- 172.21.15.152:0/4108261172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff7f80c88d0 0x7ff7f8150260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400fa40 tx=0x7ff7f400fd50 comp rx=0 tx=0).stop 2023-10-16T20:06:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7fe425700 1 -- 172.21.15.152:0/4108261172 reap_dead start 2023-10-16T20:06:52.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 shutdown_connections 2023-10-16T20:06:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 >> 172.21.15.152:0/4108261172 conn(0x7ff7f806c850 msgr2=0x7ff7f81529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 shutdown_connections 2023-10-16T20:06:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.804+0000 7ff7ffe88700 1 -- 172.21.15.152:0/4108261172 wait complete. 2023-10-16T20:06:52.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.811+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 --> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14b4007170 con 0x7f14b4174d00 2023-10-16T20:06:52.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.812+0000 7f14b97fa700 1 -- 172.21.15.152:0/492463276 <== osd.1 v2:172.21.15.152:6816/3247585045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14a800a9b0 con 0x7f14b4174d00 2023-10-16T20:06:52.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.812+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f14b4174d00 msgr2=0x7f14b40e13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.812+0000 7f14c185b700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f14b4174d00 0x7f14b40e13c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.917 INFO:teuthology.orchestra.run.smithi152.stdout:64424509450 2023-10-16T20:06:52.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T20:06:52.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7fca100744c0 msgr2=0x7fca10076900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7fca100744c0 0x7fca10076900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.919 INFO:teuthology.orchestra.run.smithi152.stdout:64424509450 2023-10-16T20:06:52.920 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T20:06:52.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca1006af00 msgr2=0x7fca1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca1006af00 0x7fca1006d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca20009a50 tx=0x7fca20009190 comp rx=0 tx=0).stop 2023-10-16T20:06:52.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca300a9e40 msgr2=0x7fca300c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 --2- 172.21.15.152:0/4218974640 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca300a9e40 0x7fca300c86e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca300672a0 tx=0x7fca2400b670 comp rx=0 tx=0).stop 2023-10-16T20:06:52.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca2ed9d700 1 -- 172.21.15.152:0/4218974640 reap_dead start 2023-10-16T20:06:52.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 shutdown_connections 2023-10-16T20:06:52.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 >> 172.21.15.152:0/4218974640 conn(0x7fca300cbad0 msgr2=0x7fca300c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 shutdown_connections 2023-10-16T20:06:52.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.813+0000 7fca34aac700 1 -- 172.21.15.152:0/4218974640 wait complete. 2023-10-16T20:06:52.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.815+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14ac06f830 msgr2=0x7f14ac071cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.815+0000 7f14c185b700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f14ac06f830 0x7f14ac071cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14b404f570 tx=0x7f14b00079f0 comp rx=0 tx=0).stop 2023-10-16T20:06:52.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.815+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14b4175eb0 msgr2=0x7f14b40e0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:52.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.815+0000 7f14c185b700 1 --2- 172.21.15.152:0/492463276 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14b4175eb0 0x7f14b40e0e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f14bc06a070 tx=0x7f14bc068b50 comp rx=0 tx=0).stop 2023-10-16T20:06:52.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.815+0000 7f14c105a700 1 -- 172.21.15.152:0/492463276 reap_dead start 2023-10-16T20:06:52.924 INFO:teuthology.orchestra.run.smithi152.stdout:60129542155 2023-10-16T20:06:52.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T20:06:52.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.818+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 shutdown_connections 2023-10-16T20:06:52.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.818+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 >> 172.21.15.152:0/492463276 conn(0x7f14b4054d20 msgr2=0x7f14b4038930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:52.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.818+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 shutdown_connections 2023-10-16T20:06:52.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:52.818+0000 7f14c185b700 1 -- 172.21.15.152:0/492463276 wait complete. 2023-10-16T20:06:52.927 INFO:teuthology.orchestra.run.smithi152.stdout:64424509451 2023-10-16T20:06:52.927 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T20:06:52.928 INFO:teuthology.orchestra.run.smithi152.stdout:60129542154 2023-10-16T20:06:52.929 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T20:06:52.930 INFO:teuthology.orchestra.run.smithi152.stdout:60129542154 2023-10-16T20:06:52.930 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T20:06:53.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.148+0000 7f6238750700 1 Processor -- start 2023-10-16T20:06:53.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.148+0000 7f6238750700 1 -- start start 2023-10-16T20:06:53.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.149+0000 7f6238750700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f623015daa0 0x7f62300af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.149+0000 7f6238750700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f62300af560 0x7f6230071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.149+0000 7f6238750700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623015ed10 con 0x7f6230071d90 2023-10-16T20:06:53.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.149+0000 7f6238750700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6230072200 con 0x7f62300af560 2023-10-16T20:06:53.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.149+0000 7f6238750700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623015de80 con 0x7f623015daa0 2023-10-16T20:06:53.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.150+0000 7f6236ced700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6230071d90 0x7f62300ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39114/0 (socket says 172.21.15.152:39114) 2023-10-16T20:06:53.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.150+0000 7f6236ced700 1 -- 172.21.15.152:0/2757012444 learned_addr learned my addr 172.21.15.152:0/2757012444 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:53.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.150+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006315190 0 0) 0x7f623015ed10 con 0x7f6230071d90 2023-10-16T20:06:53.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.150+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f621c0057c0 con 0x7f6230071d90 2023-10-16T20:06:53.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4143152800 0 0) 0x7f621c0057c0 con 0x7f6230071d90 2023-10-16T20:06:53.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f623015daa0 msgr2=0x7f62300af020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:53.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f623015daa0 0x7f62300af020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 >> v2:172.21.15.163:3300/0 conn(0x7f62300af560 msgr2=0x7f6230071850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:53.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 --2- 172.21.15.152:0/2757012444 >> v2:172.21.15.163:3300/0 conn(0x7f62300af560 0x7f6230071850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623015e100 con 0x7f6230071d90 2023-10-16T20:06:53.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f6228001a40 con 0x7f6230071d90 2023-10-16T20:06:53.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 >> v1:172.21.15.152:6789/0 conn(0x7f6230071d90 legacy=0x7f62300ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c005c10 0x7f621c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c0065e0 0x7f621c006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f621c0072c0 0x7f621c014810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6230072200 con 0x7f621c005c10 2023-10-16T20:06:53.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623015de80 con 0x7f621c0065e0 2023-10-16T20:06:53.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00bcc0 con 0x7f621c0072c0 2023-10-16T20:06:53.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.151+0000 7f6236ced700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f621c0072c0 0x7f621c014810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f6236ced700 1 -- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c0065e0 msgr2=0x7f621c006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:53.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f6236ced700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c0065e0 0x7f621c006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f6236ced700 1 -- 172.21.15.152:0/2757012444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c005c10 msgr2=0x7f621c006030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:53.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f6236ced700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c005c10 0x7f621c006030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f6236ced700 1 -- 172.21.15.152:0/2757012444 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623015e100 con 0x7f621c0072c0 2023-10-16T20:06:53.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f6236ced700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f621c0072c0 0x7f621c014810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f622800a8a0 tx=0x7f621c007a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51989a26acff9cec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228012600 con 0x7f621c0072c0 2023-10-16T20:06:53.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228012760 con 0x7f621c0072c0 2023-10-16T20:06:53.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.152+0000 7f62354ea700 1 -- 172.21.15.152:0/2757012444 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228012b10 con 0x7f621c0072c0 2023-10-16T20:06:53.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.155+0000 7f6238750700 1 -- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f621c0072c0 msgr2=0x7f621c014810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.155+0000 7f6238750700 1 --2- 172.21.15.152:0/2757012444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f621c0072c0 0x7f621c014810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f622800a8a0 tx=0x7f621c007a90 comp rx=0 tx=0).stop 2023-10-16T20:06:53.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.155+0000 7f6236ced700 1 -- 172.21.15.152:0/2757012444 reap_dead start 2023-10-16T20:06:53.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.156+0000 7f6238750700 1 -- 172.21.15.152:0/2757012444 shutdown_connections 2023-10-16T20:06:53.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.156+0000 7f6238750700 1 -- 172.21.15.152:0/2757012444 >> 172.21.15.152:0/2757012444 conn(0x7f62300d0180 msgr2=0x7f62300d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.156+0000 7f6238750700 1 -- 172.21.15.152:0/2757012444 shutdown_connections 2023-10-16T20:06:53.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.156+0000 7f6238750700 1 -- 172.21.15.152:0/2757012444 wait complete. 2023-10-16T20:06:53.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.158+0000 7f6238750700 1 Processor -- start 2023-10-16T20:06:53.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.158+0000 7f6238750700 1 -- start start 2023-10-16T20:06:53.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.158+0000 7f86ec989700 1 Processor -- start 2023-10-16T20:06:53.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.158+0000 7f8707594700 1 Processor -- start 2023-10-16T20:06:53.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.158+0000 7f86ec989700 1 -- start start 2023-10-16T20:06:53.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6238750700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c0072c0 0x7f62301594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6238750700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6230157240 0x7f62300c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6238750700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62300c5ca0 0x7f62300c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6238750700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c6690 con 0x7f621c0072c0 2023-10-16T20:06:53.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6238750700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c8ae0 con 0x7f62300c5ca0 2023-10-16T20:06:53.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6238750700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6230159a00 con 0x7f6230157240 2023-10-16T20:06:53.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f62364ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c0072c0 0x7f62301594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6236ced700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62300c5ca0 0x7f62300c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f62364ec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c0072c0 0x7f62301594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58926/0 (socket says 172.21.15.152:58926) 2023-10-16T20:06:53.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f62364ec700 1 -- 172.21.15.152:0/4293879444 learned_addr learned my addr 172.21.15.152:0/4293879444 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f6235ceb700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6230157240 0x7f62300c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6236ced700 1 -- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6230157240 msgr2=0x7f62300c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6236ced700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6230157240 0x7f62300c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6236ced700 1 -- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c0072c0 msgr2=0x7f62301594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6236ced700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c0072c0 0x7f62301594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6236ced700 1 -- 172.21.15.152:0/4293879444 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623015c040 con 0x7f62300c5ca0 2023-10-16T20:06:53.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6236ced700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62300c5ca0 0x7f62300c6150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f622800a870 tx=0x7f6228001d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.159+0000 7f8707594700 1 -- start start 2023-10-16T20:06:53.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86ec989700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86e80cc5f0 0x7f86e8159810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86ec989700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80cb210 0x7f86e806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8707594700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f870006daf0 0x7f870006ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86ec989700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86e806eb10 0x7f86e806e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86ec989700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80c9cd0 con 0x7f86e80cc5f0 2023-10-16T20:06:53.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86ec989700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80c9fb0 con 0x7f86e806eb10 2023-10-16T20:06:53.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86ec989700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80ca290 con 0x7f86e80cb210 2023-10-16T20:06:53.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86e659c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86e80cc5f0 0x7f86e8159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86e659c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86e80cc5f0 0x7f86e8159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58930/0 (socket says 172.21.15.152:58930) 2023-10-16T20:06:53.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86e659c700 1 -- 172.21.15.152:0/806828665 learned_addr learned my addr 172.21.15.152:0/806828665 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86e6d9d700 1 --2- 172.21.15.152:0/806828665 >> v2:172.21.15.163:3300/0 conn(0x7f86e806eb10 0x7f86e806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622801e600 con 0x7f62300c5ca0 2023-10-16T20:06:53.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8707594700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006eb10 0x7f8700070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8707594700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87000c9a30 con 0x7f87000cb210 2023-10-16T20:06:53.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8707594700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870006e410 con 0x7f870006daf0 2023-10-16T20:06:53.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8707594700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000c9cd0 con 0x7f870006eb10 2023-10-16T20:06:53.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622801e760 con 0x7f62300c5ca0 2023-10-16T20:06:53.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622801eb10 con 0x7f62300c5ca0 2023-10-16T20:06:53.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8705330700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f870006daf0 0x7f870006ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f86e5d9b700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80cb210 0x7f86e806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8705330700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f870006daf0 0x7f870006ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59936/0 (socket says 172.21.15.152:59936) 2023-10-16T20:06:53.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.160+0000 7f8705330700 1 -- 172.21.15.152:0/1878833230 learned_addr learned my addr 172.21.15.152:0/1878833230 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f8705b31700 1 --2- 172.21.15.152:0/1878833230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006eb10 0x7f8700070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623015c320 con 0x7f62300c5ca0 2023-10-16T20:06:53.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62300c86b0 con 0x7f62300c5ca0 2023-10-16T20:06:53.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86f7fff700 1 -- 172.21.15.152:0/1878833230 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717645977 0 0) 0x7f87000c9a30 con 0x7f87000cb210 2023-10-16T20:06:53.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86f7fff700 1 -- 172.21.15.152:0/1878833230 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86ec0035b0 con 0x7f87000cb210 2023-10-16T20:06:53.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f8705b31700 1 -- 172.21.15.152:0/1878833230 >> v2:172.21.15.163:3300/0 conn(0x7f870006daf0 msgr2=0x7f870006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:53.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f8705b31700 1 --2- 172.21.15.152:0/1878833230 >> v2:172.21.15.163:3300/0 conn(0x7f870006daf0 0x7f870006ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f8705b31700 1 -- 172.21.15.152:0/1878833230 >> v1:172.21.15.163:6789/0 conn(0x7f87000cb210 legacy=0x7f87000705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f8705b31700 1 -- 172.21.15.152:0/1878833230 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000c9fb0 con 0x7f870006eb10 2023-10-16T20:06:53.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f8705b31700 1 --2- 172.21.15.152:0/1878833230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006eb10 0x7f8700070cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f86f000b1b0 tx=0x7f86f000b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff74ad3f0c656b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86f7fff700 1 -- 172.21.15.152:0/1878833230 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0011420 con 0x7f870006eb10 2023-10-16T20:06:53.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e659c700 1 -- 172.21.15.152:0/806828665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80cb210 msgr2=0x7f86e806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:53.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e659c700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80cb210 0x7f86e806daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e659c700 1 -- 172.21.15.152:0/806828665 >> v2:172.21.15.163:3300/0 conn(0x7f86e806eb10 msgr2=0x7f86e806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:53.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e659c700 1 --2- 172.21.15.152:0/806828665 >> v2:172.21.15.163:3300/0 conn(0x7f86e806eb10 0x7f86e806e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e659c700 1 -- 172.21.15.152:0/806828665 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80ca570 con 0x7f86e80cc5f0 2023-10-16T20:06:53.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e5d9b700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80cb210 0x7f86e806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:53.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86e6d9d700 1 --2- 172.21.15.152:0/806828665 >> v2:172.21.15.163:3300/0 conn(0x7f86e806eb10 0x7f86e806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:53.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86f7fff700 1 -- 172.21.15.152:0/1878833230 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0011580 con 0x7f870006eb10 2023-10-16T20:06:53.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.161+0000 7f86f7fff700 1 -- 172.21.15.152:0/1878833230 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00118f0 con 0x7f870006eb10 2023-10-16T20:06:53.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62300c8930 con 0x7f62300c5ca0 2023-10-16T20:06:53.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f5f8332c700 1 Processor -- start 2023-10-16T20:06:53.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f1a380a7700 1 Processor -- start 2023-10-16T20:06:53.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f8707594700 1 -- 172.21.15.152:0/1878833230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006eb10 msgr2=0x7f8700070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f8707594700 1 --2- 172.21.15.152:0/1878833230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006eb10 0x7f8700070cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f86f000b1b0 tx=0x7f86f000b4c0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6228019030 con 0x7f62300c5ca0 2023-10-16T20:06:53.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f86e659c700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cc5f0 0x7f86e8159810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86e80aebc0 tx=0x7f86d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa77d9a71b081b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f86e559a700 1 -- 172.21.15.152:0/806828665 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8011830 con 0x7f86e80cc5f0 2023-10-16T20:06:53.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f86e559a700 1 -- 172.21.15.152:0/806828665 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8011990 con 0x7f86e80cc5f0 2023-10-16T20:06:53.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f86e559a700 1 -- 172.21.15.152:0/806828665 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8011d20 con 0x7f86e80cc5f0 2023-10-16T20:06:53.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f8707594700 1 -- 172.21.15.152:0/1878833230 shutdown_connections 2023-10-16T20:06:53.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f8707594700 1 --2- 172.21.15.152:0/1878833230 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006eb10 0x7f8700070cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.162+0000 7f5f8332c700 1 -- start start 2023-10-16T20:06:53.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f8707594700 1 --2- 172.21.15.152:0/1878833230 >> v2:172.21.15.163:3300/0 conn(0x7f870006daf0 0x7f870006ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f8707594700 1 -- 172.21.15.152:0/1878833230 >> 172.21.15.152:0/1878833230 conn(0x7f87000cbad0 msgr2=0x7f87000cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f6226ffd700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406afd0 0x7f621406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f86ec989700 1 -- 172.21.15.152:0/806828665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cc5f0 msgr2=0x7f86e8159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f86ec989700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cc5f0 0x7f86e8159810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86e80aebc0 tx=0x7f86d8009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f622808b3e0 con 0x7f62300c5ca0 2023-10-16T20:06:53.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f1a380a7700 1 -- start start 2023-10-16T20:06:53.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f62364ec700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406afd0 0x7f621406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f8707594700 1 -- 172.21.15.152:0/1878833230 shutdown_connections 2023-10-16T20:06:53.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 -- 172.21.15.152:0/806828665 shutdown_connections 2023-10-16T20:06:53.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 --2- 172.21.15.152:0/806828665 >> v2:172.21.15.163:3300/0 conn(0x7f86e806eb10 0x7f86e806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cc5f0 0x7f86e8159810 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86e80aebc0 tx=0x7f86d8009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 --2- 172.21.15.152:0/806828665 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80cb210 0x7f86e806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 -- 172.21.15.152:0/806828665 >> 172.21.15.152:0/806828665 conn(0x7f86e80cbad0 msgr2=0x7f86e80cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.163+0000 7f5f8332c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5f7c06daf0 0x7f5f7c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f8332c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5f7c06eb10 0x7f5f7c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f8332c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0c9a30 con 0x7f5f7c0cb210 2023-10-16T20:06:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f8332c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c06e410 con 0x7f5f7c06eb10 2023-10-16T20:06:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f8332c700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c9cd0 con 0x7f5f7c06daf0 2023-10-16T20:06:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f808c7700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5f7c0cb210 0x7f5f7c0705e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54324/0 (socket says 172.21.15.152:54324) 2023-10-16T20:06:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f808c7700 1 -- 172.21.15.152:0/281193675 learned_addr learned my addr 172.21.15.152:0/281193675 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f5f818c9700 1 --2- 172.21.15.152:0/281193675 >> v2:172.21.15.152:3300/0 conn(0x7f5f7c06eb10 0x7f5f7c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f818c9700 1 -- 172.21.15.152:0/281193675 >> v2:172.21.15.163:3300/0 conn(0x7f5f7c06daf0 msgr2=0x7f5f7c06ded0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f818c9700 1 --2- 172.21.15.152:0/281193675 >> v2:172.21.15.163:3300/0 conn(0x7f5f7c06daf0 0x7f5f7c06ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f818c9700 1 -- 172.21.15.152:0/281193675 >> v1:172.21.15.163:6789/0 conn(0x7f5f7c0cb210 legacy=0x7f5f7c0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f818c9700 1 -- 172.21.15.152:0/281193675 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0c9fb0 con 0x7f5f7c06eb10 2023-10-16T20:06:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a380a7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a300b0c30 0x7f1a300b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a380a7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1a3015b600 0x7f1a300ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a380a7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a300c9d40 con 0x7f1a300b1860 2023-10-16T20:06:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a380a7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a300b1550 con 0x7f1a300b0c30 2023-10-16T20:06:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a380a7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a300cd6d0 con 0x7f1a3015b600 2023-10-16T20:06:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f8707594700 1 -- 172.21.15.152:0/1878833230 wait complete. 2023-10-16T20:06:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7fd4bfb1a700 1 Processor -- start 2023-10-16T20:06:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f818c9700 1 --2- 172.21.15.152:0/281193675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06eb10 0x7f5f7c070cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c06a1b0 tx=0x7f5f6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19c25093e1a5b37 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35642700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f1a300b1860 0x7f1a300ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54328/0 (socket says 172.21.15.152:54328) 2023-10-16T20:06:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35642700 1 -- 172.21.15.152:0/2555538866 learned_addr learned my addr 172.21.15.152:0/2555538866 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35e43700 1 --2- 172.21.15.152:0/2555538866 >> v2:172.21.15.152:3300/0 conn(0x7f1a300b0c30 0x7f1a300b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a36644700 1 --2- 172.21.15.152:0/2555538866 >> v2:172.21.15.163:3300/0 conn(0x7f1a3015b600 0x7f1a300ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f7bfff700 1 -- 172.21.15.152:0/281193675 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c00e070 con 0x7f5f7c06eb10 2023-10-16T20:06:53.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f8707594700 1 Processor -- start 2023-10-16T20:06:53.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f7bfff700 1 -- 172.21.15.152:0/281193675 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c00bbd0 con 0x7f5f7c06eb10 2023-10-16T20:06:53.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f5f7bfff700 1 -- 172.21.15.152:0/281193675 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c012430 con 0x7f5f7c06eb10 2023-10-16T20:06:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7fd1161a3700 1 Processor -- start 2023-10-16T20:06:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7fd1161a3700 1 -- start start 2023-10-16T20:06:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35e43700 1 -- 172.21.15.152:0/2555538866 >> v2:172.21.15.163:3300/0 conn(0x7f1a3015b600 msgr2=0x7f1a300ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35e43700 1 --2- 172.21.15.152:0/2555538866 >> v2:172.21.15.163:3300/0 conn(0x7f1a3015b600 0x7f1a300ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35e43700 1 -- 172.21.15.152:0/2555538866 >> v1:172.21.15.163:6789/0 conn(0x7f1a300b1860 legacy=0x7f1a300ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f1a35e43700 1 -- 172.21.15.152:0/2555538866 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a300cd9a0 con 0x7f1a300b0c30 2023-10-16T20:06:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f1a35e43700 1 --2- 172.21.15.152:0/2555538866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a300b0c30 0x7f1a300b1010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1a3006d780 tx=0x7f1a20009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797f79c65a2b8bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.165+0000 7f8707594700 1 -- start start 2023-10-16T20:06:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 -- 172.21.15.152:0/806828665 shutdown_connections 2023-10-16T20:06:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.164+0000 7f86ec989700 1 -- 172.21.15.152:0/806828665 wait complete. 2023-10-16T20:06:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f86ec989700 1 Processor -- start 2023-10-16T20:06:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f1a34e41700 1 -- 172.21.15.152:0/2555538866 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011830 con 0x7f1a300b0c30 2023-10-16T20:06:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f1a34e41700 1 -- 172.21.15.152:0/2555538866 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20011990 con 0x7f1a300b0c30 2023-10-16T20:06:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f1a34e41700 1 -- 172.21.15.152:0/2555538866 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011d20 con 0x7f1a300b0c30 2023-10-16T20:06:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f86ec989700 1 -- start start 2023-10-16T20:06:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f5f8332c700 1 -- 172.21.15.152:0/281193675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06eb10 msgr2=0x7f5f7c070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.166+0000 7f5f8332c700 1 --2- 172.21.15.152:0/281193675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06eb10 0x7f5f7c070cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c06a1b0 tx=0x7f5f6c00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f5f8332c700 1 -- 172.21.15.152:0/281193675 shutdown_connections 2023-10-16T20:06:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f5f8332c700 1 --2- 172.21.15.152:0/281193675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06eb10 0x7f5f7c070cf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f5f8332c700 1 --2- 172.21.15.152:0/281193675 >> v2:172.21.15.163:3300/0 conn(0x7f5f7c06daf0 0x7f5f7c06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f5f8332c700 1 -- 172.21.15.152:0/281193675 >> 172.21.15.152:0/281193675 conn(0x7f5f7c0cbad0 msgr2=0x7f5f7c0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8707594700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006daf0 0x7f870015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8707594700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f870006eb10 0x7f87000b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8707594700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cb210 0x7f8700142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8707594700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700159a80 con 0x7f87000cb210 2023-10-16T20:06:53.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8707594700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870015a290 con 0x7f870006eb10 2023-10-16T20:06:53.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8707594700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000afbb0 con 0x7f870006daf0 2023-10-16T20:06:53.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd1161a3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd11015d530 0x7fd1100c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd1161a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd110161a80 0x7fd1100cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd1161a3700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd110161e90 con 0x7fd1100cbc30 2023-10-16T20:06:53.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd1161a3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1101620c0 con 0x7fd11015d530 2023-10-16T20:06:53.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd1161a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100cc600 con 0x7fd110161a80 2023-10-16T20:06:53.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 -- 172.21.15.152:0/2555538866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a300b0c30 msgr2=0x7f1a300b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 --2- 172.21.15.152:0/2555538866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a300b0c30 0x7f1a300b1010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1a3006d780 tx=0x7f1a20009b20 comp rx=0 tx=0).stop 2023-10-16T20:06:53.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 -- 172.21.15.152:0/2555538866 shutdown_connections 2023-10-16T20:06:53.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705b31700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cb210 0x7f8700142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705b31700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cb210 0x7f8700142b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58960/0 (socket says 172.21.15.152:58960) 2023-10-16T20:06:53.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705b31700 1 -- 172.21.15.152:0/3899073788 learned_addr learned my addr 172.21.15.152:0/3899073788 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705330700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006daf0 0x7f870015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 --2- 172.21.15.152:0/2555538866 >> v2:172.21.15.163:3300/0 conn(0x7f1a3015b600 0x7f1a300ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 --2- 172.21.15.152:0/2555538866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a300b0c30 0x7f1a300b1010 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1a3006d780 tx=0x7f1a20009b20 comp rx=0 tx=0).stop 2023-10-16T20:06:53.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 -- 172.21.15.152:0/2555538866 >> 172.21.15.152:0/2555538866 conn(0x7f1a3006c850 msgr2=0x7f1a3006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f5f8332c700 1 -- 172.21.15.152:0/281193675 shutdown_connections 2023-10-16T20:06:53.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 -- 172.21.15.152:0/2555538866 shutdown_connections 2023-10-16T20:06:53.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd10f7fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd11015d530 0x7fd1100c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd10effd700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fd1100cbc30 0x7fd110161370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54340/0 (socket says 172.21.15.152:54340) 2023-10-16T20:06:53.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7fd10effd700 1 -- 172.21.15.152:0/77429476 learned_addr learned my addr 172.21.15.152:0/77429476 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:53.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7fd10ffff700 1 --2- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd110161a80 0x7fd1100cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86ec989700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e806eb10 0x7f86e814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86ec989700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cb210 0x7f86e80c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86ec989700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80c5a00 0x7f86e8149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86ec989700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80b2dc0 con 0x7f86e80cb210 2023-10-16T20:06:53.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86ec989700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80b2140 con 0x7f86e806eb10 2023-10-16T20:06:53.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86ec989700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80b2420 con 0x7f86e80c5a00 2023-10-16T20:06:53.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cb210 0x7f86e80c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cb210 0x7f86e80c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58970/0 (socket says 172.21.15.152:58970) 2023-10-16T20:06:53.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7fd10f7fe700 1 -- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd110161a80 msgr2=0x7fd1100cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:53.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7fd10f7fe700 1 --2- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd110161a80 0x7fd1100cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7fd10f7fe700 1 -- 172.21.15.152:0/77429476 >> v1:172.21.15.163:6789/0 conn(0x7fd1100cbc30 legacy=0x7fd110161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e5d9b700 1 -- 172.21.15.152:0/1230649067 learned_addr learned my addr 172.21.15.152:0/1230649067 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e6d9d700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80c5a00 0x7f86e8149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7fd10f7fe700 1 -- 172.21.15.152:0/77429476 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100acf30 con 0x7fd11015d530 2023-10-16T20:06:53.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e659c700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e806eb10 0x7f86e814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f62364ec700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406afd0 0x7f621406d490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6220009990 tx=0x7f6220006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7fd10f7fe700 1 --2- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd11015d530 0x7fd1100c9740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd100009840 tx=0x7fd100009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3941d7163e196e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7fd4bfb1a700 1 -- start start 2023-10-16T20:06:53.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f1a380a7700 1 -- 172.21.15.152:0/2555538866 wait complete. 2023-10-16T20:06:53.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f1a380a7700 1 Processor -- start 2023-10-16T20:06:53.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705330700 1 -- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f870006eb10 msgr2=0x7f87000b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705330700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f870006eb10 0x7f87000b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705330700 1 -- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cb210 msgr2=0x7f8700142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705330700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cb210 0x7f8700142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f8705330700 1 -- 172.21.15.152:0/3899073788 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0009d30 con 0x7f870006daf0 2023-10-16T20:06:53.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.167+0000 7f5f8332c700 1 -- 172.21.15.152:0/281193675 wait complete. 2023-10-16T20:06:53.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f5f8332c700 1 Processor -- start 2023-10-16T20:06:53.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f1a380a7700 1 -- start start 2023-10-16T20:06:53.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f8705330700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006daf0 0x7f870015c890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86f8007b20 tx=0x7f86f8007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800da90 con 0x7f870006daf0 2023-10-16T20:06:53.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800f040 con 0x7f870006daf0 2023-10-16T20:06:53.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800ddf0 con 0x7f870006daf0 2023-10-16T20:06:53.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700159cd0 con 0x7f870006daf0 2023-10-16T20:06:53.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f5f8332c700 1 -- start start 2023-10-16T20:06:53.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87000afe50 con 0x7f870006daf0 2023-10-16T20:06:53.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e6d9d700 1 -- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e806eb10 msgr2=0x7f86e814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e6d9d700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e806eb10 0x7f86e814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e6d9d700 1 -- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cb210 msgr2=0x7f86e80c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e6d9d700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cb210 0x7f86e80c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.168+0000 7f86e6d9d700 1 -- 172.21.15.152:0/1230649067 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009a70 con 0x7f86e80c5a00 2023-10-16T20:06:53.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86e659c700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e806eb10 0x7f86e814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:53.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86e6d9d700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80c5a00 0x7f86e8149660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86e000eed0 tx=0x7f86e000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0010040 con 0x7f86e80c5a00 2023-10-16T20:06:53.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e000bb30 con 0x7f86e80c5a00 2023-10-16T20:06:53.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.169+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0003a20 con 0x7f86e80c5a00 2023-10-16T20:06:53.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8009550 con 0x7f86e80c5a00 2023-10-16T20:06:53.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e80b29e0 con 0x7f86e80c5a00 2023-10-16T20:06:53.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f1a380a7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 0x7f1a301595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f1a380a7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a3015b600 0x7f1a300af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f1a380a7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a300c56e0 0x7f1a300afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f1a380a7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300af270 con 0x7f1a3015b600 2023-10-16T20:06:53.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f1a380a7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300c5ea0 con 0x7f1a300c56e0 2023-10-16T20:06:53.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f1a380a7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300c5bc0 con 0x7f1a300b1860 2023-10-16T20:06:53.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6228056210 con 0x7f62300c5ca0 2023-10-16T20:06:53.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bfb1a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4b815daa0 0x7fd4b80af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bfb1a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b815ed10 con 0x7fd4b8071f60 2023-10-16T20:06:53.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bfb1a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b815de80 con 0x7fd4b80af560 2023-10-16T20:06:53.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bfb1a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b815e100 con 0x7fd4b815daa0 2023-10-16T20:06:53.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bd8b6700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4b815daa0 0x7fd4b80af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bd8b6700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4b815daa0 0x7fd4b80af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58974/0 (socket says 172.21.15.152:58974) 2023-10-16T20:06:53.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bd8b6700 1 -- 172.21.15.152:0/573698453 learned_addr learned my addr 172.21.15.152:0/573698453 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd4bd0b5700 1 --1- 172.21.15.152:0/573698453 >> v1:172.21.15.163:6789/0 conn(0x7fd4b80af560 0x7fd4b8071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54354/0 (socket says 172.21.15.152:54354) 2023-10-16T20:06:53.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f5f8332c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06daf0 0x7f5f7c200290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f5f8332c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f7c06eb10 0x7f5f7c159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f5f8332c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 0x7f5f7c202e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f5f8332c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c2007d0 con 0x7f5f7c06daf0 2023-10-16T20:06:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f5f8332c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c2038c0 con 0x7f5f7c06eb10 2023-10-16T20:06:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7f5f8332c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c203ba0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 0x7f5f7c202e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 0x7f5f7c202e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47630/0 (socket says 172.21.15.152:47630) 2023-10-16T20:06:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 -- 172.21.15.152:0/3906500281 learned_addr learned my addr 172.21.15.152:0/3906500281 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 -- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f7c06eb10 msgr2=0x7f5f7c159fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T20:06:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f7c06eb10 0x7f5f7c159fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 -- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06daf0 msgr2=0x7f5f7c200290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T20:06:53.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06daf0 0x7f5f7c200290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 -- 172.21.15.152:0/3906500281 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009a70 con 0x7f5f7c0cb210 2023-10-16T20:06:53.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7f5f818c9700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 0x7f5f7c202e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c06c130 tx=0x7f5f6c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd10e7fc700 1 -- 172.21.15.152:0/77429476 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100011830 con 0x7fd11015d530 2023-10-16T20:06:53.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd4bd8b6700 1 -- 172.21.15.152:0/573698453 >> v1:172.21.15.163:6789/0 conn(0x7fd4b80af560 legacy=0x7fd4b8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd4bd8b6700 1 -- 172.21.15.152:0/573698453 >> v1:172.21.15.152:6789/0 conn(0x7fd4b8071f60 legacy=0x7fd4b806d100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:53.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd4bd8b6700 1 -- 172.21.15.152:0/573698453 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b815e3e0 con 0x7fd4b815daa0 2023-10-16T20:06:53.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd4bd8b6700 1 --2- 172.21.15.152:0/573698453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80af020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80098f0 tx=0x7fd4a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c912441ff8276ffd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd4bc8b4700 1 -- 172.21.15.152:0/573698453 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8012b80 con 0x7fd4b815daa0 2023-10-16T20:06:53.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.170+0000 7fd10e7fc700 1 -- 172.21.15.152:0/77429476 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100011990 con 0x7fd11015d530 2023-10-16T20:06:53.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd10e7fc700 1 -- 172.21.15.152:0/77429476 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100011d00 con 0x7fd11015d530 2023-10-16T20:06:53.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd1161a3700 1 -- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd11015d530 msgr2=0x7fd1100c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd1161a3700 1 --2- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd11015d530 0x7fd1100c9740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd100009840 tx=0x7fd100009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:53.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0048e0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 0x7f1a301595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 0x7f1a301595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47632/0 (socket says 172.21.15.152:47632) 2023-10-16T20:06:53.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 -- 172.21.15.152:0/3634031769 learned_addr learned my addr 172.21.15.152:0/3634031769 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a36644700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a300c56e0 0x7f1a300afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f86e001d410 con 0x7f86e80c5a00 2023-10-16T20:06:53.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 -- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a300c56e0 msgr2=0x7f1a300afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a300c56e0 0x7f1a300afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 -- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a3015b600 msgr2=0x7f1a300af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a3015b600 0x7f1a300af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f1a35e43700 1 -- 172.21.15.152:0/3634031769 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200094a0 con 0x7f1a300b1860 2023-10-16T20:06:53.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.171+0000 7fd4bc8b4700 1 -- 172.21.15.152:0/573698453 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8012ce0 con 0x7fd4b815daa0 2023-10-16T20:06:53.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7fd4bc8b4700 1 -- 172.21.15.152:0/573698453 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8004250 con 0x7fd4b815daa0 2023-10-16T20:06:53.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f1a35e43700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 0x7f1a301595c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a200090b0 tx=0x7f1a20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f86d6ffd700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86c806af00 0x7f86c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86e0089d30 con 0x7f86e80c5a00 2023-10-16T20:06:53.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f86f8015400 con 0x7f870006daf0 2023-10-16T20:06:53.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f86f5ffb700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86f80894e0 con 0x7f870006daf0 2023-10-16T20:06:53.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f8704b2f700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/573698453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 msgr2=0x7fd4b80af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/573698453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80af020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80098f0 tx=0x7fd4a8009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:53.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c020070 con 0x7f5f7c0cb210 2023-10-16T20:06:53.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0276c0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c1ffa90 con 0x7f5f7c0cb210 2023-10-16T20:06:53.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.172+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c15a4f0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200044d0 con 0x7f1a300b1860 2023-10-16T20:06:53.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2001f070 con 0x7f1a300b1860 2023-10-16T20:06:53.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.173+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200038e0 con 0x7f1a300b1860 2023-10-16T20:06:53.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e804ebb0 con 0x7f86e80c5a00 2023-10-16T20:06:53.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/573698453 shutdown_connections 2023-10-16T20:06:53.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/573698453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80af020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/573698453 >> 172.21.15.152:0/573698453 conn(0x7fd4b80d0180 msgr2=0x7fd4b80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7f8704b2f700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86fc007fd0 tx=0x7f86fc007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/573698453 shutdown_connections 2023-10-16T20:06:53.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/573698453 wait complete. 2023-10-16T20:06:53.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a300aec20 con 0x7f1a300b1860 2023-10-16T20:06:53.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3014ff70 con 0x7f1a300b1860 2023-10-16T20:06:53.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7fd1161a3700 1 -- 172.21.15.152:0/77429476 shutdown_connections 2023-10-16T20:06:53.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7fd1161a3700 1 --2- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd110161a80 0x7fd1100cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7fd1161a3700 1 --2- 172.21.15.152:0/77429476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd11015d530 0x7fd1100c9740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7fd1161a3700 1 -- 172.21.15.152:0/77429476 >> 172.21.15.152:0/77429476 conn(0x7fd1100b0ae0 msgr2=0x7fd1100b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3004f400 con 0x7f1a300b1860 2023-10-16T20:06:53.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.174+0000 7f86e659c700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86c806af00 0x7f86c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a20003a40 con 0x7f1a300b1860 2023-10-16T20:06:53.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e00052f0 con 0x7f870006daf0 2023-10-16T20:06:53.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f6c012430 con 0x7f5f7c0cb210 2023-10-16T20:06:53.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.175+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c0052f0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7f86e659c700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86c806af00 0x7f86c806d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86e8067730 tx=0x7f86d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7f5f79ffb700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f6406b080 0x7f5f6406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f6c022070 con 0x7f5f7c0cb210 2023-10-16T20:06:53.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7fd4bfb1a700 1 Processor -- start 2023-10-16T20:06:53.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7f1a267fc700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1a1406af00 0x7f1a1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a20021070 con 0x7f1a300b1860 2023-10-16T20:06:53.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7fd1161a3700 1 -- 172.21.15.152:0/77429476 shutdown_connections 2023-10-16T20:06:53.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7fd1161a3700 1 -- 172.21.15.152:0/77429476 wait complete. 2023-10-16T20:06:53.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7f1a35642700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1a1406af00 0x7f1a1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.176+0000 7fd4bfb1a700 1 -- start start 2023-10-16T20:06:53.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7f1a35642700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1a1406af00 0x7f1a1406d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a300b4400 tx=0x7f1a2c007ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fa0f953c700 1 Processor -- start 2023-10-16T20:06:53.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fa0f953c700 1 -- start start 2023-10-16T20:06:53.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bfb1a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4b8071f60 0x7fd4b80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bfb1a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4b80af560 0x7fd4b80c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bfb1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bfb1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815c1b0 con 0x7fd4b815daa0 2023-10-16T20:06:53.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bfb1a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80c47e0 con 0x7fd4b8071f60 2023-10-16T20:06:53.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bfb1a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80c4ac0 con 0x7fd4b80af560 2023-10-16T20:06:53.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bd8b6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4b8071f60 0x7fd4b80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4be0b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bd8b6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4b8071f60 0x7fd4b80c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:59994/0 (socket says 172.21.15.152:59994) 2023-10-16T20:06:53.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bd8b6700 1 -- 172.21.15.152:0/2335983953 learned_addr learned my addr 172.21.15.152:0/2335983953 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4bd0b5700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4b80af560 0x7fd4b80c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.177+0000 7fd4be0b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58998/0 (socket says 172.21.15.152:58998) 2023-10-16T20:06:53.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd4bd0b5700 1 -- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4b8071f60 msgr2=0x7fd4b80c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd4bd0b5700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4b8071f60 0x7fd4b80c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd4bd0b5700 1 -- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 msgr2=0x7fd4b80c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd4bd0b5700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd4bd0b5700 1 -- 172.21.15.152:0/2335983953 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8009550 con 0x7fd4b80af560 2023-10-16T20:06:53.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd1161a3700 1 Processor -- start 2023-10-16T20:06:53.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7f5f810c8700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f6406b080 0x7f5f6406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7f5f810c8700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f6406b080 0x7f5f6406d540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c151cb0 tx=0x7f5f74006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd4bd0b5700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4b80af560 0x7fd4b80c3c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400c490 tx=0x7fd4b400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f953c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa0f415ecb0 0x7fa0f406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f953c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa0f406a820 0x7fa0f41670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f953c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f406bd90 con 0x7fa0f40ccd60 2023-10-16T20:06:53.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f953c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f406d4e0 con 0x7fa0f415ecb0 2023-10-16T20:06:53.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f953c700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f406d7c0 con 0x7fa0f406a820 2023-10-16T20:06:53.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f37fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa0f415ecb0 0x7fa0f406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f37fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa0f415ecb0 0x7fa0f406ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59002/0 (socket says 172.21.15.152:59002) 2023-10-16T20:06:53.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f37fe700 1 -- 172.21.15.152:0/3919452542 learned_addr learned my addr 172.21.15.152:0/3919452542 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f8d3b700 1 --2- 172.21.15.152:0/3919452542 >> v2:172.21.15.163:3300/0 conn(0x7fa0f406a820 0x7fa0f41670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fd1161a3700 1 -- start start 2023-10-16T20:06:53.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f8d3b700 1 -- 172.21.15.152:0/3919452542 >> v2:172.21.15.152:3300/0 conn(0x7fa0f415ecb0 msgr2=0x7fa0f406ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:53.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f8d3b700 1 --2- 172.21.15.152:0/3919452542 >> v2:172.21.15.152:3300/0 conn(0x7fa0f415ecb0 0x7fa0f406ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f8d3b700 1 -- 172.21.15.152:0/3919452542 >> v1:172.21.15.152:6789/0 conn(0x7fa0f40ccd60 legacy=0x7fa0f40cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.178+0000 7fa0f8d3b700 1 -- 172.21.15.152:0/3919452542 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f406daa0 con 0x7fa0f406a820 2023-10-16T20:06:53.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.179+0000 7fa0f8d3b700 1 --2- 172.21.15.152:0/3919452542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f406a820 0x7fa0f41670f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40cf050 tx=0x7fa0ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fa941c1c3b7d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.179+0000 7fa0f2ffd700 1 -- 172.21.15.152:0/3919452542 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00e070 con 0x7fa0f406a820 2023-10-16T20:06:53.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.179+0000 7fa0f2ffd700 1 -- 172.21.15.152:0/3919452542 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00bb20 con 0x7fa0f406a820 2023-10-16T20:06:53.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.179+0000 7fa0f2ffd700 1 -- 172.21.15.152:0/3919452542 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec012430 con 0x7fa0f406a820 2023-10-16T20:06:53.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.179+0000 7fa0f953c700 1 -- 172.21.15.152:0/3919452542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f406a820 msgr2=0x7fa0f41670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.179+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3919452542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f406a820 0x7fa0f41670f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40cf050 tx=0x7fa0ec00b330 comp rx=0 tx=0).stop 2023-10-16T20:06:53.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fa0f953c700 1 -- 172.21.15.152:0/3919452542 shutdown_connections 2023-10-16T20:06:53.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3919452542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f406a820 0x7fa0f41670f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3919452542 >> v2:172.21.15.152:3300/0 conn(0x7fa0f415ecb0 0x7fa0f406ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fa0f953c700 1 -- 172.21.15.152:0/3919452542 >> 172.21.15.152:0/3919452542 conn(0x7fa0f40cf7c0 msgr2=0x7fa0f40cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd1161a3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1100cbc30 0x7fd110150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd1161a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd11015d530 0x7fd1100b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd1161a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd110161a80 0x7fd1100c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd1161a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100c5e00 con 0x7fd110161a80 2023-10-16T20:06:53.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd1161a3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100b3660 con 0x7fd1100cbc30 2023-10-16T20:06:53.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd1161a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11014f470 con 0x7fd11015d530 2023-10-16T20:06:53.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86e0054b80 con 0x7f86e80c5a00 2023-10-16T20:06:53.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd110161a80 0x7fd1100c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fa0f953c700 1 -- 172.21.15.152:0/3919452542 shutdown_connections 2023-10-16T20:06:53.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd110161a80 0x7fd1100c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59008/0 (socket says 172.21.15.152:59008) 2023-10-16T20:06:53.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10ffff700 1 -- 172.21.15.152:0/2920416054 learned_addr learned my addr 172.21.15.152:0/2920416054 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1100cbc30 0x7fd110150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10effd700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd11015d530 0x7fd1100b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fa0f953c700 1 -- 172.21.15.152:0/3919452542 wait complete. 2023-10-16T20:06:53.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 -- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd11015d530 msgr2=0x7fd1100b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd11015d530 0x7fd1100b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 -- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd110161a80 msgr2=0x7fd1100c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd110161a80 0x7fd1100c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 -- 172.21.15.152:0/2920416054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000094a0 con 0x7fd1100cbc30 2023-10-16T20:06:53.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10effd700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd11015d530 0x7fd1100b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:53.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.180+0000 7fd10f7fe700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1100cbc30 0x7fd110150230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd100016000 tx=0x7fd100004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.181+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100004510 con 0x7fd1100cbc30 2023-10-16T20:06:53.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.181+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10001f070 con 0x7fd1100cbc30 2023-10-16T20:06:53.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.181+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000038e0 con 0x7fd1100cbc30 2023-10-16T20:06:53.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.181+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11014f750 con 0x7fd1100cbc30 2023-10-16T20:06:53.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.181+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11014fd10 con 0x7fd1100cbc30 2023-10-16T20:06:53.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.181+0000 7fa0f953c700 1 Processor -- start 2023-10-16T20:06:53.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 -- start start 2023-10-16T20:06:53.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 0x7fa0f4149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0f40ccd60 0x7fa0f4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f415ecb0 0x7fa0f41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f415c140 con 0x7fa0f406a820 2023-10-16T20:06:53.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41f37d0 con 0x7fa0f415ecb0 2023-10-16T20:06:53.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f953c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41f2be0 con 0x7fa0f40ccd60 2023-10-16T20:06:53.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fa0f3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 0x7fa0f4149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 0x7fa0f4149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59012/0 (socket says 172.21.15.152:59012) 2023-10-16T20:06:53.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f3fff700 1 -- 172.21.15.152:0/3348433899 learned_addr learned my addr 172.21.15.152:0/3348433899 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:53.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0f40ccd60 0x7fa0f4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f8d3b700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f415ecb0 0x7fa0f41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.182+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11004ebb0 con 0x7fd1100cbc30 2023-10-16T20:06:53.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 -- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f415ecb0 msgr2=0x7fa0f41571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f415ecb0 0x7fa0f41571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 -- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 msgr2=0x7fa0f4149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 0x7fa0f4149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 -- 172.21.15.152:0/3348433899 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009a70 con 0x7fa0f40ccd60 2023-10-16T20:06:53.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f3fff700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 0x7fa0f4149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:53.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fa0f37fe700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0f40ccd60 0x7fa0f4156c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800e840 tx=0x7fa0e800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.183+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd100003a40 con 0x7fd1100cbc30 2023-10-16T20:06:53.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.184+0000 7fd0f7fff700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0fc06af00 0x7fd0fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.184+0000 7fd10effd700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0fc06af00 0x7fd0fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.184+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd100021070 con 0x7fd1100cbc30 2023-10-16T20:06:53.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.184+0000 7fd10effd700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0fc06af00 0x7fd0fc06d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1100b4c40 tx=0x7fd104009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.184+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86f8054340 con 0x7f870006daf0 2023-10-16T20:06:53.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.188+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd100055d90 con 0x7fd1100cbc30 2023-10-16T20:06:53.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.189+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f6c056590 con 0x7f5f7c0cb210 2023-10-16T20:06:53.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8013680 con 0x7fa0f40ccd60 2023-10-16T20:06:53.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80137e0 con 0x7fa0f40ccd60 2023-10-16T20:06:53.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8013b70 con 0x7fa0f40ccd60 2023-10-16T20:06:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400cea0 con 0x7fd4b80af560 2023-10-16T20:06:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4005cb0 con 0x7fd4b80af560 2023-10-16T20:06:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40072d0 con 0x7fd4b80af560 2023-10-16T20:06:53.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.193+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b80c4da0 con 0x7fd4b80af560 2023-10-16T20:06:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.194+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b80c5360 con 0x7fd4b80af560 2023-10-16T20:06:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.194+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a20055ce0 con 0x7f1a300b1860 2023-10-16T20:06:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.194+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f4157710 con 0x7fa0f40ccd60 2023-10-16T20:06:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.194+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4149d80 con 0x7fa0f40ccd60 2023-10-16T20:06:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.196+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd4b4007430 con 0x7fd4b80af560 2023-10-16T20:06:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.196+0000 7fd4ae7fc700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd49c06afd0 0x7fd49c06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.197+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4b4088b30 con 0x7fd4b80af560 2023-10-16T20:06:53.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.197+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f41f3910 con 0x7fa0f40ccd60 2023-10-16T20:06:53.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.197+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa0e8013cd0 con 0x7fa0f40ccd60 2023-10-16T20:06:53.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.197+0000 7fa0f0ff9700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa0e006afd0 0x7fa0e006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:53.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.198+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0e8089630 con 0x7fa0f40ccd60 2023-10-16T20:06:53.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.200+0000 7fd4bd8b6700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd49c06afd0 0x7fd49c06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.201+0000 7fd4bd8b6700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd49c06afd0 0x7fd49c06d490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8012fd0 tx=0x7fd4a801d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.200+0000 7fa0f3fff700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa0e006afd0 0x7fa0e006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:53.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.201+0000 7fa0f3fff700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa0e006afd0 0x7fa0e006d490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4001d10 tx=0x7fa0e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:53.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.203+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a00052f0 con 0x7fd4b80af560 2023-10-16T20:06:53.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.204+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0f41f3910 con 0x7fa0f40ccd60 2023-10-16T20:06:53.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.208+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4b4086e60 con 0x7fd4b80af560 2023-10-16T20:06:53.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.568+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f62300c8c90 con 0x7f62300c5ca0 2023-10-16T20:06:53.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.571+0000 7f6226ffd700 1 -- 172.21.15.152:0/4293879444 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62300c8c90 con 0x7f62300c5ca0 2023-10-16T20:06:53.575 INFO:teuthology.orchestra.run.smithi152.stdout:64424509449 2023-10-16T20:06:53.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.574+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406afd0 msgr2=0x7f621406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.574+0000 7f6238750700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406afd0 0x7f621406d490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6220009990 tx=0x7f6220006f90 comp rx=0 tx=0).stop 2023-10-16T20:06:53.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.574+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62300c5ca0 msgr2=0x7f62300c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.574+0000 7f6238750700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62300c5ca0 0x7f62300c6150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f622800a870 tx=0x7f6228001d00 comp rx=0 tx=0).stop 2023-10-16T20:06:53.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.574+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 shutdown_connections 2023-10-16T20:06:53.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.575+0000 7f6238750700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406afd0 0x7f621406d490 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6220009990 tx=0x7f6220006f90 comp rx=0 tx=0).stop 2023-10-16T20:06:53.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.575+0000 7f6238750700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62300c5ca0 0x7f62300c6150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.575+0000 7f6238750700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c0072c0 0x7f62301594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.575+0000 7f6238750700 1 --2- 172.21.15.152:0/4293879444 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6230157240 0x7f62300c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.575+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 >> 172.21.15.152:0/4293879444 conn(0x7f62300d0180 msgr2=0x7f623006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.577+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 shutdown_connections 2023-10-16T20:06:53.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.577+0000 7f6238750700 1 -- 172.21.15.152:0/4293879444 wait complete. 2023-10-16T20:06:53.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.581+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f86e8168850 con 0x7f86e80c5a00 2023-10-16T20:06:53.588 INFO:teuthology.orchestra.run.smithi152.stdout:64424509449 2023-10-16T20:06:53.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86e00055a0 con 0x7f870006daf0 2023-10-16T20:06:53.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.584+0000 7f86d6ffd700 1 -- 172.21.15.152:0/1230649067 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86e0018030 con 0x7f86e80c5a00 2023-10-16T20:06:53.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86c806af00 msgr2=0x7f86c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86c806af00 0x7f86c806d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86e8067730 tx=0x7f86d8008030 comp rx=0 tx=0).stop 2023-10-16T20:06:53.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80c5a00 msgr2=0x7f86e8149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80c5a00 0x7f86e8149660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86e000eed0 tx=0x7f86e000b390 comp rx=0 tx=0).stop 2023-10-16T20:06:53.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 shutdown_connections 2023-10-16T20:06:53.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86c806af00 0x7f86c806d3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f86e80c5a00 0x7f86e8149660 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86e806eb10 0x7f86e814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 --2- 172.21.15.152:0/1230649067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86e80cb210 0x7f86e80c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.587+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 >> 172.21.15.152:0/1230649067 conn(0x7f86e80cbad0 msgr2=0x7f86e806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.588+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 shutdown_connections 2023-10-16T20:06:53.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.588+0000 7f86ec989700 1 -- 172.21.15.152:0/1230649067 wait complete. 2023-10-16T20:06:53.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.589+0000 7f86f5ffb700 1 -- 172.21.15.152:0/3899073788 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86f801a030 con 0x7f870006daf0 2023-10-16T20:06:53.593 INFO:teuthology.orchestra.run.smithi152.stdout:60129542154 2023-10-16T20:06:53.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.590+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5f5c0055a0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.590+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd11014f5b0 con 0x7fd1100cbc30 2023-10-16T20:06:53.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.590+0000 7f5f79ffb700 1 -- 172.21.15.152:0/3906500281 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f6c059bb0 con 0x7f5f7c0cb210 2023-10-16T20:06:53.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.591+0000 7fd0f7fff700 1 -- 172.21.15.152:0/2920416054 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd11014f5b0 con 0x7fd1100cbc30 2023-10-16T20:06:53.595 INFO:teuthology.orchestra.run.smithi152.stdout:60129542153 2023-10-16T20:06:53.596 INFO:teuthology.orchestra.run.smithi152.stdout:64424509450 2023-10-16T20:06:53.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1a300af550 con 0x7f1a300b1860 2023-10-16T20:06:53.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 msgr2=0x7f86e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7f8707594700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86fc007fd0 tx=0x7f86fc007980 comp rx=0 tx=0).stop 2023-10-16T20:06:53.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006daf0 msgr2=0x7f870015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7f8707594700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006daf0 0x7f870015c890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86f8007b20 tx=0x7f86f8007e30 comp rx=0 tx=0).stop 2023-10-16T20:06:53.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0fc06af00 msgr2=0x7fd0fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7fd1161a3700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0fc06af00 0x7fd0fc06d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1100b4c40 tx=0x7fd104009040 comp rx=0 tx=0).stop 2023-10-16T20:06:53.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1100cbc30 msgr2=0x7fd110150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7fd1161a3700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1100cbc30 0x7fd110150230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd100016000 tx=0x7fd100004750 comp rx=0 tx=0).stop 2023-10-16T20:06:53.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.595+0000 7f1a267fc700 1 -- 172.21.15.152:0/3634031769 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a2002b090 con 0x7f1a300b1860 2023-10-16T20:06:53.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 shutdown_connections 2023-10-16T20:06:53.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0fc06af00 0x7fd0fc06d3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd110161a80 0x7fd1100c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1100cbc30 0x7fd110150230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 --2- 172.21.15.152:0/2920416054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd11015d530 0x7fd1100b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 >> 172.21.15.152:0/2920416054 conn(0x7fd1100b0ae0 msgr2=0x7fd1100cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 shutdown_connections 2023-10-16T20:06:53.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.596+0000 7fd1161a3700 1 -- 172.21.15.152:0/2920416054 wait complete. 2023-10-16T20:06:53.602 INFO:teuthology.orchestra.run.smithi152.stdout:64424509449 2023-10-16T20:06:53.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2023-10-16T20:06:53.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.597+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 shutdown_connections 2023-10-16T20:06:53.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.597+0000 7f8707594700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f86e406af00 0x7f86e406d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.597+0000 7f8707594700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f870006daf0 0x7f870015c890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.597+0000 7f8707594700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87000cb210 0x7f8700142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.597+0000 7f8707594700 1 --2- 172.21.15.152:0/3899073788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f870006eb10 0x7f87000b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.597+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 >> 172.21.15.152:0/3899073788 conn(0x7f87000cbad0 msgr2=0x7f87000cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 shutdown_connections 2023-10-16T20:06:53.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f6406b080 msgr2=0x7f5f6406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f6406b080 0x7f5f6406d540 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c151cb0 tx=0x7f5f74006c60 comp rx=0 tx=0).stop 2023-10-16T20:06:53.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 msgr2=0x7f5f7c202e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 0x7f5f7c202e00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c06c130 tx=0x7f5f6c004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f8707594700 1 -- 172.21.15.152:0/3899073788 wait complete. 2023-10-16T20:06:53.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1a1406af00 msgr2=0x7f1a1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1a1406af00 0x7f1a1406d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a300b4400 tx=0x7f1a2c007ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 msgr2=0x7f1a301595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 0x7f1a301595c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a200090b0 tx=0x7f1a20004750 comp rx=0 tx=0).stop 2023-10-16T20:06:53.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 shutdown_connections 2023-10-16T20:06:53.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1a1406af00 0x7f1a1406d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1a300b1860 0x7f1a301595c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1a300c56e0 0x7f1a300afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 --2- 172.21.15.152:0/3634031769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a3015b600 0x7f1a300af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 >> 172.21.15.152:0/3634031769 conn(0x7f1a3006c850 msgr2=0x7f1a300ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 shutdown_connections 2023-10-16T20:06:53.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f6406b080 0x7f5f6406d540 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f7c0cb210 0x7f5f7c202e00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c06daf0 0x7f5f7c200290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 --2- 172.21.15.152:0/3906500281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f7c06eb10 0x7f5f7c159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 >> 172.21.15.152:0/3906500281 conn(0x7f5f7c0cbad0 msgr2=0x7f5f7c0ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 shutdown_connections 2023-10-16T20:06:53.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f5f8332c700 1 -- 172.21.15.152:0/3906500281 wait complete. 2023-10-16T20:06:53.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 shutdown_connections 2023-10-16T20:06:53.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.599+0000 7f1a380a7700 1 -- 172.21.15.152:0/3634031769 wait complete. 2023-10-16T20:06:53.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.600+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0f41f3910 con 0x7fa0f40ccd60 2023-10-16T20:06:53.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.601+0000 7fa0f0ff9700 1 -- 172.21.15.152:0/3348433899 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0f41f3910 con 0x7fa0f40ccd60 2023-10-16T20:06:53.613 INFO:teuthology.orchestra.run.smithi152.stdout:60129542154 2023-10-16T20:06:53.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa0e006afd0 msgr2=0x7fa0e006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa0e006afd0 0x7fa0e006d490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4001d10 tx=0x7fa0e4009040 comp rx=0 tx=0).stop 2023-10-16T20:06:53.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0f40ccd60 msgr2=0x7fa0f4156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0f40ccd60 0x7fa0f4156c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800e840 tx=0x7fa0e800eb50 comp rx=0 tx=0).stop 2023-10-16T20:06:53.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 shutdown_connections 2023-10-16T20:06:53.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa0e006afd0 0x7fa0e006d490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa0f415ecb0 0x7fa0f41571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0f406a820 0x7fa0f4149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 --2- 172.21.15.152:0/3348433899 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa0f40ccd60 0x7fa0f4156c90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 >> 172.21.15.152:0/3348433899 conn(0x7fa0f40cf7c0 msgr2=0x7fa0f406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 shutdown_connections 2023-10-16T20:06:53.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.607+0000 7fa0f953c700 1 -- 172.21.15.152:0/3348433899 wait complete. 2023-10-16T20:06:53.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.611+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4a00055a0 con 0x7fd4b80af560 2023-10-16T20:06:53.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.611+0000 7fd4ae7fc700 1 -- 172.21.15.152:0/2335983953 <== mon.2 v2:172.21.15.163:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4b4017030 con 0x7fd4b80af560 2023-10-16T20:06:53.618 INFO:teuthology.orchestra.run.smithi152.stdout:60129542153 2023-10-16T20:06:53.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.616+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd49c06afd0 msgr2=0x7fd49c06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.616+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd49c06afd0 0x7fd49c06d490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8012fd0 tx=0x7fd4a801d040 comp rx=0 tx=0).stop 2023-10-16T20:06:53.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.616+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4b80af560 msgr2=0x7fd4b80c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:53.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.616+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4b80af560 0x7fd4b80c3c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400c490 tx=0x7fd4b400c7a0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2023-10-16T20:06:53.621 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 shutdown_connections 2023-10-16T20:06:53.621 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd49c06afd0 0x7fd49c06d490 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.623 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b815daa0 0x7fd4b80c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4b8071f60 0x7fd4b80c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 --2- 172.21.15.152:0/2335983953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4b80af560 0x7fd4b80c3c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:53.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 >> 172.21.15.152:0/2335983953 conn(0x7fd4b80d0180 msgr2=0x7fd4b806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:53.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 shutdown_connections 2023-10-16T20:06:53.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:53.619+0000 7fd4bfb1a700 1 -- 172.21.15.152:0/2335983953 wait complete. 2023-10-16T20:06:53.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2023-10-16T20:06:53.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.0 2023-10-16T20:06:53.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2023-10-16T20:06:53.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2023-10-16T20:06:53.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2023-10-16T20:06:53.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2023-10-16T20:06:54.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T20:06:54.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T20:06:54.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T20:06:54.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T20:06:54.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T20:06:54.629 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T20:06:54.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T20:06:54.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T20:06:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.803+0000 7f75d1988700 1 Processor -- start 2023-10-16T20:06:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.803+0000 7f75d1988700 1 -- start start 2023-10-16T20:06:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.805+0000 7f75d1988700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75cc0cc5f0 0x7f75cc070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.805+0000 7f75d1988700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0c9a30 con 0x7f75cc06e200 2023-10-16T20:06:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.805+0000 7f75d1988700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0c9cd0 con 0x7f75cc1599f0 2023-10-16T20:06:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.805+0000 7f75d1988700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0c9fb0 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.806+0000 7f75cb7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75cc0cc5f0 0x7f75cc070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.806+0000 7f75cb7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75cc0cc5f0 0x7f75cc070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59024/0 (socket says 172.21.15.152:59024) 2023-10-16T20:06:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.806+0000 7f75cb7fe700 1 -- 172.21.15.152:0/1448996623 learned_addr learned my addr 172.21.15.152:0/1448996623 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.807+0000 7f75cb7fe700 1 -- 172.21.15.152:0/1448996623 >> v1:172.21.15.163:6789/0 conn(0x7f75cc1599f0 legacy=0x7f75cc06daf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T20:06:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.807+0000 7f75cb7fe700 1 -- 172.21.15.152:0/1448996623 >> v1:172.21.15.152:6789/0 conn(0x7f75cc06e200 legacy=0x7f75cc0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.807+0000 7f75cb7fe700 1 -- 172.21.15.152:0/1448996623 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0ca290 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.807+0000 7f75cb7fe700 1 --2- 172.21.15.152:0/1448996623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc070cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009e50 tx=0x7f75c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734f7e7002af9ae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.808+0000 7f75c9ffb700 1 -- 172.21.15.152:0/1448996623 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400e070 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.808+0000 7f75c9ffb700 1 -- 172.21.15.152:0/1448996623 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4003a20 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.808+0000 7f75c9ffb700 1 -- 172.21.15.152:0/1448996623 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4003dd0 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.809+0000 7f75d1988700 1 -- 172.21.15.152:0/1448996623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 msgr2=0x7f75cc070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.809+0000 7f75d1988700 1 --2- 172.21.15.152:0/1448996623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc070cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009e50 tx=0x7f75c400b330 comp rx=0 tx=0).stop 2023-10-16T20:06:54.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.810+0000 7f75d1988700 1 -- 172.21.15.152:0/1448996623 shutdown_connections 2023-10-16T20:06:54.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.810+0000 7f75d1988700 1 --2- 172.21.15.152:0/1448996623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc070cf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.810+0000 7f75d1988700 1 -- 172.21.15.152:0/1448996623 >> 172.21.15.152:0/1448996623 conn(0x7f75cc0cbad0 msgr2=0x7f75cc0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.810+0000 7f75d1988700 1 -- 172.21.15.152:0/1448996623 shutdown_connections 2023-10-16T20:06:54.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.810+0000 7f75d1988700 1 -- 172.21.15.152:0/1448996623 wait complete. 2023-10-16T20:06:54.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.812+0000 7f75d1988700 1 Processor -- start 2023-10-16T20:06:54.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.813+0000 7f75d1988700 1 -- start start 2023-10-16T20:06:54.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.814+0000 7f75d1988700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75cc06e200 0x7f75cc16ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.814+0000 7f75d1988700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.814+0000 7f75d1988700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75cc1599f0 0x7f75cc168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.814+0000 7f75d1988700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b4610 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.814+0000 7f75d1988700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc16c1a0 con 0x7f75cc06e200 2023-10-16T20:06:54.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.814+0000 7f75d1988700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc16c480 con 0x7f75cc1599f0 2023-10-16T20:06:54.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc0afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59032/0 (socket says 172.21.15.152:59032) 2023-10-16T20:06:54.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 -- 172.21.15.152:0/866302384 learned_addr learned my addr 172.21.15.152:0/866302384 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 -- 172.21.15.152:0/866302384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75cc1599f0 msgr2=0x7f75cc168590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:54.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75cc1599f0 0x7f75cc168590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 -- 172.21.15.152:0/866302384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75cc06e200 msgr2=0x7f75cc16ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:54.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75cc06e200 0x7f75cc16ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.815+0000 7f75ca7fc700 1 -- 172.21.15.152:0/866302384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c4009b30 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.816+0000 7f75ca7fc700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc0afeb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c4a0 tx=0x7f75bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.817+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0054e0 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.817+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc003680 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.817+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc003a30 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.817+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc16c760 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.817+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc0b20e0 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.822+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75bc003b90 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.822+0000 7f75b3fff700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75b806afd0 0x7f75b806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.822+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75bc088cd0 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.823+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0052f0 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.825+0000 7f75caffd700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75b806afd0 0x7f75b806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.825+0000 7f75caffd700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75b806afd0 0x7f75b806d490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75c0006fd0 tx=0x7f75c0006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.832+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75bc053b00 con 0x7f75cc0cc5f0 2023-10-16T20:06:54.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.859+0000 7f4afddd2700 1 Processor -- start 2023-10-16T20:06:54.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.859+0000 7f4afddd2700 1 -- start start 2023-10-16T20:06:54.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.860+0000 7f4afddd2700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 0x7f4af8161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.860+0000 7f4afddd2700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4af806eb10 0x7f4af8163890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.860+0000 7f4afddd2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80c9a30 con 0x7f4af806daf0 2023-10-16T20:06:54.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.860+0000 7f4afddd2700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80c9cd0 con 0x7f4af806eb10 2023-10-16T20:06:54.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.860+0000 7f4afddd2700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80c9fb0 con 0x7f4af80cb210 2023-10-16T20:06:54.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.860+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 0x7f4af8161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 0x7f4af8161340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47694/0 (socket says 172.21.15.152:47694) 2023-10-16T20:06:54.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 -- 172.21.15.152:0/1836546067 learned_addr learned my addr 172.21.15.152:0/1836546067 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 -- 172.21.15.152:0/1836546067 >> v2:172.21.15.152:3300/0 conn(0x7f4af806eb10 msgr2=0x7f4af8163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 --2- 172.21.15.152:0/1836546067 >> v2:172.21.15.152:3300/0 conn(0x7f4af806eb10 0x7f4af8163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 -- 172.21.15.152:0/1836546067 >> v1:172.21.15.152:6789/0 conn(0x7f4af806daf0 legacy=0x7f4af806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 -- 172.21.15.152:0/1836546067 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80ca290 con 0x7f4af80cb210 2023-10-16T20:06:54.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.861+0000 7f4aeeffd700 1 --2- 172.21.15.152:0/1836546067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 0x7f4af8161340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00092e0 tx=0x7f4ae00095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be79d4ff675c42d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.865+0000 7fbc53365700 1 Processor -- start 2023-10-16T20:06:54.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.865+0000 7fbc53365700 1 -- start start 2023-10-16T20:06:54.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc53365700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc4c06daf0 0x7fbc4c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc53365700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06eb10 0x7fbc4c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc53365700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4c0c9a30 con 0x7fbc4c0cb210 2023-10-16T20:06:54.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc53365700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c06e410 con 0x7fbc4c06daf0 2023-10-16T20:06:54.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc53365700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c0c9cd0 con 0x7fbc4c06eb10 2023-10-16T20:06:54.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc4c06daf0 0x7fbc4c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7f4af6ffd700 1 -- 172.21.15.152:0/1836546067 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004230 con 0x7f4af80cb210 2023-10-16T20:06:54.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc4c06daf0 0x7fbc4c06ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59044/0 (socket says 172.21.15.152:59044) 2023-10-16T20:06:54.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 -- 172.21.15.152:0/2760299592 learned_addr learned my addr 172.21.15.152:0/2760299592 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7f4af6ffd700 1 -- 172.21.15.152:0/1836546067 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0004390 con 0x7f4af80cb210 2023-10-16T20:06:54.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7f4af6ffd700 1 -- 172.21.15.152:0/1836546067 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000c770 con 0x7f4af80cb210 2023-10-16T20:06:54.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 -- 172.21.15.152:0/2760299592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06eb10 msgr2=0x7fbc4c070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 --2- 172.21.15.152:0/2760299592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06eb10 0x7fbc4c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 -- 172.21.15.152:0/2760299592 >> v1:172.21.15.163:6789/0 conn(0x7fbc4c0cb210 legacy=0x7fbc4c0705e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T20:06:54.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.867+0000 7fbc51101700 1 -- 172.21.15.152:0/2760299592 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c0c9fb0 con 0x7fbc4c06daf0 2023-10-16T20:06:54.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7fbc51101700 1 --2- 172.21.15.152:0/2760299592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06daf0 0x7fbc4c06ded0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009160 tx=0x7fbc48009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c6eac37da2a593 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f0b3d1ba700 1 Processor -- start 2023-10-16T20:06:54.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 -- 172.21.15.152:0/1836546067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 msgr2=0x7f4af8161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 --2- 172.21.15.152:0/1836546067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 0x7f4af8161340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00092e0 tx=0x7f4ae00095f0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 -- 172.21.15.152:0/1836546067 shutdown_connections 2023-10-16T20:06:54.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 --2- 172.21.15.152:0/1836546067 >> v2:172.21.15.152:3300/0 conn(0x7f4af806eb10 0x7f4af8163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 --2- 172.21.15.152:0/1836546067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af80cb210 0x7f4af8161340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 -- 172.21.15.152:0/1836546067 >> 172.21.15.152:0/1836546067 conn(0x7f4af80cbad0 msgr2=0x7f4af80cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 -- 172.21.15.152:0/1836546067 shutdown_connections 2023-10-16T20:06:54.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7fbc43fff700 1 -- 172.21.15.152:0/2760299592 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc48004230 con 0x7fbc4c06daf0 2023-10-16T20:06:54.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7fbc43fff700 1 -- 172.21.15.152:0/2760299592 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48004390 con 0x7fbc4c06daf0 2023-10-16T20:06:54.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7fbc43fff700 1 -- 172.21.15.152:0/2760299592 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480036a0 con 0x7fbc4c06daf0 2023-10-16T20:06:54.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f0b3d1ba700 1 -- start start 2023-10-16T20:06:54.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.869+0000 7f0b3d1ba700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b3806cf10 0x7f0b3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.869+0000 7f0b3d1ba700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0b380cae90 0x7f0b380cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.869+0000 7f0b3d1ba700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380ca420 con 0x7f0b380712e0 2023-10-16T20:06:54.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.869+0000 7f0b3d1ba700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3806d9b0 con 0x7f0b380cae90 2023-10-16T20:06:54.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.869+0000 7f0b3d1ba700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380ca690 con 0x7f0b3806cf10 2023-10-16T20:06:54.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b36d9d700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f0b380712e0 0x7f0b380716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54428/0 (socket says 172.21.15.152:54428) 2023-10-16T20:06:54.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b36d9d700 1 -- 172.21.15.152:0/966499510 learned_addr learned my addr 172.21.15.152:0/966499510 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:54.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b3659c700 1 --2- 172.21.15.152:0/966499510 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b3806cf10 0x7f0b3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b3659c700 1 -- 172.21.15.152:0/966499510 >> v2:172.21.15.152:3300/0 conn(0x7f0b380cae90 msgr2=0x7f0b380cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b3659c700 1 --2- 172.21.15.152:0/966499510 >> v2:172.21.15.152:3300/0 conn(0x7f0b380cae90 0x7f0b380cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b3659c700 1 -- 172.21.15.152:0/966499510 >> v1:172.21.15.163:6789/0 conn(0x7f0b380712e0 legacy=0x7f0b380716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7fbc53365700 1 -- 172.21.15.152:0/2760299592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06daf0 msgr2=0x7fbc4c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7fbc53365700 1 --2- 172.21.15.152:0/2760299592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06daf0 0x7fbc4c06ded0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009160 tx=0x7fbc48009470 comp rx=0 tx=0).stop 2023-10-16T20:06:54.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b3659c700 1 -- 172.21.15.152:0/966499510 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380ca970 con 0x7f0b3806cf10 2023-10-16T20:06:54.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.868+0000 7f4afddd2700 1 -- 172.21.15.152:0/1836546067 wait complete. 2023-10-16T20:06:54.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f4afddd2700 1 Processor -- start 2023-10-16T20:06:54.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7fbc53365700 1 -- 172.21.15.152:0/2760299592 shutdown_connections 2023-10-16T20:06:54.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7fbc53365700 1 --2- 172.21.15.152:0/2760299592 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06eb10 0x7fbc4c070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7fbc53365700 1 --2- 172.21.15.152:0/2760299592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06daf0 0x7fbc4c06ded0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7fbc53365700 1 -- 172.21.15.152:0/2760299592 >> 172.21.15.152:0/2760299592 conn(0x7fbc4c0cbad0 msgr2=0x7fbc4c0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.870+0000 7f0b3659c700 1 --2- 172.21.15.152:0/966499510 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b3806cf10 0x7f0b3806d390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009840 tx=0x7f0b2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ef1b57d41f584b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.871+0000 7fbc53365700 1 -- 172.21.15.152:0/2760299592 shutdown_connections 2023-10-16T20:06:54.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.871+0000 7fbc53365700 1 -- 172.21.15.152:0/2760299592 wait complete. 2023-10-16T20:06:54.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.871+0000 7f4afddd2700 1 -- start start 2023-10-16T20:06:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.871+0000 7f0b35d9b700 1 -- 172.21.15.152:0/966499510 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c004230 con 0x7f0b3806cf10 2023-10-16T20:06:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.871+0000 7f0b35d9b700 1 -- 172.21.15.152:0/966499510 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c004390 con 0x7f0b3806cf10 2023-10-16T20:06:54.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.871+0000 7f0b35d9b700 1 -- 172.21.15.152:0/966499510 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0036a0 con 0x7f0b3806cf10 2023-10-16T20:06:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4afddd2700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af806daf0 0x7f4af814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4afddd2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4af806eb10 0x7f4af8157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4afddd2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4af80cb210 0x7f4af81fac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4afddd2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af814e3e0 con 0x7f4af80cb210 2023-10-16T20:06:54.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4afddd2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af814f2e0 con 0x7f4af806eb10 2023-10-16T20:06:54.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4afddd2700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8157b80 con 0x7f4af806daf0 2023-10-16T20:06:54.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4af806eb10 0x7f4af8157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4af77fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af806daf0 0x7f4af814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/966499510 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b3806cf10 msgr2=0x7f0b3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/966499510 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b3806cf10 0x7f0b3806d390 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009840 tx=0x7f0b2c009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/966499510 shutdown_connections 2023-10-16T20:06:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/966499510 >> v2:172.21.15.152:3300/0 conn(0x7f0b380cae90 0x7f0b380cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/966499510 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b3806cf10 0x7f0b3806d390 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009840 tx=0x7f0b2c009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/966499510 >> 172.21.15.152:0/966499510 conn(0x7f0b380cfcd0 msgr2=0x7f0b380d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4aeeffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4af806eb10 0x7f4af8157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60054/0 (socket says 172.21.15.152:60054) 2023-10-16T20:06:54.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.872+0000 7f4aeeffd700 1 -- 172.21.15.152:0/269515350 learned_addr learned my addr 172.21.15.152:0/269515350 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f4af7fff700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4af80cb210 0x7f4af81fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7fbc53365700 1 Processor -- start 2023-10-16T20:06:54.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/966499510 shutdown_connections 2023-10-16T20:06:54.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/966499510 wait complete. 2023-10-16T20:06:54.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7fbc53365700 1 -- start start 2023-10-16T20:06:54.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f865d433700 1 Processor -- start 2023-10-16T20:06:54.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f865d433700 1 -- start start 2023-10-16T20:06:54.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f865d433700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f86580cd5a0 0x7f86580c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f865d433700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580c4970 con 0x7f86580cb230 2023-10-16T20:06:54.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f865d433700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86580c4040 con 0x7f865806daf0 2023-10-16T20:06:54.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f865d433700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86580c4320 con 0x7f86580cd5a0 2023-10-16T20:06:54.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f0b3d1ba700 1 Processor -- start 2023-10-16T20:06:54.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f4af7fff700 1 -- 172.21.15.152:0/269515350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af806daf0 msgr2=0x7f4af814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f4af7fff700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af806daf0 0x7f4af814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f4af7fff700 1 -- 172.21.15.152:0/269515350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4af806eb10 msgr2=0x7f4af8157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f4af7fff700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4af806eb10 0x7f4af8157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.873+0000 7f4af7fff700 1 -- 172.21.15.152:0/269515350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0009de0 con 0x7f4af80cb210 2023-10-16T20:06:54.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7f4af7fff700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4af80cb210 0x7f4af81fac30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4af000be50 tx=0x7f4af0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000cb90 con 0x7f4af80cb210 2023-10-16T20:06:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af000cd10 con 0x7f4af80cb210 2023-10-16T20:06:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0014680 con 0x7f4af80cb210 2023-10-16T20:06:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af814e6d0 con 0x7f4af80cb210 2023-10-16T20:06:54.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af814ec90 con 0x7f4af80cb210 2023-10-16T20:06:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f0b3d1ba700 1 -- start start 2023-10-16T20:06:54.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f86577fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f86580cb230 0x7f86580c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39266/0 (socket says 172.21.15.152:39266) 2023-10-16T20:06:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f86577fe700 1 -- 172.21.15.152:0/3518138005 learned_addr learned my addr 172.21.15.152:0/3518138005 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f8655ffb700 1 -- 172.21.15.152:0/3518138005 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301020314 0 0) 0x7f86580c4970 con 0x7f86580cb230 2023-10-16T20:06:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f8655ffb700 1 -- 172.21.15.152:0/3518138005 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86400035b0 con 0x7f86580cb230 2023-10-16T20:06:54.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af804ebb0 con 0x7f4af80cb210 2023-10-16T20:06:54.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7fbc53365700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06daf0 0x7fbc4c150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.874+0000 7fbc53365700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 0x7fbc4c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7fbc51101700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06daf0 0x7fbc4c150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc51101700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06daf0 0x7fbc4c150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47712/0 (socket says 172.21.15.152:47712) 2023-10-16T20:06:54.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc53365700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc4c0cb210 0x7fbc4c1e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc53365700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156770 con 0x7fbc4c06eb10 2023-10-16T20:06:54.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc53365700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156a50 con 0x7fbc4c0cb210 2023-10-16T20:06:54.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc53365700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156d30 con 0x7fbc4c06daf0 2023-10-16T20:06:54.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc50900700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 0x7fbc4c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc50900700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 0x7fbc4c155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59062/0 (socket says 172.21.15.152:59062) 2023-10-16T20:06:54.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7fbc50900700 1 -- 172.21.15.152:0/2794225827 learned_addr learned my addr 172.21.15.152:0/2794225827 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3d1ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b380712e0 0x7f0b381497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3d1ba700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b380cae90 0x7f0b38150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3d1ba700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b38151510 0x7f0b380afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3d1ba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b381519c0 con 0x7f0b380712e0 2023-10-16T20:06:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3d1ba700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3814fda0 con 0x7f0b38151510 2023-10-16T20:06:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3d1ba700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38150080 con 0x7f0b380cae90 2023-10-16T20:06:54.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b380cae90 0x7f0b38150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b380cae90 0x7f0b38150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47724/0 (socket says 172.21.15.152:47724) 2023-10-16T20:06:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3659c700 1 -- 172.21.15.152:0/2359737756 learned_addr learned my addr 172.21.15.152:0/2359737756 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.876+0000 7f0b3759e700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b38151510 0x7f0b380afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f7b8df99700 1 Processor -- start 2023-10-16T20:06:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.875+0000 7f7b8df99700 1 -- start start 2023-10-16T20:06:54.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc51902700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc4c0cb210 0x7fbc4c1e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3759e700 1 -- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b380cae90 msgr2=0x7f0b38150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3759e700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b380cae90 0x7f0b38150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3759e700 1 -- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b380712e0 msgr2=0x7f0b381497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3759e700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b380712e0 0x7f0b381497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3759e700 1 -- 172.21.15.152:0/2359737756 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0094a0 con 0x7f0b38151510 2023-10-16T20:06:54.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4af001d3b0 con 0x7f4af80cb210 2023-10-16T20:06:54.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f4af4ff9700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4ad806afd0 0x7f4ad806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4af0006e40 con 0x7f4af80cb210 2023-10-16T20:06:54.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc50900700 1 -- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06daf0 msgr2=0x7fbc4c150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc50900700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06daf0 0x7fbc4c150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc50900700 1 -- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc4c0cb210 msgr2=0x7fbc4c1e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc50900700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc4c0cb210 0x7fbc4c1e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc50900700 1 -- 172.21.15.152:0/2794225827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48009de0 con 0x7fbc4c06eb10 2023-10-16T20:06:54.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7fbc51902700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc4c0cb210 0x7fbc4c1e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:54.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7fbc50900700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 0x7fbc4c155d20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400ba50 tx=0x7fbc4400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3759e700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b38151510 0x7f0b380afd70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000be20 tx=0x7f0b3000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000cb90 con 0x7f0b38151510 2023-10-16T20:06:54.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3000cd10 con 0x7f0b38151510 2023-10-16T20:06:54.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b38150360 con 0x7f0b38151510 2023-10-16T20:06:54.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b8df99700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7b8806daf0 0x7f7b8806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b8df99700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7b880cb210 0x7f7b880705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b8df99700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880c9a30 con 0x7f7b880cc5f0 2023-10-16T20:06:54.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b8df99700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8806e410 con 0x7f7b880cb210 2023-10-16T20:06:54.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b8df99700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880c9cd0 con 0x7f7b8806daf0 2023-10-16T20:06:54.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30014680 con 0x7f0b38151510 2023-10-16T20:06:54.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38150920 con 0x7f0b38151510 2023-10-16T20:06:54.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.879+0000 7f4af77fe700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4ad806afd0 0x7f4ad806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b87fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7b880cb210 0x7f7b880705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b87fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7b880cb210 0x7f7b880705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59078/0 (socket says 172.21.15.152:59078) 2023-10-16T20:06:54.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.877+0000 7f7b87fff700 1 -- 172.21.15.152:0/2569976713 learned_addr learned my addr 172.21.15.152:0/2569976713 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f7b877fe700 1 --2- 172.21.15.152:0/2569976713 >> v2:172.21.15.163:3300/0 conn(0x7f7b8806daf0 0x7f7b8806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f7b87fff700 1 -- 172.21.15.152:0/2569976713 >> v2:172.21.15.163:3300/0 conn(0x7f7b8806daf0 msgr2=0x7f7b8806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f7b87fff700 1 --2- 172.21.15.152:0/2569976713 >> v2:172.21.15.163:3300/0 conn(0x7f7b8806daf0 0x7f7b8806ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f7b87fff700 1 -- 172.21.15.152:0/2569976713 >> v1:172.21.15.163:6789/0 conn(0x7f7b880cc5f0 legacy=0x7f7b88070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f7b87fff700 1 -- 172.21.15.152:0/2569976713 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880c9fb0 con 0x7f7b880cb210 2023-10-16T20:06:54.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f7b87fff700 1 --2- 172.21.15.152:0/2569976713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cb210 0x7f7b880705e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b8806a1b0 tx=0x7f7b80008600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0641e05184fee28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f71e1bf0700 1 Processor -- start 2023-10-16T20:06:54.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.878+0000 7f71e1bf0700 1 -- start start 2023-10-16T20:06:54.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.879+0000 7f4af77fe700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4ad806afd0 0x7f4ad806d490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4af814fc70 tx=0x7f4ae8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.879+0000 7f86567fc700 1 --2- 172.21.15.152:0/3518138005 >> v2:172.21.15.163:3300/0 conn(0x7f86580cd5a0 0x7f86580c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.879+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b38150b10 con 0x7f0b38151510 2023-10-16T20:06:54.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.879+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b3001d3b0 con 0x7f0b38151510 2023-10-16T20:06:54.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71e1bf0700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71dc06daf0 0x7f71dc06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71e1bf0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cb210 0x7f71dc0705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f0b1f7fe700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b2406af00 0x7f0b2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71e1bf0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0c9a30 con 0x7f71dc0cc5f0 2023-10-16T20:06:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71e1bf0700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc06e410 con 0x7f71dc06daf0 2023-10-16T20:06:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71e1bf0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0c9cd0 con 0x7f71dc0cb210 2023-10-16T20:06:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71dc06daf0 0x7f71dc06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71dc06daf0 0x7f71dc06ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59086/0 (socket says 172.21.15.152:59086) 2023-10-16T20:06:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 -- 172.21.15.152:0/1550880477 learned_addr learned my addr 172.21.15.152:0/1550880477 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71daffd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cb210 0x7f71dc0705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b300897a0 con 0x7f0b38151510 2023-10-16T20:06:54.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 -- 172.21.15.152:0/1550880477 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cb210 msgr2=0x7f71dc0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:54.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 --2- 172.21.15.152:0/1550880477 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cb210 0x7f71dc0705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 -- 172.21.15.152:0/1550880477 >> v1:172.21.15.152:6789/0 conn(0x7f71dc0cc5f0 legacy=0x7f71dc163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.880+0000 7f71db7fe700 1 -- 172.21.15.152:0/1550880477 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0c9fb0 con 0x7f71dc06daf0 2023-10-16T20:06:54.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f71db7fe700 1 --2- 172.21.15.152:0/1550880477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 0x7f71dc06ded0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098f0 tx=0x7f71cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c625f04830efa88d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f0b36d9d700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b2406af00 0x7f0b2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f86567fc700 1 -- 172.21.15.152:0/3518138005 >> v1:172.21.15.163:6789/0 conn(0x7f865806daf0 legacy=0x7f865806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f86567fc700 1 -- 172.21.15.152:0/3518138005 >> v1:172.21.15.152:6789/0 conn(0x7f86580cb230 legacy=0x7f86580c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f86567fc700 1 -- 172.21.15.152:0/3518138005 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580c4600 con 0x7f86580cd5a0 2023-10-16T20:06:54.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f86567fc700 1 --2- 172.21.15.152:0/3518138005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cd5a0 0x7f86580c4e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f864c009840 tx=0x7f864c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea0ebbc3325ad196 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.881+0000 7f0b36d9d700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b2406af00 0x7f0b2406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b28001810 tx=0x7f0b28007a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4af0054540 con 0x7f4af80cb210 2023-10-16T20:06:54.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4400cae0 con 0x7fbc4c06eb10 2023-10-16T20:06:54.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4400cc40 con 0x7fbc4c06eb10 2023-10-16T20:06:54.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44014440 con 0x7fbc4c06eb10 2023-10-16T20:06:54.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c157010 con 0x7fbc4c06eb10 2023-10-16T20:06:54.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7f7b867fc700 1 -- 172.21.15.152:0/2569976713 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000b2e0 con 0x7f7b880cb210 2023-10-16T20:06:54.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7f7b867fc700 1 -- 172.21.15.152:0/2569976713 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8000b440 con 0x7f7b880cb210 2023-10-16T20:06:54.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7f71da7fc700 1 -- 172.21.15.152:0/1550880477 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc011830 con 0x7f71dc06daf0 2023-10-16T20:06:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7f71da7fc700 1 -- 172.21.15.152:0/1550880477 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc011990 con 0x7f71dc06daf0 2023-10-16T20:06:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7f71da7fc700 1 -- 172.21.15.152:0/1550880477 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc011d20 con 0x7f71dc06daf0 2023-10-16T20:06:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.883+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c1e3970 con 0x7fbc4c06eb10 2023-10-16T20:06:54.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.885+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c04ebb0 con 0x7fbc4c06eb10 2023-10-16T20:06:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.885+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b30054550 con 0x7f0b38151510 2023-10-16T20:06:54.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f7b867fc700 1 -- 172.21.15.152:0/2569976713 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80003c40 con 0x7f7b880cb210 2023-10-16T20:06:54.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.885+0000 7f7b8df99700 1 -- 172.21.15.152:0/2569976713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cb210 msgr2=0x7f7b880705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.885+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2569976713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cb210 0x7f7b880705e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b8806a1b0 tx=0x7f7b80008600 comp rx=0 tx=0).stop 2023-10-16T20:06:54.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 -- 172.21.15.152:0/1550880477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 msgr2=0x7f71dc06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/1550880477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 0x7f71dc06ded0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098f0 tx=0x7f71cc009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 -- 172.21.15.152:0/1550880477 shutdown_connections 2023-10-16T20:06:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/1550880477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 0x7f71dc06ded0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/1550880477 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cb210 0x7f71dc0705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 -- 172.21.15.152:0/1550880477 >> 172.21.15.152:0/1550880477 conn(0x7f71dc0cbad0 msgr2=0x7f71dc0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 -- 172.21.15.152:0/1550880477 shutdown_connections 2023-10-16T20:06:54.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.884+0000 7f71e1bf0700 1 -- 172.21.15.152:0/1550880477 wait complete. 2023-10-16T20:06:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.886+0000 7f71e1bf0700 1 Processor -- start 2023-10-16T20:06:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.887+0000 7f71e1bf0700 1 -- start start 2023-10-16T20:06:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71e1bf0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 0x7f71dc0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71e1bf0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 0x7f71dc14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71e1bf0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 0x7f71dc14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71e1bf0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0b4e60 con 0x7f71dc06daf0 2023-10-16T20:06:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71e1bf0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1e25e0 con 0x7f71dc0cb210 2023-10-16T20:06:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71e1bf0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1504a0 con 0x7f71dc0cc5f0 2023-10-16T20:06:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 0x7f71dc14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 0x7f71dc14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71dbfff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 0x7f71dc14db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:47750/0 (socket says 172.21.15.152:47750) 2023-10-16T20:06:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 0x7f71dc14ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60096/0 (socket says 172.21.15.152:60096) 2023-10-16T20:06:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71dbfff700 1 -- 172.21.15.152:0/4146999893 learned_addr learned my addr 172.21.15.152:0/4146999893 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 -- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 msgr2=0x7f71dc14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 0x7f71dc14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 -- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 msgr2=0x7f71dc0b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 0x7f71dc0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.888+0000 7f71daffd700 1 -- 172.21.15.152:0/4146999893 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc009550 con 0x7f71dc0cb210 2023-10-16T20:06:54.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.889+0000 7f71dbfff700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 0x7f71dc14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:54.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.889+0000 7f71daffd700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 0x7f71dc14ff60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71d000bb20 tx=0x7f71d000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.892+0000 7f7b8df99700 1 -- 172.21.15.152:0/2569976713 shutdown_connections 2023-10-16T20:06:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.892+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2569976713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cb210 0x7f7b880705e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.892+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2569976713 >> v2:172.21.15.163:3300/0 conn(0x7f7b8806daf0 0x7f7b8806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.892+0000 7f7b8df99700 1 -- 172.21.15.152:0/2569976713 >> 172.21.15.152:0/2569976713 conn(0x7f7b880cbad0 msgr2=0x7f7b880cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.892+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc4401d3b0 con 0x7fbc4c06eb10 2023-10-16T20:06:54.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7fbc41ffb700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbc3006af00 0x7fbc3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc44089b90 con 0x7fbc4c06eb10 2023-10-16T20:06:54.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7fbc51101700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbc3006af00 0x7fbc3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc440b5d40 con 0x7fbc4c06eb10 2023-10-16T20:06:54.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.895+0000 7fbc51101700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbc3006af00 0x7fbc3006d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009130 tx=0x7fbc48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7f8655ffb700 1 -- 172.21.15.152:0/3518138005 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011830 con 0x7f86580cd5a0 2023-10-16T20:06:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7f8655ffb700 1 -- 172.21.15.152:0/3518138005 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c011990 con 0x7f86580cd5a0 2023-10-16T20:06:54.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.893+0000 7f8655ffb700 1 -- 172.21.15.152:0/3518138005 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011d00 con 0x7f86580cd5a0 2023-10-16T20:06:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 -- 172.21.15.152:0/3518138005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cd5a0 msgr2=0x7f86580c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 --2- 172.21.15.152:0/3518138005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cd5a0 0x7f86580c4e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f864c009840 tx=0x7f864c009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 -- 172.21.15.152:0/3518138005 shutdown_connections 2023-10-16T20:06:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 --2- 172.21.15.152:0/3518138005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cd5a0 0x7f86580c4e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 -- 172.21.15.152:0/3518138005 >> 172.21.15.152:0/3518138005 conn(0x7f86580cbad0 msgr2=0x7f86580cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 -- 172.21.15.152:0/3518138005 shutdown_connections 2023-10-16T20:06:54.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.894+0000 7f865d433700 1 -- 172.21.15.152:0/3518138005 wait complete. 2023-10-16T20:06:54.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.896+0000 7f7b8df99700 1 -- 172.21.15.152:0/2569976713 shutdown_connections 2023-10-16T20:06:54.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.896+0000 7f7b8df99700 1 -- 172.21.15.152:0/2569976713 wait complete. 2023-10-16T20:06:54.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.896+0000 7f865d433700 1 Processor -- start 2023-10-16T20:06:54.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.896+0000 7f865d433700 1 -- start start 2023-10-16T20:06:54.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f865d433700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f865806daf0 0x7f86582109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f865d433700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cb230 0x7f8658211c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f865d433700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 0x7f86580ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f865d433700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8658212fb0 con 0x7f86580cd5a0 2023-10-16T20:06:54.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f865d433700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8658212140 con 0x7f86580cb230 2023-10-16T20:06:54.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f865d433700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86580cae50 con 0x7f865806daf0 2023-10-16T20:06:54.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.897+0000 7f7b8df99700 1 Processor -- start 2023-10-16T20:06:54.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.897+0000 7f7b8df99700 1 -- start start 2023-10-16T20:06:54.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b8df99700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8806daf0 0x7f7b88151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b8df99700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b880cb210 0x7f7b88152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b8df99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 0x7f7b880af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b8df99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88153ba0 con 0x7f7b880cc5f0 2023-10-16T20:06:54.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b8df99700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880b2d80 con 0x7f7b8806daf0 2023-10-16T20:06:54.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b8df99700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881520e0 con 0x7f7b880cb210 2023-10-16T20:06:54.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b87fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 0x7f7b880af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b87fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 0x7f7b880af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59110/0 (socket says 172.21.15.152:59110) 2023-10-16T20:06:54.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b87fff700 1 -- 172.21.15.152:0/2036757022 learned_addr learned my addr 172.21.15.152:0/2036757022 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f86577fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 0x7f86580ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f86577fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 0x7f86580ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59106/0 (socket says 172.21.15.152:59106) 2023-10-16T20:06:54.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f86577fe700 1 -- 172.21.15.152:0/988994797 learned_addr learned my addr 172.21.15.152:0/988994797 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.898+0000 7f7b877fe700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8806daf0 0x7f7b88151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f86577fe700 1 -- 172.21.15.152:0/988994797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f865806daf0 msgr2=0x7f86582109f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:54.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f86577fe700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f865806daf0 0x7f86582109f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f86577fe700 1 -- 172.21.15.152:0/988994797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cb230 msgr2=0x7f8658211c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:54.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f86577fe700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cb230 0x7f8658211c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f86577fe700 1 -- 172.21.15.152:0/988994797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0094a0 con 0x7f86580cd5a0 2023-10-16T20:06:54.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f86577fe700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 0x7f86580ca910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f865000cb40 tx=0x7f865000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b87fff700 1 -- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b880cb210 msgr2=0x7f7b88152e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T20:06:54.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b87fff700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b880cb210 0x7f7b88152e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b87fff700 1 -- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8806daf0 msgr2=0x7f7b88151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b87fff700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8806daf0 0x7f7b88151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b87fff700 1 -- 172.21.15.152:0/2036757022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8000bb50 con 0x7f7b880cc5f0 2023-10-16T20:06:54.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b877fe700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8806daf0 0x7f7b88151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:54.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000ab50 con 0x7f86580cd5a0 2023-10-16T20:06:54.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b87fff700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 0x7f7b880af180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b80008a00 tx=0x7f7b80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000b2e0 con 0x7f7b880cc5f0 2023-10-16T20:06:54.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80019c60 con 0x7f7b880cc5f0 2023-10-16T20:06:54.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80009600 con 0x7f7b880cc5f0 2023-10-16T20:06:54.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.900+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b881538c0 con 0x7f7b880cc5f0 2023-10-16T20:06:54.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86582123a0 con 0x7f86580cd5a0 2023-10-16T20:06:54.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8658212960 con 0x7f86580cd5a0 2023-10-16T20:06:54.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000acb0 con 0x7f86580cd5a0 2023-10-16T20:06:54.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.899+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650012620 con 0x7f86580cd5a0 2023-10-16T20:06:54.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.900+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880b3270 con 0x7f7b880cc5f0 2023-10-16T20:06:54.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.901+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000f7a0 con 0x7f71dc0cb210 2023-10-16T20:06:54.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.901+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000f900 con 0x7f71dc0cb210 2023-10-16T20:06:54.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.901+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000fc70 con 0x7f71dc0cb210 2023-10-16T20:06:54.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.901+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0b45c0 con 0x7f71dc0cb210 2023-10-16T20:06:54.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.901+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc0b4b80 con 0x7f71dc0cb210 2023-10-16T20:06:54.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.901+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b88072a30 con 0x7f7b880cc5f0 2023-10-16T20:06:54.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.902+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f865001b3b0 con 0x7f86580cd5a0 2023-10-16T20:06:54.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.903+0000 7f863f7fe700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f864406af00 0x7f864406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.903+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86500896a0 con 0x7f86580cd5a0 2023-10-16T20:06:54.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.902+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc0052f0 con 0x7f71dc0cb210 2023-10-16T20:06:54.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.903+0000 7f8656ffd700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f864406af00 0x7f864406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.904+0000 7f8656ffd700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f864406af00 0x7f864406d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8648001580 tx=0x7f8648007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.904+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b8002a020 con 0x7f7b880cc5f0 2023-10-16T20:06:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.905+0000 7f7b6ffff700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b7406af00 0x7f7b7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.905+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b80093970 con 0x7f7b880cc5f0 2023-10-16T20:06:54.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.904+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71d0014070 con 0x7f71dc0cb210 2023-10-16T20:06:54.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.905+0000 7f71c3fff700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71c806afd0 0x7f71c806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.905+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71d0088cd0 con 0x7f71dc0cb210 2023-10-16T20:06:54.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.908+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71d0053b00 con 0x7f71dc0cb210 2023-10-16T20:06:54.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.911+0000 7f7b877fe700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b7406af00 0x7f7b7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.911+0000 7f71db7fe700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71c806afd0 0x7f71c806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.911+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86380052f0 con 0x7f86580cd5a0 2023-10-16T20:06:54.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.911+0000 7f7b877fe700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b7406af00 0x7f7b7406d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800af50 tx=0x7f7b78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.912+0000 7fde640b7700 1 Processor -- start 2023-10-16T20:06:54.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.912+0000 7fde640b7700 1 -- start start 2023-10-16T20:06:54.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.913+0000 7fde640b7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0cf130 0x7fde5c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.913+0000 7fde640b7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c15c6f0 con 0x7fde5c071630 2023-10-16T20:06:54.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.913+0000 7fde640b7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0ce2d0 con 0x7fde5c0711b0 2023-10-16T20:06:54.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.913+0000 7fde640b7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15bb00 con 0x7fde5c0cf130 2023-10-16T20:06:54.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.913+0000 7fde62654700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fde5c071630 0x7fde5c0cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39320/0 (socket says 172.21.15.152:39320) 2023-10-16T20:06:54.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.913+0000 7fde62654700 1 -- 172.21.15.152:0/3861855877 learned_addr learned my addr 172.21.15.152:0/3861855877 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:54.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.914+0000 7fde61e53700 1 --2- 172.21.15.152:0/3861855877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0cf130 0x7fde5c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.914+0000 7fde61e53700 1 -- 172.21.15.152:0/3861855877 >> v1:172.21.15.163:6789/0 conn(0x7fde5c0711b0 legacy=0x7fde5c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.914+0000 7fde61e53700 1 -- 172.21.15.152:0/3861855877 >> v1:172.21.15.152:6789/0 conn(0x7fde5c071630 legacy=0x7fde5c0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.914+0000 7fde61e53700 1 -- 172.21.15.152:0/3861855877 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c071ac0 con 0x7fde5c0cf130 2023-10-16T20:06:54.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.914+0000 7f71db7fe700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71c806afd0 0x7f71c806d490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009c40 tx=0x7f71cc010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.914+0000 7fde61e53700 1 --2- 172.21.15.152:0/3861855877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0cf130 0x7fde5c0c9f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097f0 tx=0x7fde4c009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf3644fd8b00bcc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.915+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b8005e720 con 0x7f7b880cc5f0 2023-10-16T20:06:54.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.915+0000 7fde60e51700 1 -- 172.21.15.152:0/3861855877 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c004230 con 0x7fde5c0cf130 2023-10-16T20:06:54.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.915+0000 7fde60e51700 1 -- 172.21.15.152:0/3861855877 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c004390 con 0x7fde5c0cf130 2023-10-16T20:06:54.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.915+0000 7fde60e51700 1 -- 172.21.15.152:0/3861855877 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0036a0 con 0x7fde5c0cf130 2023-10-16T20:06:54.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.916+0000 7fde640b7700 1 -- 172.21.15.152:0/3861855877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0cf130 msgr2=0x7fde5c0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.916+0000 7fde640b7700 1 --2- 172.21.15.152:0/3861855877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0cf130 0x7fde5c0c9f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097f0 tx=0x7fde4c009b00 comp rx=0 tx=0).stop 2023-10-16T20:06:54.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.917+0000 7fde640b7700 1 -- 172.21.15.152:0/3861855877 shutdown_connections 2023-10-16T20:06:54.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.917+0000 7fde640b7700 1 --2- 172.21.15.152:0/3861855877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0cf130 0x7fde5c0c9f30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.917+0000 7fde640b7700 1 -- 172.21.15.152:0/3861855877 >> 172.21.15.152:0/3861855877 conn(0x7fde5c0cfcd0 msgr2=0x7fde5c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:54.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.917+0000 7fde640b7700 1 -- 172.21.15.152:0/3861855877 shutdown_connections 2023-10-16T20:06:54.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.917+0000 7fde640b7700 1 -- 172.21.15.152:0/3861855877 wait complete. 2023-10-16T20:06:54.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.919+0000 7fde640b7700 1 Processor -- start 2023-10-16T20:06:54.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.919+0000 7fde640b7700 1 -- start start 2023-10-16T20:06:54.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde640b7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0711b0 0x7fde5c0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde640b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 0x7fde5c0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde640b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde5c0cf130 0x7fde5c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde640b7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c203140 con 0x7fde5c0cf130 2023-10-16T20:06:54.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde640b7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1e5b50 con 0x7fde5c071630 2023-10-16T20:06:54.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde640b7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c203350 con 0x7fde5c0711b0 2023-10-16T20:06:54.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde61e53700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0711b0 0x7fde5c0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde61652700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 0x7fde5c0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde61652700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 0x7fde5c0b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60126/0 (socket says 172.21.15.152:60126) 2023-10-16T20:06:54.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.921+0000 7fde61652700 1 -- 172.21.15.152:0/4031444814 learned_addr learned my addr 172.21.15.152:0/4031444814 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:54.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde62654700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde5c0cf130 0x7fde5c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde61652700 1 -- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0711b0 msgr2=0x7fde5c0c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde61652700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0711b0 0x7fde5c0c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde61652700 1 -- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde5c0cf130 msgr2=0x7fde5c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:54.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde61652700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde5c0cf130 0x7fde5c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:54.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde61652700 1 -- 172.21.15.152:0/4031444814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0094a0 con 0x7fde5c071630 2023-10-16T20:06:54.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.922+0000 7fde61652700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 0x7fde5c0b4790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c700 tx=0x7fde5800cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.923+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8650054460 con 0x7f86580cd5a0 2023-10-16T20:06:54.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.924+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde580054e0 con 0x7fde5c071630 2023-10-16T20:06:54.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.924+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde58003680 con 0x7fde5c071630 2023-10-16T20:06:54.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.924+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58003a30 con 0x7fde5c071630 2023-10-16T20:06:54.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.924+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c203630 con 0x7fde5c071630 2023-10-16T20:06:54.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.924+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c0c62b0 con 0x7fde5c071630 2023-10-16T20:06:54.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.927+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde58003b90 con 0x7fde5c071630 2023-10-16T20:06:54.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.928+0000 7fde527fc700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fde4006afd0 0x7fde4006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:54.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.928+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde58088e50 con 0x7fde5c071630 2023-10-16T20:06:54.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.928+0000 7fde61e53700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fde4006afd0 0x7fde4006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:54.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.929+0000 7fde61e53700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fde4006afd0 0x7fde4006d490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009b40 tx=0x7fde4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:54.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.938+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde440052f0 con 0x7fde5c071630 2023-10-16T20:06:54.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:54.947+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde58053c00 con 0x7fde5c071630 2023-10-16T20:06:55.226 INFO:teuthology.orchestra.run.smithi152.stdout:64424509451 2023-10-16T20:06:55.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.221+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75ac0055a0 con 0x7f75cc0cc5f0 2023-10-16T20:06:55.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.222+0000 7f75b3fff700 1 -- 172.21.15.152:0/866302384 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75bc017020 con 0x7f75cc0cc5f0 2023-10-16T20:06:55.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75b806afd0 msgr2=0x7f75b806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75b806afd0 0x7f75b806d490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75c0006fd0 tx=0x7f75c0006bc0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 msgr2=0x7f75cc0afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc0afeb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c4a0 tx=0x7f75bc00c860 comp rx=0 tx=0).stop 2023-10-16T20:06:55.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 shutdown_connections 2023-10-16T20:06:55.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75b806afd0 0x7f75b806d490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75cc1599f0 0x7f75cc168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75cc06e200 0x7f75cc16ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 --2- 172.21.15.152:0/866302384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75cc0cc5f0 0x7f75cc0afeb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.226+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 >> 172.21.15.152:0/866302384 conn(0x7f75cc0cbad0 msgr2=0x7f75cc06daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.227+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 shutdown_connections 2023-10-16T20:06:55.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.227+0000 7f75d1988700 1 -- 172.21.15.152:0/866302384 wait complete. 2023-10-16T20:06:55.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.6 2023-10-16T20:06:55.247 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.289+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4af80ca540 con 0x7f4af80cb210 2023-10-16T20:06:55.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.290+0000 7f4af4ff9700 1 -- 172.21.15.152:0/269515350 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4af0057b60 con 0x7f4af80cb210 2023-10-16T20:06:55.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.290+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8638005870 con 0x7f86580cd5a0 2023-10-16T20:06:55.292 INFO:teuthology.orchestra.run.smithi152.stdout:60129542155 2023-10-16T20:06:55.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.291+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0b3804ebb0 con 0x7f0b38151510 2023-10-16T20:06:55.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.291+0000 7f0b1f7fe700 1 -- 172.21.15.152:0/2359737756 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b30019020 con 0x7f0b38151510 2023-10-16T20:06:55.294 INFO:teuthology.orchestra.run.smithi152.stdout:64424509451 2023-10-16T20:06:55.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4ad806afd0 msgr2=0x7f4ad806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4ad806afd0 0x7f4ad806d490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4af814fc70 tx=0x7f4ae8009040 comp rx=0 tx=0).stop 2023-10-16T20:06:55.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4af80cb210 msgr2=0x7f4af81fac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4af80cb210 0x7f4af81fac30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4af000be50 tx=0x7f4af0009ed0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 shutdown_connections 2023-10-16T20:06:55.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4ad806afd0 0x7f4ad806d490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4af806daf0 0x7f4af814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4af80cb210 0x7f4af81fac30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 --2- 172.21.15.152:0/269515350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4af806eb10 0x7f4af8157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.292+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 >> 172.21.15.152:0/269515350 conn(0x7f4af80cbad0 msgr2=0x7f4af8152070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.293+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 shutdown_connections 2023-10-16T20:06:55.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.293+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc4c071e90 con 0x7fbc4c06eb10 2023-10-16T20:06:55.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.293+0000 7fbc41ffb700 1 -- 172.21.15.152:0/2794225827 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc440549c0 con 0x7fbc4c06eb10 2023-10-16T20:06:55.297 INFO:teuthology.orchestra.run.smithi152.stdout:60129542156 2023-10-16T20:06:55.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f4afddd2700 1 -- 172.21.15.152:0/269515350 wait complete. 2023-10-16T20:06:55.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b2406af00 msgr2=0x7f0b2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b2406af00 0x7f0b2406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b28001810 tx=0x7f0b28007a30 comp rx=0 tx=0).stop 2023-10-16T20:06:55.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b38151510 msgr2=0x7f0b380afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b38151510 0x7f0b380afd70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000be20 tx=0x7f0b3000be50 comp rx=0 tx=0).stop 2023-10-16T20:06:55.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 shutdown_connections 2023-10-16T20:06:55.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b2406af00 0x7f0b2406d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b38151510 0x7f0b380afd70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b380712e0 0x7f0b381497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 --2- 172.21.15.152:0/2359737756 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b380cae90 0x7f0b38150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.294+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 >> 172.21.15.152:0/2359737756 conn(0x7f0b380cfcd0 msgr2=0x7f0b3815ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.296+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbc3006af00 msgr2=0x7fbc3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbc3006af00 0x7fbc3006d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009130 tx=0x7fbc48008030 comp rx=0 tx=0).stop 2023-10-16T20:06:55.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 msgr2=0x7fbc4c155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 0x7fbc4c155d20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400ba50 tx=0x7fbc4400be10 comp rx=0 tx=0).stop 2023-10-16T20:06:55.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 shutdown_connections 2023-10-16T20:06:55.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbc3006af00 0x7fbc3006d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbc4c06daf0 0x7fbc4c150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc4c0cb210 0x7fbc4c1e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 --2- 172.21.15.152:0/2794225827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc4c06eb10 0x7fbc4c155d20 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400ba50 tx=0x7fbc4400be10 comp rx=0 tx=0).stop 2023-10-16T20:06:55.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 >> 172.21.15.152:0/2794225827 conn(0x7fbc4c0cbad0 msgr2=0x7fbc4c151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.297+0000 7f863f7fe700 1 -- 172.21.15.152:0/988994797 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8650017070 con 0x7f86580cd5a0 2023-10-16T20:06:55.303 INFO:teuthology.orchestra.run.smithi152.stdout:64424509451 2023-10-16T20:06:55.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.298+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 shutdown_connections 2023-10-16T20:06:55.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.298+0000 7fbc53365700 1 -- 172.21.15.152:0/2794225827 wait complete. 2023-10-16T20:06:55.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f864406af00 msgr2=0x7f864406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f864406af00 0x7f864406d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8648001580 tx=0x7f8648007a00 comp rx=0 tx=0).stop 2023-10-16T20:06:55.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 msgr2=0x7f86580ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 0x7f86580ca910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f865000cb40 tx=0x7f865000cf00 comp rx=0 tx=0).stop 2023-10-16T20:06:55.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 shutdown_connections 2023-10-16T20:06:55.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f864406af00 0x7f864406d3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f865806daf0 0x7f86582109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86580cd5a0 0x7f86580ca910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 --2- 172.21.15.152:0/988994797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86580cb230 0x7f8658211c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 >> 172.21.15.152:0/988994797 conn(0x7f86580cbad0 msgr2=0x7f8658151970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 shutdown_connections 2023-10-16T20:06:55.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.299+0000 7f865d433700 1 -- 172.21.15.152:0/988994797 wait complete. 2023-10-16T20:06:55.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.303+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71bc005870 con 0x7f71dc0cb210 2023-10-16T20:06:55.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.303+0000 7f71c3fff700 1 -- 172.21.15.152:0/4146999893 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71d0057120 con 0x7f71dc0cb210 2023-10-16T20:06:55.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.304+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 shutdown_connections 2023-10-16T20:06:55.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f0b3d1ba700 1 -- 172.21.15.152:0/2359737756 wait complete. 2023-10-16T20:06:55.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.306+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7b8804ebb0 con 0x7f7b880cc5f0 2023-10-16T20:06:55.309 INFO:teuthology.orchestra.run.smithi152.stdout:60129542156 2023-10-16T20:06:55.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71c806afd0 msgr2=0x7f71c806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71c806afd0 0x7f71c806d490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009c40 tx=0x7f71cc010000 comp rx=0 tx=0).stop 2023-10-16T20:06:55.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 msgr2=0x7f71dc14ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 0x7f71dc14ff60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71d000bb20 tx=0x7f71d000be30 comp rx=0 tx=0).stop 2023-10-16T20:06:55.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 shutdown_connections 2023-10-16T20:06:55.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71c806afd0 0x7f71c806d490 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71dc0cc5f0 0x7f71dc14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71dc06daf0 0x7f71dc0b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 --2- 172.21.15.152:0/4146999893 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71dc0cb210 0x7f71dc14ff60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.307+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 >> 172.21.15.152:0/4146999893 conn(0x7f71dc0cbad0 msgr2=0x7f71dc1589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.308+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 shutdown_connections 2023-10-16T20:06:55.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.308+0000 7f71e1bf0700 1 -- 172.21.15.152:0/4146999893 wait complete. 2023-10-16T20:06:55.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.309+0000 7f7b6ffff700 1 -- 172.21.15.152:0/2036757022 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b80061d40 con 0x7f7b880cc5f0 2023-10-16T20:06:55.313 INFO:teuthology.orchestra.run.smithi152.stdout:64424509452 2023-10-16T20:06:55.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.2 2023-10-16T20:06:55.314 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.313+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b7406af00 msgr2=0x7f7b7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.313+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b7406af00 0x7f7b7406d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800af50 tx=0x7f7b78008040 comp rx=0 tx=0).stop 2023-10-16T20:06:55.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.313+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 msgr2=0x7f7b880af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.313+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 0x7f7b880af180 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b80008a00 tx=0x7f7b80004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.314+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 shutdown_connections 2023-10-16T20:06:55.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.314+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b7406af00 0x7f7b7406d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.314+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b880cc5f0 0x7f7b880af180 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.314+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b8806daf0 0x7f7b88151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.314+0000 7f7b8df99700 1 --2- 172.21.15.152:0/2036757022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b880cb210 0x7f7b88152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.314+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 >> 172.21.15.152:0/2036757022 conn(0x7f7b880cbad0 msgr2=0x7f7b880c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.315+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 shutdown_connections 2023-10-16T20:06:55.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.315+0000 7f7b8df99700 1 -- 172.21.15.152:0/2036757022 wait complete. 2023-10-16T20:06:55.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542156 for osd.0 2023-10-16T20:06:55.321 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.5 2023-10-16T20:06:55.330 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542156 for osd.3 2023-10-16T20:06:55.333 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.4 2023-10-16T20:06:55.334 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.7 2023-10-16T20:06:55.340 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.345+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde440055a0 con 0x7fde5c071630 2023-10-16T20:06:55.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.345+0000 7fde527fc700 1 -- 172.21.15.152:0/4031444814 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde58017030 con 0x7fde5c071630 2023-10-16T20:06:55.347 INFO:teuthology.orchestra.run.smithi152.stdout:60129542155 2023-10-16T20:06:55.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fde4006afd0 msgr2=0x7fde4006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fde4006afd0 0x7fde4006d490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009b40 tx=0x7fde4c008030 comp rx=0 tx=0).stop 2023-10-16T20:06:55.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 msgr2=0x7fde5c0b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 0x7fde5c0b4790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c700 tx=0x7fde5800cac0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 shutdown_connections 2023-10-16T20:06:55.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fde4006afd0 0x7fde4006d490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fde5c0711b0 0x7fde5c0c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde5c0cf130 0x7fde5c0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 --2- 172.21.15.152:0/4031444814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fde5c071630 0x7fde5c0b4790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 >> 172.21.15.152:0/4031444814 conn(0x7fde5c0cfcd0 msgr2=0x7fde5c0b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 shutdown_connections 2023-10-16T20:06:55.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.348+0000 7fde640b7700 1 -- 172.21.15.152:0/4031444814 wait complete. 2023-10-16T20:06:55.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.1 2023-10-16T20:06:55.362 DEBUG:teuthology.parallel:result is None 2023-10-16T20:06:55.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T20:06:55.363 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:06:55.521 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.519+0000 7f076c1f1700 1 Processor -- start 2023-10-16T20:06:55.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.520+0000 7f076c1f1700 1 -- start start 2023-10-16T20:06:55.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.520+0000 7f076c1f1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f076406a820 0x7f07640cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.520+0000 7f076c1f1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f076406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.520+0000 7f076c1f1700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640cfeb0 con 0x7f07640ca7d0 2023-10-16T20:06:55.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.520+0000 7f076c1f1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640ce410 con 0x7f076406a820 2023-10-16T20:06:55.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.520+0000 7f076c1f1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076415ec50 con 0x7f076415e7f0 2023-10-16T20:06:55.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f076406a820 0x7f07640cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f076978c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f076406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f076406a820 0x7f07640cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60134/0 (socket says 172.21.15.152:60134) 2023-10-16T20:06:55.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 -- 172.21.15.152:0/3415960126 learned_addr learned my addr 172.21.15.152:0/3415960126 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:55.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f076a78e700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f07640ca7d0 0x7f0764071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54514/0 (socket says 172.21.15.152:54514) 2023-10-16T20:06:55.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 -- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 msgr2=0x7f076406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:55.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 --2- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f076406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 -- 172.21.15.152:0/3415960126 >> v1:172.21.15.163:6789/0 conn(0x7f07640ca7d0 legacy=0x7f0764071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 -- 172.21.15.152:0/3415960126 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640af9d0 con 0x7f076406a820 2023-10-16T20:06:55.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f076978c700 1 --2- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f076406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:55.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0769f8d700 1 --2- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f076406a820 0x7f07640cf7d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b6aac36c322c8b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:55.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0768f8b700 1 -- 172.21.15.152:0/3415960126 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011830 con 0x7f076406a820 2023-10-16T20:06:55.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0768f8b700 1 -- 172.21.15.152:0/3415960126 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754011990 con 0x7f076406a820 2023-10-16T20:06:55.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.521+0000 7f0768f8b700 1 -- 172.21.15.152:0/3415960126 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011d20 con 0x7f076406a820 2023-10-16T20:06:55.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 -- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f076406a820 msgr2=0x7f07640cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 --2- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f076406a820 0x7f07640cf7d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:55.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 -- 172.21.15.152:0/3415960126 shutdown_connections 2023-10-16T20:06:55.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 --2- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f076406a820 0x7f07640cf7d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 --2- 172.21.15.152:0/3415960126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f076406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 -- 172.21.15.152:0/3415960126 >> 172.21.15.152:0/3415960126 conn(0x7f07640d0180 msgr2=0x7f07640d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 -- 172.21.15.152:0/3415960126 shutdown_connections 2023-10-16T20:06:55.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.522+0000 7f076c1f1700 1 -- 172.21.15.152:0/3415960126 wait complete. 2023-10-16T20:06:55.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.523+0000 7f076c1f1700 1 Processor -- start 2023-10-16T20:06:55.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.523+0000 7f076c1f1700 1 -- start start 2023-10-16T20:06:55.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076c1f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 0x7f07641f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076c1f1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07640ca7d0 0x7f07640c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076c1f1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f07640c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076c1f1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640ca460 con 0x7f076406a820 2023-10-16T20:06:55.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076c1f1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c9850 con 0x7f07640ca7d0 2023-10-16T20:06:55.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076c1f1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c9b30 con 0x7f076415e7f0 2023-10-16T20:06:55.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 0x7f07641f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 0x7f07641f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59140/0 (socket says 172.21.15.152:59140) 2023-10-16T20:06:55.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 -- 172.21.15.152:0/71171459 learned_addr learned my addr 172.21.15.152:0/71171459 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:55.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076a78e700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f07640c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076978c700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07640ca7d0 0x7f07640c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 -- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 msgr2=0x7f07640c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f07640c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 -- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07640ca7d0 msgr2=0x7f07640c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07640ca7d0 0x7f07640c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f0769f8d700 1 -- 172.21.15.152:0/71171459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600094a0 con 0x7f076406a820 2023-10-16T20:06:55.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.524+0000 7f076978c700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07640ca7d0 0x7f07640c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:55.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.525+0000 7f0769f8d700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 0x7f07641f2950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0754000c00 tx=0x7f0754004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:55.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.525+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540045b0 con 0x7f076406a820 2023-10-16T20:06:55.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.525+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075401f070 con 0x7f076406a820 2023-10-16T20:06:55.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.525+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540038a0 con 0x7f076406a820 2023-10-16T20:06:55.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.525+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754009550 con 0x7f076406a820 2023-10-16T20:06:55.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.525+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07640ca0f0 con 0x7f076406a820 2023-10-16T20:06:55.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.526+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640ca280 con 0x7f076406a820 2023-10-16T20:06:55.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.526+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0754021030 con 0x7f076406a820 2023-10-16T20:06:55.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.526+0000 7f075a7fc700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f074806af00 0x7f074806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.527+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f075408ad80 con 0x7f076406a820 2023-10-16T20:06:55.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.527+0000 7f076978c700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f074806af00 0x7f074806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.527+0000 7f076978c700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f074806af00 0x7f074806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0760009c50 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:55.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.531+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0754055cf0 con 0x7f076406a820 2023-10-16T20:06:55.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.718+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07640af410 con 0x7f074806af00 2023-10-16T20:06:55.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.727+0000 7f075a7fc700 1 -- 172.21.15.152:0/71171459 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345232 (secure 0 0 0) 0x7f0760009d90 con 0x7f074806af00 2023-10-16T20:06:55.733 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f074806af00 msgr2=0x7f074806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f074806af00 0x7f074806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0760009c50 tx=0x7f0760008040 comp rx=0 tx=0).stop 2023-10-16T20:06:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 msgr2=0x7f07641f2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 0x7f07641f2950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0754000c00 tx=0x7f0754004750 comp rx=0 tx=0).stop 2023-10-16T20:06:55.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 shutdown_connections 2023-10-16T20:06:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f074806af00 0x7f074806d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f076415e7f0 0x7f07640c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076406a820 0x7f07641f2950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 --2- 172.21.15.152:0/71171459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f07640ca7d0 0x7f07640c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.731+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 >> 172.21.15.152:0/71171459 conn(0x7f07640d0180 msgr2=0x7f076415f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.732+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 shutdown_connections 2023-10-16T20:06:55.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.732+0000 7f076c1f1700 1 -- 172.21.15.152:0/71171459 wait complete. 2023-10-16T20:06:55.738 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:06:55.745 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-16T20:06:54.772027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3416064,"data_stored":2039488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008483"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195372+0000","last_change":"2023-10-16T20:06:32.768697+0000","last_active":"2023-10-16T20:06:37.195372+0000","last_peered":"2023-10-16T20:06:37.195372+0000","last_clean":"2023-10-16T20:06:37.195372+0000","last_became_active":"2023-10-16T20:06:32.768425+0000","last_became_peered":"2023-10-16T20:06:32.768425+0000","last_unstale":"2023-10-16T20:06:37.195372+0000","last_undegraded":"2023-10-16T20:06:37.195372+0000","last_fullsized":"2023-10-16T20:06:37.195372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886277+0000","last_change":"2023-10-16T20:06:32.752823+0000","last_active":"2023-10-16T20:06:36.886277+0000","last_peered":"2023-10-16T20:06:36.886277+0000","last_clean":"2023-10-16T20:06:36.886277+0000","last_became_active":"2023-10-16T20:06:32.752488+0000","last_became_peered":"2023-10-16T20:06:32.752488+0000","last_unstale":"2023-10-16T20:06:36.886277+0000","last_undegraded":"2023-10-16T20:06:36.886277+0000","last_fullsized":"2023-10-16T20:06:36.886277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885188+0000","last_change":"2023-10-16T20:06:32.755212+0000","last_active":"2023-10-16T20:06:36.885188+0000","last_peered":"2023-10-16T20:06:36.885188+0000","last_clean":"2023-10-16T20:06:36.885188+0000","last_became_active":"2023-10-16T20:06:32.754919+0000","last_became_peered":"2023-10-16T20:06:32.754919+0000","last_unstale":"2023-10-16T20:06:36.885188+0000","last_undegraded":"2023-10-16T20:06:36.885188+0000","last_fullsized":"2023-10-16T20:06:36.885188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.761928+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761127+0000","last_became_peered":"2023-10-16T20:06:32.761127+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194887+0000","last_change":"2023-10-16T20:06:32.767050+0000","last_active":"2023-10-16T20:06:37.194887+0000","last_peered":"2023-10-16T20:06:37.194887+0000","last_clean":"2023-10-16T20:06:37.194887+0000","last_became_active":"2023-10-16T20:06:32.766739+0000","last_became_peered":"2023-10-16T20:06:32.766739+0000","last_unstale":"2023-10-16T20:06:37.194887+0000","last_undegraded":"2023-10-16T20:06:37.194887+0000","last_fullsized":"2023-10-16T20:06:37.194887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884978+0000","last_change":"2023-10-16T20:06:32.761991+0000","last_active":"2023-10-16T20:06:36.884978+0000","last_peered":"2023-10-16T20:06:36.884978+0000","last_clean":"2023-10-16T20:06:36.884978+0000","last_became_active":"2023-10-16T20:06:32.761421+0000","last_became_peered":"2023-10-16T20:06:32.761421+0000","last_unstale":"2023-10-16T20:06:36.884978+0000","last_undegraded":"2023-10-16T20:06:36.884978+0000","last_fullsized":"2023-10-16T20:06:36.884978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194866+0000","last_change":"2023-10-16T20:06:32.767492+0000","last_active":"2023-10-16T20:06:37.194866+0000","last_peered":"2023-10-16T20:06:37.194866+0000","last_clean":"2023-10-16T20:06:37.194866+0000","last_became_active":"2023-10-16T20:06:32.767148+0000","last_became_peered":"2023-10-16T20:06:32.767148+0000","last_unstale":"2023-10-16T20:06:37.194866+0000","last_undegraded":"2023-10-16T20:06:37.194866+0000","last_fullsized":"2023-10-16T20:06:37.194866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894286+0000","last_change":"2023-10-16T20:06:32.761690+0000","last_active":"2023-10-16T20:06:36.894286+0000","last_peered":"2023-10-16T20:06:36.894286+0000","last_clean":"2023-10-16T20:06:36.894286+0000","last_became_active":"2023-10-16T20:06:32.761353+0000","last_became_peered":"2023-10-16T20:06:32.761353+0000","last_unstale":"2023-10-16T20:06:36.894286+0000","last_undegraded":"2023-10-16T20:06:36.894286+0000","last_fullsized":"2023-10-16T20:06:36.894286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195306+0000","last_change":"2023-10-16T20:06:32.768700+0000","last_active":"2023-10-16T20:06:37.195306+0000","last_peered":"2023-10-16T20:06:37.195306+0000","last_clean":"2023-10-16T20:06:37.195306+0000","last_became_active":"2023-10-16T20:06:32.768467+0000","last_became_peered":"2023-10-16T20:06:32.768467+0000","last_unstale":"2023-10-16T20:06:37.195306+0000","last_undegraded":"2023-10-16T20:06:37.195306+0000","last_fullsized":"2023-10-16T20:06:37.195306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878795+0000","last_change":"2023-10-16T20:06:32.761708+0000","last_active":"2023-10-16T20:06:36.878795+0000","last_peered":"2023-10-16T20:06:36.878795+0000","last_clean":"2023-10-16T20:06:36.878795+0000","last_became_active":"2023-10-16T20:06:32.761049+0000","last_became_peered":"2023-10-16T20:06:32.761049+0000","last_unstale":"2023-10-16T20:06:36.878795+0000","last_undegraded":"2023-10-16T20:06:36.878795+0000","last_fullsized":"2023-10-16T20:06:36.878795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.879062+0000","last_change":"2023-10-16T20:06:32.763671+0000","last_active":"2023-10-16T20:06:36.879062+0000","last_peered":"2023-10-16T20:06:36.879062+0000","last_clean":"2023-10-16T20:06:36.879062+0000","last_became_active":"2023-10-16T20:06:32.763356+0000","last_became_peered":"2023-10-16T20:06:32.763356+0000","last_unstale":"2023-10-16T20:06:36.879062+0000","last_undegraded":"2023-10-16T20:06:36.879062+0000","last_fullsized":"2023-10-16T20:06:36.879062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:47.470974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876982+0000","last_change":"2023-10-16T20:06:32.750776+0000","last_active":"2023-10-16T20:06:36.876982+0000","last_peered":"2023-10-16T20:06:36.876982+0000","last_clean":"2023-10-16T20:06:36.876982+0000","last_became_active":"2023-10-16T20:06:32.750465+0000","last_became_peered":"2023-10-16T20:06:32.750465+0000","last_unstale":"2023-10-16T20:06:36.876982+0000","last_undegraded":"2023-10-16T20:06:36.876982+0000","last_fullsized":"2023-10-16T20:06:36.876982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:55.631957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893374+0000","last_change":"2023-10-16T20:06:32.759849+0000","last_active":"2023-10-16T20:06:36.893374+0000","last_peered":"2023-10-16T20:06:36.893374+0000","last_clean":"2023-10-16T20:06:36.893374+0000","last_became_active":"2023-10-16T20:06:32.759521+0000","last_became_peered":"2023-10-16T20:06:32.759521+0000","last_unstale":"2023-10-16T20:06:36.893374+0000","last_undegraded":"2023-10-16T20:06:36.893374+0000","last_fullsized":"2023-10-16T20:06:36.893374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881227+0000","last_change":"2023-10-16T20:06:32.758196+0000","last_active":"2023-10-16T20:06:36.881227+0000","last_peered":"2023-10-16T20:06:36.881227+0000","last_clean":"2023-10-16T20:06:36.881227+0000","last_became_active":"2023-10-16T20:06:32.757915+0000","last_became_peered":"2023-10-16T20:06:32.757915+0000","last_unstale":"2023-10-16T20:06:36.881227+0000","last_undegraded":"2023-10-16T20:06:36.881227+0000","last_fullsized":"2023-10-16T20:06:36.881227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882603+0000","last_change":"2023-10-16T20:06:32.745759+0000","last_active":"2023-10-16T20:06:36.882603+0000","last_peered":"2023-10-16T20:06:36.882603+0000","last_clean":"2023-10-16T20:06:36.882603+0000","last_became_active":"2023-10-16T20:06:32.745456+0000","last_became_peered":"2023-10-16T20:06:32.745456+0000","last_unstale":"2023-10-16T20:06:36.882603+0000","last_undegraded":"2023-10-16T20:06:36.882603+0000","last_fullsized":"2023-10-16T20:06:36.882603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884589+0000","last_change":"2023-10-16T20:06:32.762852+0000","last_active":"2023-10-16T20:06:36.884589+0000","last_peered":"2023-10-16T20:06:36.884589+0000","last_clean":"2023-10-16T20:06:36.884589+0000","last_became_active":"2023-10-16T20:06:32.762554+0000","last_became_peered":"2023-10-16T20:06:32.762554+0000","last_unstale":"2023-10-16T20:06:36.884589+0000","last_undegraded":"2023-10-16T20:06:36.884589+0000","last_fullsized":"2023-10-16T20:06:36.884589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885258+0000","last_change":"2023-10-16T20:06:32.769083+0000","last_active":"2023-10-16T20:06:36.885258+0000","last_peered":"2023-10-16T20:06:36.885258+0000","last_clean":"2023-10-16T20:06:36.885258+0000","last_became_active":"2023-10-16T20:06:32.768686+0000","last_became_peered":"2023-10-16T20:06:32.768686+0000","last_unstale":"2023-10-16T20:06:36.885258+0000","last_undegraded":"2023-10-16T20:06:36.885258+0000","last_fullsized":"2023-10-16T20:06:36.885258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876513+0000","last_change":"2023-10-16T20:06:32.756439+0000","last_active":"2023-10-16T20:06:36.876513+0000","last_peered":"2023-10-16T20:06:36.876513+0000","last_clean":"2023-10-16T20:06:36.876513+0000","last_became_active":"2023-10-16T20:06:32.756183+0000","last_became_peered":"2023-10-16T20:06:32.756183+0000","last_unstale":"2023-10-16T20:06:36.876513+0000","last_undegraded":"2023-10-16T20:06:36.876513+0000","last_fullsized":"2023-10-16T20:06:36.876513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:35.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195238+0000","last_change":"2023-10-16T20:06:32.759997+0000","last_active":"2023-10-16T20:06:37.195238+0000","last_peered":"2023-10-16T20:06:37.195238+0000","last_clean":"2023-10-16T20:06:37.195238+0000","last_became_active":"2023-10-16T20:06:32.759616+0000","last_became_peered":"2023-10-16T20:06:32.759616+0000","last_unstale":"2023-10-16T20:06:37.195238+0000","last_undegraded":"2023-10-16T20:06:37.195238+0000","last_fullsized":"2023-10-16T20:06:37.195238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877453+0000","last_change":"2023-10-16T20:06:37.202706+0000","last_active":"2023-10-16T20:06:37.877453+0000","last_peered":"2023-10-16T20:06:37.877453+0000","last_clean":"2023-10-16T20:06:37.877453+0000","last_became_active":"2023-10-16T20:06:37.201561+0000","last_became_peered":"2023-10-16T20:06:37.201561+0000","last_unstale":"2023-10-16T20:06:37.877453+0000","last_undegraded":"2023-10-16T20:06:37.877453+0000","last_fullsized":"2023-10-16T20:06:37.877453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:54.383396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881285+0000","last_change":"2023-10-16T20:06:31.760708+0000","last_active":"2023-10-16T20:06:36.881285+0000","last_peered":"2023-10-16T20:06:36.881285+0000","last_clean":"2023-10-16T20:06:36.881285+0000","last_became_active":"2023-10-16T20:06:31.760372+0000","last_became_peered":"2023-10-16T20:06:31.760372+0000","last_unstale":"2023-10-16T20:06:36.881285+0000","last_undegraded":"2023-10-16T20:06:36.881285+0000","last_fullsized":"2023-10-16T20:06:36.881285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:34.488224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894537+0000","last_change":"2023-10-16T20:06:32.755438+0000","last_active":"2023-10-16T20:06:36.894537+0000","last_peered":"2023-10-16T20:06:36.894537+0000","last_clean":"2023-10-16T20:06:36.894537+0000","last_became_active":"2023-10-16T20:06:32.755151+0000","last_became_peered":"2023-10-16T20:06:32.755151+0000","last_unstale":"2023-10-16T20:06:36.894537+0000","last_undegraded":"2023-10-16T20:06:36.894537+0000","last_fullsized":"2023-10-16T20:06:36.894537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877813+0000","last_change":"2023-10-16T20:06:36.894982+0000","last_active":"2023-10-16T20:06:37.877813+0000","last_peered":"2023-10-16T20:06:37.877813+0000","last_clean":"2023-10-16T20:06:37.877813+0000","last_became_active":"2023-10-16T20:06:36.894580+0000","last_became_peered":"2023-10-16T20:06:36.894580+0000","last_unstale":"2023-10-16T20:06:37.877813+0000","last_undegraded":"2023-10-16T20:06:37.877813+0000","last_fullsized":"2023-10-16T20:06:37.877813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:01.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894628+0000","last_change":"2023-10-16T20:06:31.758252+0000","last_active":"2023-10-16T20:06:36.894628+0000","last_peered":"2023-10-16T20:06:36.894628+0000","last_clean":"2023-10-16T20:06:36.894628+0000","last_became_active":"2023-10-16T20:06:31.758059+0000","last_became_peered":"2023-10-16T20:06:31.758059+0000","last_unstale":"2023-10-16T20:06:36.894628+0000","last_undegraded":"2023-10-16T20:06:36.894628+0000","last_fullsized":"2023-10-16T20:06:36.894628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881181+0000","last_change":"2023-10-16T20:06:32.762874+0000","last_active":"2023-10-16T20:06:36.881181+0000","last_peered":"2023-10-16T20:06:36.881181+0000","last_clean":"2023-10-16T20:06:36.881181+0000","last_became_active":"2023-10-16T20:06:32.762402+0000","last_became_peered":"2023-10-16T20:06:32.762402+0000","last_unstale":"2023-10-16T20:06:36.881181+0000","last_undegraded":"2023-10-16T20:06:36.881181+0000","last_fullsized":"2023-10-16T20:06:36.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877518+0000","last_change":"2023-10-16T20:06:36.898631+0000","last_active":"2023-10-16T20:06:37.877518+0000","last_peered":"2023-10-16T20:06:37.877518+0000","last_clean":"2023-10-16T20:06:37.877518+0000","last_became_active":"2023-10-16T20:06:36.898270+0000","last_became_peered":"2023-10-16T20:06:36.898270+0000","last_unstale":"2023-10-16T20:06:37.877518+0000","last_undegraded":"2023-10-16T20:06:37.877518+0000","last_fullsized":"2023-10-16T20:06:37.877518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:51.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195047+0000","last_change":"2023-10-16T20:06:31.760987+0000","last_active":"2023-10-16T20:06:37.195047+0000","last_peered":"2023-10-16T20:06:37.195047+0000","last_clean":"2023-10-16T20:06:37.195047+0000","last_became_active":"2023-10-16T20:06:31.760689+0000","last_became_peered":"2023-10-16T20:06:31.760689+0000","last_unstale":"2023-10-16T20:06:37.195047+0000","last_undegraded":"2023-10-16T20:06:37.195047+0000","last_fullsized":"2023-10-16T20:06:37.195047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:55.970423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884745+0000","last_change":"2023-10-16T20:06:32.761819+0000","last_active":"2023-10-16T20:06:36.884745+0000","last_peered":"2023-10-16T20:06:36.884745+0000","last_clean":"2023-10-16T20:06:36.884745+0000","last_became_active":"2023-10-16T20:06:32.760684+0000","last_became_peered":"2023-10-16T20:06:32.760684+0000","last_unstale":"2023-10-16T20:06:36.884745+0000","last_undegraded":"2023-10-16T20:06:36.884745+0000","last_fullsized":"2023-10-16T20:06:36.884745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878229+0000","last_change":"2023-10-16T20:06:36.892310+0000","last_active":"2023-10-16T20:06:37.878229+0000","last_peered":"2023-10-16T20:06:37.878229+0000","last_clean":"2023-10-16T20:06:37.878229+0000","last_became_active":"2023-10-16T20:06:36.891929+0000","last_became_peered":"2023-10-16T20:06:36.891929+0000","last_unstale":"2023-10-16T20:06:37.878229+0000","last_undegraded":"2023-10-16T20:06:37.878229+0000","last_fullsized":"2023-10-16T20:06:37.878229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:08.770589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194885+0000","last_change":"2023-10-16T20:06:31.764299+0000","last_active":"2023-10-16T20:06:37.194885+0000","last_peered":"2023-10-16T20:06:37.194885+0000","last_clean":"2023-10-16T20:06:37.194885+0000","last_became_active":"2023-10-16T20:06:31.763992+0000","last_became_peered":"2023-10-16T20:06:31.763992+0000","last_unstale":"2023-10-16T20:06:37.194885+0000","last_undegraded":"2023-10-16T20:06:37.194885+0000","last_fullsized":"2023-10-16T20:06:37.194885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:47.236030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885181+0000","last_change":"2023-10-16T20:06:32.762698+0000","last_active":"2023-10-16T20:06:36.885181+0000","last_peered":"2023-10-16T20:06:36.885181+0000","last_clean":"2023-10-16T20:06:36.885181+0000","last_became_active":"2023-10-16T20:06:32.762260+0000","last_became_peered":"2023-10-16T20:06:32.762260+0000","last_unstale":"2023-10-16T20:06:36.885181+0000","last_undegraded":"2023-10-16T20:06:36.885181+0000","last_fullsized":"2023-10-16T20:06:36.885181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877522+0000","last_change":"2023-10-16T20:06:36.899980+0000","last_active":"2023-10-16T20:06:37.877522+0000","last_peered":"2023-10-16T20:06:37.877522+0000","last_clean":"2023-10-16T20:06:37.877522+0000","last_became_active":"2023-10-16T20:06:36.899573+0000","last_became_peered":"2023-10-16T20:06:36.899573+0000","last_unstale":"2023-10-16T20:06:37.877522+0000","last_undegraded":"2023-10-16T20:06:37.877522+0000","last_fullsized":"2023-10-16T20:06:37.877522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:13.468658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893703+0000","last_change":"2023-10-16T20:06:31.760320+0000","last_active":"2023-10-16T20:06:36.893703+0000","last_peered":"2023-10-16T20:06:36.893703+0000","last_clean":"2023-10-16T20:06:36.893703+0000","last_became_active":"2023-10-16T20:06:31.759976+0000","last_became_peered":"2023-10-16T20:06:31.759976+0000","last_unstale":"2023-10-16T20:06:36.893703+0000","last_undegraded":"2023-10-16T20:06:36.893703+0000","last_fullsized":"2023-10-16T20:06:36.893703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878749+0000","last_change":"2023-10-16T20:06:32.746691+0000","last_active":"2023-10-16T20:06:36.878749+0000","last_peered":"2023-10-16T20:06:36.878749+0000","last_clean":"2023-10-16T20:06:36.878749+0000","last_became_active":"2023-10-16T20:06:32.745389+0000","last_became_peered":"2023-10-16T20:06:32.745389+0000","last_unstale":"2023-10-16T20:06:36.878749+0000","last_undegraded":"2023-10-16T20:06:36.878749+0000","last_fullsized":"2023-10-16T20:06:36.878749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:23:34.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450907+0000","last_change":"2023-10-16T20:06:36.900651+0000","last_active":"2023-10-16T20:06:38.450907+0000","last_peered":"2023-10-16T20:06:38.450907+0000","last_clean":"2023-10-16T20:06:38.450907+0000","last_became_active":"2023-10-16T20:06:36.900236+0000","last_became_peered":"2023-10-16T20:06:36.900236+0000","last_unstale":"2023-10-16T20:06:38.450907+0000","last_undegraded":"2023-10-16T20:06:38.450907+0000","last_fullsized":"2023-10-16T20:06:38.450907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:01.291449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876809+0000","last_change":"2023-10-16T20:06:31.761790+0000","last_active":"2023-10-16T20:06:36.876809+0000","last_peered":"2023-10-16T20:06:36.876809+0000","last_clean":"2023-10-16T20:06:36.876809+0000","last_became_active":"2023-10-16T20:06:31.761519+0000","last_became_peered":"2023-10-16T20:06:31.761519+0000","last_unstale":"2023-10-16T20:06:36.876809+0000","last_undegraded":"2023-10-16T20:06:36.876809+0000","last_fullsized":"2023-10-16T20:06:36.876809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:20.846036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881411+0000","last_change":"2023-10-16T20:06:32.757771+0000","last_active":"2023-10-16T20:06:36.881411+0000","last_peered":"2023-10-16T20:06:36.881411+0000","last_clean":"2023-10-16T20:06:36.881411+0000","last_became_active":"2023-10-16T20:06:32.757124+0000","last_became_peered":"2023-10-16T20:06:32.757124+0000","last_unstale":"2023-10-16T20:06:36.881411+0000","last_undegraded":"2023-10-16T20:06:36.881411+0000","last_fullsized":"2023-10-16T20:06:36.881411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877753+0000","last_change":"2023-10-16T20:06:36.894985+0000","last_active":"2023-10-16T20:06:37.877753+0000","last_peered":"2023-10-16T20:06:37.877753+0000","last_clean":"2023-10-16T20:06:37.877753+0000","last_became_active":"2023-10-16T20:06:36.894583+0000","last_became_peered":"2023-10-16T20:06:36.894583+0000","last_unstale":"2023-10-16T20:06:37.877753+0000","last_undegraded":"2023-10-16T20:06:37.877753+0000","last_fullsized":"2023-10-16T20:06:37.877753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893346+0000","last_change":"2023-10-16T20:06:31.755087+0000","last_active":"2023-10-16T20:06:36.893346+0000","last_peered":"2023-10-16T20:06:36.893346+0000","last_clean":"2023-10-16T20:06:36.893346+0000","last_became_active":"2023-10-16T20:06:31.754799+0000","last_became_peered":"2023-10-16T20:06:31.754799+0000","last_unstale":"2023-10-16T20:06:36.893346+0000","last_undegraded":"2023-10-16T20:06:36.893346+0000","last_fullsized":"2023-10-16T20:06:36.893346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:50.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894075+0000","last_change":"2023-10-16T20:06:32.760484+0000","last_active":"2023-10-16T20:06:36.894075+0000","last_peered":"2023-10-16T20:06:36.894075+0000","last_clean":"2023-10-16T20:06:36.894075+0000","last_became_active":"2023-10-16T20:06:32.759921+0000","last_became_peered":"2023-10-16T20:06:32.759921+0000","last_unstale":"2023-10-16T20:06:36.894075+0000","last_undegraded":"2023-10-16T20:06:36.894075+0000","last_fullsized":"2023-10-16T20:06:36.894075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450546+0000","last_change":"2023-10-16T20:06:37.201860+0000","last_active":"2023-10-16T20:06:38.450546+0000","last_peered":"2023-10-16T20:06:38.450546+0000","last_clean":"2023-10-16T20:06:38.450546+0000","last_became_active":"2023-10-16T20:06:37.201460+0000","last_became_peered":"2023-10-16T20:06:37.201460+0000","last_unstale":"2023-10-16T20:06:38.450546+0000","last_undegraded":"2023-10-16T20:06:38.450546+0000","last_fullsized":"2023-10-16T20:06:38.450546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884636+0000","last_change":"2023-10-16T20:06:31.763472+0000","last_active":"2023-10-16T20:06:36.884636+0000","last_peered":"2023-10-16T20:06:36.884636+0000","last_clean":"2023-10-16T20:06:36.884636+0000","last_became_active":"2023-10-16T20:06:31.763182+0000","last_became_peered":"2023-10-16T20:06:31.763182+0000","last_unstale":"2023-10-16T20:06:36.884636+0000","last_undegraded":"2023-10-16T20:06:36.884636+0000","last_fullsized":"2023-10-16T20:06:36.884636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:36.641784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882893+0000","last_change":"2023-10-16T20:06:32.760456+0000","last_active":"2023-10-16T20:06:36.882893+0000","last_peered":"2023-10-16T20:06:36.882893+0000","last_clean":"2023-10-16T20:06:36.882893+0000","last_became_active":"2023-10-16T20:06:32.760213+0000","last_became_peered":"2023-10-16T20:06:32.760213+0000","last_unstale":"2023-10-16T20:06:36.882893+0000","last_undegraded":"2023-10-16T20:06:36.882893+0000","last_fullsized":"2023-10-16T20:06:36.882893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877007+0000","last_change":"2023-10-16T20:06:37.202225+0000","last_active":"2023-10-16T20:06:37.877007+0000","last_peered":"2023-10-16T20:06:37.877007+0000","last_clean":"2023-10-16T20:06:37.877007+0000","last_became_active":"2023-10-16T20:06:37.201869+0000","last_became_peered":"2023-10-16T20:06:37.201869+0000","last_unstale":"2023-10-16T20:06:37.877007+0000","last_undegraded":"2023-10-16T20:06:37.877007+0000","last_fullsized":"2023-10-16T20:06:37.877007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878662+0000","last_change":"2023-10-16T20:06:31.760996+0000","last_active":"2023-10-16T20:06:36.878662+0000","last_peered":"2023-10-16T20:06:36.878662+0000","last_clean":"2023-10-16T20:06:36.878662+0000","last_became_active":"2023-10-16T20:06:31.760730+0000","last_became_peered":"2023-10-16T20:06:31.760730+0000","last_unstale":"2023-10-16T20:06:36.878662+0000","last_undegraded":"2023-10-16T20:06:36.878662+0000","last_fullsized":"2023-10-16T20:06:36.878662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:41.705266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885662+0000","last_change":"2023-10-16T20:06:32.769034+0000","last_active":"2023-10-16T20:06:36.885662+0000","last_peered":"2023-10-16T20:06:36.885662+0000","last_clean":"2023-10-16T20:06:36.885662+0000","last_became_active":"2023-10-16T20:06:32.768739+0000","last_became_peered":"2023-10-16T20:06:32.768739+0000","last_unstale":"2023-10-16T20:06:36.885662+0000","last_undegraded":"2023-10-16T20:06:36.885662+0000","last_fullsized":"2023-10-16T20:06:36.885662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877177+0000","last_change":"2023-10-16T20:06:36.900254+0000","last_active":"2023-10-16T20:06:37.877177+0000","last_peered":"2023-10-16T20:06:37.877177+0000","last_clean":"2023-10-16T20:06:37.877177+0000","last_became_active":"2023-10-16T20:06:36.899452+0000","last_became_peered":"2023-10-16T20:06:36.899452+0000","last_unstale":"2023-10-16T20:06:37.877177+0000","last_undegraded":"2023-10-16T20:06:37.877177+0000","last_fullsized":"2023-10-16T20:06:37.877177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:44:40.784270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885577+0000","last_change":"2023-10-16T20:06:31.760615+0000","last_active":"2023-10-16T20:06:36.885577+0000","last_peered":"2023-10-16T20:06:36.885577+0000","last_clean":"2023-10-16T20:06:36.885577+0000","last_became_active":"2023-10-16T20:06:31.760334+0000","last_became_peered":"2023-10-16T20:06:31.760334+0000","last_unstale":"2023-10-16T20:06:36.885577+0000","last_undegraded":"2023-10-16T20:06:36.885577+0000","last_fullsized":"2023-10-16T20:06:36.885577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881436+0000","last_change":"2023-10-16T20:06:32.762754+0000","last_active":"2023-10-16T20:06:36.881436+0000","last_peered":"2023-10-16T20:06:36.881436+0000","last_clean":"2023-10-16T20:06:36.881436+0000","last_became_active":"2023-10-16T20:06:32.762465+0000","last_became_peered":"2023-10-16T20:06:32.762465+0000","last_unstale":"2023-10-16T20:06:36.881436+0000","last_undegraded":"2023-10-16T20:06:36.881436+0000","last_fullsized":"2023-10-16T20:06:36.881436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878471+0000","last_change":"2023-10-16T20:06:36.895621+0000","last_active":"2023-10-16T20:06:37.878471+0000","last_peered":"2023-10-16T20:06:37.878471+0000","last_clean":"2023-10-16T20:06:37.878471+0000","last_became_active":"2023-10-16T20:06:36.895207+0000","last_became_peered":"2023-10-16T20:06:36.895207+0000","last_unstale":"2023-10-16T20:06:37.878471+0000","last_undegraded":"2023-10-16T20:06:37.878471+0000","last_fullsized":"2023-10-16T20:06:37.878471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:45.017168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881577+0000","last_change":"2023-10-16T20:06:31.763487+0000","last_active":"2023-10-16T20:06:36.881577+0000","last_peered":"2023-10-16T20:06:36.881577+0000","last_clean":"2023-10-16T20:06:36.881577+0000","last_became_active":"2023-10-16T20:06:31.763173+0000","last_became_peered":"2023-10-16T20:06:31.763173+0000","last_unstale":"2023-10-16T20:06:36.881577+0000","last_undegraded":"2023-10-16T20:06:36.881577+0000","last_fullsized":"2023-10-16T20:06:36.881577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:59.860416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876870+0000","last_change":"2023-10-16T20:06:32.759043+0000","last_active":"2023-10-16T20:06:36.876870+0000","last_peered":"2023-10-16T20:06:36.876870+0000","last_clean":"2023-10-16T20:06:36.876870+0000","last_became_active":"2023-10-16T20:06:32.758748+0000","last_became_peered":"2023-10-16T20:06:32.758748+0000","last_unstale":"2023-10-16T20:06:36.876870+0000","last_undegraded":"2023-10-16T20:06:36.876870+0000","last_fullsized":"2023-10-16T20:06:36.876870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:35.526470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449676+0000","last_change":"2023-10-16T20:06:36.903555+0000","last_active":"2023-10-16T20:06:38.449676+0000","last_peered":"2023-10-16T20:06:38.449676+0000","last_clean":"2023-10-16T20:06:38.449676+0000","last_became_active":"2023-10-16T20:06:36.902883+0000","last_became_peered":"2023-10-16T20:06:36.902883+0000","last_unstale":"2023-10-16T20:06:38.449676+0000","last_undegraded":"2023-10-16T20:06:38.449676+0000","last_fullsized":"2023-10-16T20:06:38.449676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:43.155600+0000","last_change":"2023-10-16T20:06:31.754138+0000","last_active":"2023-10-16T20:06:43.155600+0000","last_peered":"2023-10-16T20:06:43.155600+0000","last_clean":"2023-10-16T20:06:43.155600+0000","last_became_active":"2023-10-16T20:06:31.753853+0000","last_became_peered":"2023-10-16T20:06:31.753853+0000","last_unstale":"2023-10-16T20:06:43.155600+0000","last_undegraded":"2023-10-16T20:06:43.155600+0000","last_fullsized":"2023-10-16T20:06:43.155600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:42.602521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195144+0000","last_change":"2023-10-16T20:06:32.767119+0000","last_active":"2023-10-16T20:06:37.195144+0000","last_peered":"2023-10-16T20:06:37.195144+0000","last_clean":"2023-10-16T20:06:37.195144+0000","last_became_active":"2023-10-16T20:06:32.766833+0000","last_became_peered":"2023-10-16T20:06:32.766833+0000","last_unstale":"2023-10-16T20:06:37.195144+0000","last_undegraded":"2023-10-16T20:06:37.195144+0000","last_fullsized":"2023-10-16T20:06:37.195144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356888+0000","last_change":"2023-10-16T20:06:37.202116+0000","last_active":"2023-10-16T20:06:38.356888+0000","last_peered":"2023-10-16T20:06:38.356888+0000","last_clean":"2023-10-16T20:06:38.356888+0000","last_became_active":"2023-10-16T20:06:37.201629+0000","last_became_peered":"2023-10-16T20:06:37.201629+0000","last_unstale":"2023-10-16T20:06:38.356888+0000","last_undegraded":"2023-10-16T20:06:38.356888+0000","last_fullsized":"2023-10-16T20:06:38.356888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:17.307460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881594+0000","last_change":"2023-10-16T20:06:31.758562+0000","last_active":"2023-10-16T20:06:36.881594+0000","last_peered":"2023-10-16T20:06:36.881594+0000","last_clean":"2023-10-16T20:06:36.881594+0000","last_became_active":"2023-10-16T20:06:31.758280+0000","last_became_peered":"2023-10-16T20:06:31.758280+0000","last_unstale":"2023-10-16T20:06:36.881594+0000","last_undegraded":"2023-10-16T20:06:36.881594+0000","last_fullsized":"2023-10-16T20:06:36.881594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882698+0000","last_change":"2023-10-16T20:06:32.761562+0000","last_active":"2023-10-16T20:06:36.882698+0000","last_peered":"2023-10-16T20:06:36.882698+0000","last_clean":"2023-10-16T20:06:36.882698+0000","last_became_active":"2023-10-16T20:06:32.761271+0000","last_became_peered":"2023-10-16T20:06:32.761271+0000","last_unstale":"2023-10-16T20:06:36.882698+0000","last_undegraded":"2023-10-16T20:06:36.882698+0000","last_fullsized":"2023-10-16T20:06:36.882698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:15.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877847+0000","last_change":"2023-10-16T20:06:37.196752+0000","last_active":"2023-10-16T20:06:37.877847+0000","last_peered":"2023-10-16T20:06:37.877847+0000","last_clean":"2023-10-16T20:06:37.877847+0000","last_became_active":"2023-10-16T20:06:37.196349+0000","last_became_peered":"2023-10-16T20:06:37.196349+0000","last_unstale":"2023-10-16T20:06:37.877847+0000","last_undegraded":"2023-10-16T20:06:37.877847+0000","last_fullsized":"2023-10-16T20:06:37.877847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:44.546135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885198+0000","last_change":"2023-10-16T20:06:31.760198+0000","last_active":"2023-10-16T20:06:36.885198+0000","last_peered":"2023-10-16T20:06:36.885198+0000","last_clean":"2023-10-16T20:06:36.885198+0000","last_became_active":"2023-10-16T20:06:31.759876+0000","last_became_peered":"2023-10-16T20:06:31.759876+0000","last_unstale":"2023-10-16T20:06:36.885198+0000","last_undegraded":"2023-10-16T20:06:36.885198+0000","last_fullsized":"2023-10-16T20:06:36.885198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194983+0000","last_change":"2023-10-16T20:06:32.766888+0000","last_active":"2023-10-16T20:06:37.194983+0000","last_peered":"2023-10-16T20:06:37.194983+0000","last_clean":"2023-10-16T20:06:37.194983+0000","last_became_active":"2023-10-16T20:06:32.766622+0000","last_became_peered":"2023-10-16T20:06:32.766622+0000","last_unstale":"2023-10-16T20:06:37.194983+0000","last_undegraded":"2023-10-16T20:06:37.194983+0000","last_fullsized":"2023-10-16T20:06:37.194983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878288+0000","last_change":"2023-10-16T20:06:37.203326+0000","last_active":"2023-10-16T20:06:37.878288+0000","last_peered":"2023-10-16T20:06:37.878288+0000","last_clean":"2023-10-16T20:06:37.878288+0000","last_became_active":"2023-10-16T20:06:37.202984+0000","last_became_peered":"2023-10-16T20:06:37.202984+0000","last_unstale":"2023-10-16T20:06:37.878288+0000","last_undegraded":"2023-10-16T20:06:37.878288+0000","last_fullsized":"2023-10-16T20:06:37.878288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:14.463170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876269+0000","last_change":"2023-10-16T20:06:31.753359+0000","last_active":"2023-10-16T20:06:36.876269+0000","last_peered":"2023-10-16T20:06:36.876269+0000","last_clean":"2023-10-16T20:06:36.876269+0000","last_became_active":"2023-10-16T20:06:31.753077+0000","last_became_peered":"2023-10-16T20:06:31.753077+0000","last_unstale":"2023-10-16T20:06:36.876269+0000","last_undegraded":"2023-10-16T20:06:36.876269+0000","last_fullsized":"2023-10-16T20:06:36.876269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:33:34.708942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876082+0000","last_change":"2023-10-16T20:06:32.751058+0000","last_active":"2023-10-16T20:06:36.876082+0000","last_peered":"2023-10-16T20:06:36.876082+0000","last_clean":"2023-10-16T20:06:36.876082+0000","last_became_active":"2023-10-16T20:06:32.750777+0000","last_became_peered":"2023-10-16T20:06:32.750777+0000","last_unstale":"2023-10-16T20:06:36.876082+0000","last_undegraded":"2023-10-16T20:06:36.876082+0000","last_fullsized":"2023-10-16T20:06:36.876082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:58.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450353+0000","last_change":"2023-10-16T20:06:36.902623+0000","last_active":"2023-10-16T20:06:38.450353+0000","last_peered":"2023-10-16T20:06:38.450353+0000","last_clean":"2023-10-16T20:06:38.450353+0000","last_became_active":"2023-10-16T20:06:36.902228+0000","last_became_peered":"2023-10-16T20:06:36.902228+0000","last_unstale":"2023-10-16T20:06:38.450353+0000","last_undegraded":"2023-10-16T20:06:38.450353+0000","last_fullsized":"2023-10-16T20:06:38.450353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876268+0000","last_change":"2023-10-16T20:06:31.755895+0000","last_active":"2023-10-16T20:06:36.876268+0000","last_peered":"2023-10-16T20:06:36.876268+0000","last_clean":"2023-10-16T20:06:36.876268+0000","last_became_active":"2023-10-16T20:06:31.753514+0000","last_became_peered":"2023-10-16T20:06:31.753514+0000","last_unstale":"2023-10-16T20:06:36.876268+0000","last_undegraded":"2023-10-16T20:06:36.876268+0000","last_fullsized":"2023-10-16T20:06:36.876268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:56.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194950+0000","last_change":"2023-10-16T20:06:32.761296+0000","last_active":"2023-10-16T20:06:37.194950+0000","last_peered":"2023-10-16T20:06:37.194950+0000","last_clean":"2023-10-16T20:06:37.194950+0000","last_became_active":"2023-10-16T20:06:32.759859+0000","last_became_peered":"2023-10-16T20:06:32.759859+0000","last_unstale":"2023-10-16T20:06:37.194950+0000","last_undegraded":"2023-10-16T20:06:37.194950+0000","last_fullsized":"2023-10-16T20:06:37.194950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:51:31.604677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877930+0000","last_change":"2023-10-16T20:06:36.895213+0000","last_active":"2023-10-16T20:06:37.877930+0000","last_peered":"2023-10-16T20:06:37.877930+0000","last_clean":"2023-10-16T20:06:37.877930+0000","last_became_active":"2023-10-16T20:06:36.894773+0000","last_became_peered":"2023-10-16T20:06:36.894773+0000","last_unstale":"2023-10-16T20:06:37.877930+0000","last_undegraded":"2023-10-16T20:06:37.877930+0000","last_fullsized":"2023-10-16T20:06:37.877930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:27.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876800+0000","last_change":"2023-10-16T20:06:31.757448+0000","last_active":"2023-10-16T20:06:36.876800+0000","last_peered":"2023-10-16T20:06:36.876800+0000","last_clean":"2023-10-16T20:06:36.876800+0000","last_became_active":"2023-10-16T20:06:31.757148+0000","last_became_peered":"2023-10-16T20:06:31.757148+0000","last_unstale":"2023-10-16T20:06:36.876800+0000","last_undegraded":"2023-10-16T20:06:36.876800+0000","last_fullsized":"2023-10-16T20:06:36.876800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:58.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195129+0000","last_change":"2023-10-16T20:06:32.760468+0000","last_active":"2023-10-16T20:06:37.195129+0000","last_peered":"2023-10-16T20:06:37.195129+0000","last_clean":"2023-10-16T20:06:37.195129+0000","last_became_active":"2023-10-16T20:06:32.760170+0000","last_became_peered":"2023-10-16T20:06:32.760170+0000","last_unstale":"2023-10-16T20:06:37.195129+0000","last_undegraded":"2023-10-16T20:06:37.195129+0000","last_fullsized":"2023-10-16T20:06:37.195129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:21:54.422703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449538+0000","last_change":"2023-10-16T20:06:36.903294+0000","last_active":"2023-10-16T20:06:38.449538+0000","last_peered":"2023-10-16T20:06:38.449538+0000","last_clean":"2023-10-16T20:06:38.449538+0000","last_became_active":"2023-10-16T20:06:36.902123+0000","last_became_peered":"2023-10-16T20:06:36.902123+0000","last_unstale":"2023-10-16T20:06:38.449538+0000","last_undegraded":"2023-10-16T20:06:38.449538+0000","last_fullsized":"2023-10-16T20:06:38.449538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885520+0000","last_change":"2023-10-16T20:06:31.754709+0000","last_active":"2023-10-16T20:06:36.885520+0000","last_peered":"2023-10-16T20:06:36.885520+0000","last_clean":"2023-10-16T20:06:36.885520+0000","last_became_active":"2023-10-16T20:06:31.754401+0000","last_became_peered":"2023-10-16T20:06:31.754401+0000","last_unstale":"2023-10-16T20:06:36.885520+0000","last_undegraded":"2023-10-16T20:06:36.885520+0000","last_fullsized":"2023-10-16T20:06:36.885520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.452414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885290+0000","last_change":"2023-10-16T20:06:32.761804+0000","last_active":"2023-10-16T20:06:36.885290+0000","last_peered":"2023-10-16T20:06:36.885290+0000","last_clean":"2023-10-16T20:06:36.885290+0000","last_became_active":"2023-10-16T20:06:32.760958+0000","last_became_peered":"2023-10-16T20:06:32.760958+0000","last_unstale":"2023-10-16T20:06:36.885290+0000","last_undegraded":"2023-10-16T20:06:36.885290+0000","last_fullsized":"2023-10-16T20:06:36.885290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449849+0000","last_change":"2023-10-16T20:06:36.903445+0000","last_active":"2023-10-16T20:06:38.449849+0000","last_peered":"2023-10-16T20:06:38.449849+0000","last_clean":"2023-10-16T20:06:38.449849+0000","last_became_active":"2023-10-16T20:06:36.903063+0000","last_became_peered":"2023-10-16T20:06:36.903063+0000","last_unstale":"2023-10-16T20:06:38.449849+0000","last_undegraded":"2023-10-16T20:06:38.449849+0000","last_fullsized":"2023-10-16T20:06:38.449849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884659+0000","last_change":"2023-10-16T20:06:31.763443+0000","last_active":"2023-10-16T20:06:36.884659+0000","last_peered":"2023-10-16T20:06:36.884659+0000","last_clean":"2023-10-16T20:06:36.884659+0000","last_became_active":"2023-10-16T20:06:31.763163+0000","last_became_peered":"2023-10-16T20:06:31.763163+0000","last_unstale":"2023-10-16T20:06:36.884659+0000","last_undegraded":"2023-10-16T20:06:36.884659+0000","last_fullsized":"2023-10-16T20:06:36.884659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:57.275970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878335+0000","last_change":"2023-10-16T20:06:32.752504+0000","last_active":"2023-10-16T20:06:36.878335+0000","last_peered":"2023-10-16T20:06:36.878335+0000","last_clean":"2023-10-16T20:06:36.878335+0000","last_became_active":"2023-10-16T20:06:32.752221+0000","last_became_peered":"2023-10-16T20:06:32.752221+0000","last_unstale":"2023-10-16T20:06:36.878335+0000","last_undegraded":"2023-10-16T20:06:36.878335+0000","last_fullsized":"2023-10-16T20:06:36.878335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:06.823167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450660+0000","last_change":"2023-10-16T20:06:36.904832+0000","last_active":"2023-10-16T20:06:38.450660+0000","last_peered":"2023-10-16T20:06:38.450660+0000","last_clean":"2023-10-16T20:06:38.450660+0000","last_became_active":"2023-10-16T20:06:36.902946+0000","last_became_peered":"2023-10-16T20:06:36.902946+0000","last_unstale":"2023-10-16T20:06:38.450660+0000","last_undegraded":"2023-10-16T20:06:38.450660+0000","last_fullsized":"2023-10-16T20:06:38.450660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886854+0000","last_change":"2023-10-16T20:06:32.754410+0000","last_active":"2023-10-16T20:06:36.886854+0000","last_peered":"2023-10-16T20:06:36.886854+0000","last_clean":"2023-10-16T20:06:36.886854+0000","last_became_active":"2023-10-16T20:06:32.752138+0000","last_became_peered":"2023-10-16T20:06:32.752138+0000","last_unstale":"2023-10-16T20:06:36.886854+0000","last_undegraded":"2023-10-16T20:06:36.886854+0000","last_fullsized":"2023-10-16T20:06:36.886854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876274+0000","last_change":"2023-10-16T20:06:31.754288+0000","last_active":"2023-10-16T20:06:36.876274+0000","last_peered":"2023-10-16T20:06:36.876274+0000","last_clean":"2023-10-16T20:06:36.876274+0000","last_became_active":"2023-10-16T20:06:31.753897+0000","last_became_peered":"2023-10-16T20:06:31.753897+0000","last_unstale":"2023-10-16T20:06:36.876274+0000","last_undegraded":"2023-10-16T20:06:36.876274+0000","last_fullsized":"2023-10-16T20:06:36.876274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:50.340924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877991+0000","last_change":"2023-10-16T20:06:37.196921+0000","last_active":"2023-10-16T20:06:37.877991+0000","last_peered":"2023-10-16T20:06:37.877991+0000","last_clean":"2023-10-16T20:06:37.877991+0000","last_became_active":"2023-10-16T20:06:37.196485+0000","last_became_peered":"2023-10-16T20:06:37.196485+0000","last_unstale":"2023-10-16T20:06:37.877991+0000","last_undegraded":"2023-10-16T20:06:37.877991+0000","last_fullsized":"2023-10-16T20:06:37.877991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893852+0000","last_change":"2023-10-16T20:06:32.763195+0000","last_active":"2023-10-16T20:06:36.893852+0000","last_peered":"2023-10-16T20:06:36.893852+0000","last_clean":"2023-10-16T20:06:36.893852+0000","last_became_active":"2023-10-16T20:06:32.762891+0000","last_became_peered":"2023-10-16T20:06:32.762891+0000","last_unstale":"2023-10-16T20:06:36.893852+0000","last_undegraded":"2023-10-16T20:06:36.893852+0000","last_fullsized":"2023-10-16T20:06:36.893852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885155+0000","last_change":"2023-10-16T20:06:31.759832+0000","last_active":"2023-10-16T20:06:36.885155+0000","last_peered":"2023-10-16T20:06:36.885155+0000","last_clean":"2023-10-16T20:06:36.885155+0000","last_became_active":"2023-10-16T20:06:31.759343+0000","last_became_peered":"2023-10-16T20:06:31.759343+0000","last_unstale":"2023-10-16T20:06:36.885155+0000","last_undegraded":"2023-10-16T20:06:36.885155+0000","last_fullsized":"2023-10-16T20:06:36.885155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:28.978568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194365+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:06:37.194365+0000","last_peered":"2023-10-16T20:06:37.194365+0000","last_clean":"2023-10-16T20:06:37.194365+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:06:37.194365+0000","last_undegraded":"2023-10-16T20:06:37.194365+0000","last_fullsized":"2023-10-16T20:06:37.194365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450435+0000","last_change":"2023-10-16T20:06:37.201901+0000","last_active":"2023-10-16T20:06:38.450435+0000","last_peered":"2023-10-16T20:06:38.450435+0000","last_clean":"2023-10-16T20:06:38.450435+0000","last_became_active":"2023-10-16T20:06:37.201501+0000","last_became_peered":"2023-10-16T20:06:37.201501+0000","last_unstale":"2023-10-16T20:06:38.450435+0000","last_undegraded":"2023-10-16T20:06:38.450435+0000","last_fullsized":"2023-10-16T20:06:38.450435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.880899+0000","last_change":"2023-10-16T20:06:32.757110+0000","last_active":"2023-10-16T20:06:36.880899+0000","last_peered":"2023-10-16T20:06:36.880899+0000","last_clean":"2023-10-16T20:06:36.880899+0000","last_became_active":"2023-10-16T20:06:32.756814+0000","last_became_peered":"2023-10-16T20:06:32.756814+0000","last_unstale":"2023-10-16T20:06:36.880899+0000","last_undegraded":"2023-10-16T20:06:36.880899+0000","last_fullsized":"2023-10-16T20:06:36.880899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.457314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194766+0000","last_change":"2023-10-16T20:06:31.757582+0000","last_active":"2023-10-16T20:06:37.194766+0000","last_peered":"2023-10-16T20:06:37.194766+0000","last_clean":"2023-10-16T20:06:37.194766+0000","last_became_active":"2023-10-16T20:06:31.757284+0000","last_became_peered":"2023-10-16T20:06:31.757284+0000","last_unstale":"2023-10-16T20:06:37.194766+0000","last_undegraded":"2023-10-16T20:06:37.194766+0000","last_fullsized":"2023-10-16T20:06:37.194766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:34.521571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449383+0000","last_change":"2023-10-16T20:06:37.196738+0000","last_active":"2023-10-16T20:06:38.449383+0000","last_peered":"2023-10-16T20:06:38.449383+0000","last_clean":"2023-10-16T20:06:38.449383+0000","last_became_active":"2023-10-16T20:06:37.196358+0000","last_became_peered":"2023-10-16T20:06:37.196358+0000","last_unstale":"2023-10-16T20:06:38.449383+0000","last_undegraded":"2023-10-16T20:06:38.449383+0000","last_fullsized":"2023-10-16T20:06:38.449383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195027+0000","last_change":"2023-10-16T20:06:31.763235+0000","last_active":"2023-10-16T20:06:37.195027+0000","last_peered":"2023-10-16T20:06:37.195027+0000","last_clean":"2023-10-16T20:06:37.195027+0000","last_became_active":"2023-10-16T20:06:31.762917+0000","last_became_peered":"2023-10-16T20:06:31.762917+0000","last_unstale":"2023-10-16T20:06:37.195027+0000","last_undegraded":"2023-10-16T20:06:37.195027+0000","last_fullsized":"2023-10-16T20:06:37.195027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885559+0000","last_change":"2023-10-16T20:06:32.753815+0000","last_active":"2023-10-16T20:06:36.885559+0000","last_peered":"2023-10-16T20:06:36.885559+0000","last_clean":"2023-10-16T20:06:36.885559+0000","last_became_active":"2023-10-16T20:06:32.753504+0000","last_became_peered":"2023-10-16T20:06:32.753504+0000","last_unstale":"2023-10-16T20:06:36.885559+0000","last_undegraded":"2023-10-16T20:06:36.885559+0000","last_fullsized":"2023-10-16T20:06:36.885559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.876963+0000","last_change":"2023-10-16T20:06:37.202096+0000","last_active":"2023-10-16T20:06:37.876963+0000","last_peered":"2023-10-16T20:06:37.876963+0000","last_clean":"2023-10-16T20:06:37.876963+0000","last_became_active":"2023-10-16T20:06:37.201491+0000","last_became_peered":"2023-10-16T20:06:37.201491+0000","last_unstale":"2023-10-16T20:06:37.876963+0000","last_undegraded":"2023-10-16T20:06:37.876963+0000","last_fullsized":"2023-10-16T20:06:37.876963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886132+0000","last_change":"2023-10-16T20:06:31.757976+0000","last_active":"2023-10-16T20:06:36.886132+0000","last_peered":"2023-10-16T20:06:36.886132+0000","last_clean":"2023-10-16T20:06:36.886132+0000","last_became_active":"2023-10-16T20:06:31.757076+0000","last_became_peered":"2023-10-16T20:06:31.757076+0000","last_unstale":"2023-10-16T20:06:36.886132+0000","last_undegraded":"2023-10-16T20:06:36.886132+0000","last_fullsized":"2023-10-16T20:06:36.886132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:14.095040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893777+0000","last_change":"2023-10-16T20:06:32.762472+0000","last_active":"2023-10-16T20:06:36.893777+0000","last_peered":"2023-10-16T20:06:36.893777+0000","last_clean":"2023-10-16T20:06:36.893777+0000","last_became_active":"2023-10-16T20:06:32.762178+0000","last_became_peered":"2023-10-16T20:06:32.762178+0000","last_unstale":"2023-10-16T20:06:36.893777+0000","last_undegraded":"2023-10-16T20:06:36.893777+0000","last_fullsized":"2023-10-16T20:06:36.893777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878094+0000","last_change":"2023-10-16T20:06:37.197304+0000","last_active":"2023-10-16T20:06:37.878094+0000","last_peered":"2023-10-16T20:06:37.878094+0000","last_clean":"2023-10-16T20:06:37.878094+0000","last_became_active":"2023-10-16T20:06:37.196929+0000","last_became_peered":"2023-10-16T20:06:37.196929+0000","last_unstale":"2023-10-16T20:06:37.878094+0000","last_undegraded":"2023-10-16T20:06:37.878094+0000","last_fullsized":"2023-10-16T20:06:37.878094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:50.138290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878557+0000","last_change":"2023-10-16T20:06:31.757280+0000","last_active":"2023-10-16T20:06:36.878557+0000","last_peered":"2023-10-16T20:06:36.878557+0000","last_clean":"2023-10-16T20:06:36.878557+0000","last_became_active":"2023-10-16T20:06:31.756978+0000","last_became_peered":"2023-10-16T20:06:31.756978+0000","last_unstale":"2023-10-16T20:06:36.878557+0000","last_undegraded":"2023-10-16T20:06:36.878557+0000","last_fullsized":"2023-10-16T20:06:36.878557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:45.721286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886554+0000","last_change":"2023-10-16T20:06:32.758662+0000","last_active":"2023-10-16T20:06:36.886554+0000","last_peered":"2023-10-16T20:06:36.886554+0000","last_clean":"2023-10-16T20:06:36.886554+0000","last_became_active":"2023-10-16T20:06:32.758318+0000","last_became_peered":"2023-10-16T20:06:32.758318+0000","last_unstale":"2023-10-16T20:06:36.886554+0000","last_undegraded":"2023-10-16T20:06:36.886554+0000","last_fullsized":"2023-10-16T20:06:36.886554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878944+0000","last_change":"2023-10-16T20:06:36.898893+0000","last_active":"2023-10-16T20:06:37.878944+0000","last_peered":"2023-10-16T20:06:37.878944+0000","last_clean":"2023-10-16T20:06:37.878944+0000","last_became_active":"2023-10-16T20:06:36.898502+0000","last_became_peered":"2023-10-16T20:06:36.898502+0000","last_unstale":"2023-10-16T20:06:37.878944+0000","last_undegraded":"2023-10-16T20:06:37.878944+0000","last_fullsized":"2023-10-16T20:06:37.878944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194284+0000","last_change":"2023-10-16T20:06:31.763222+0000","last_active":"2023-10-16T20:06:37.194284+0000","last_peered":"2023-10-16T20:06:37.194284+0000","last_clean":"2023-10-16T20:06:37.194284+0000","last_became_active":"2023-10-16T20:06:31.762927+0000","last_became_peered":"2023-10-16T20:06:31.762927+0000","last_unstale":"2023-10-16T20:06:37.194284+0000","last_undegraded":"2023-10-16T20:06:37.194284+0000","last_fullsized":"2023-10-16T20:06:37.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:05.818268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877358+0000","last_change":"2023-10-16T20:06:32.751479+0000","last_active":"2023-10-16T20:06:36.877358+0000","last_peered":"2023-10-16T20:06:36.877358+0000","last_clean":"2023-10-16T20:06:36.877358+0000","last_became_active":"2023-10-16T20:06:32.751190+0000","last_became_peered":"2023-10-16T20:06:32.751190+0000","last_unstale":"2023-10-16T20:06:36.877358+0000","last_undegraded":"2023-10-16T20:06:36.877358+0000","last_fullsized":"2023-10-16T20:06:36.877358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:48:45.349066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450801+0000","last_change":"2023-10-16T20:06:37.197326+0000","last_active":"2023-10-16T20:06:38.450801+0000","last_peered":"2023-10-16T20:06:38.450801+0000","last_clean":"2023-10-16T20:06:38.450801+0000","last_became_active":"2023-10-16T20:06:37.196386+0000","last_became_peered":"2023-10-16T20:06:37.196386+0000","last_unstale":"2023-10-16T20:06:38.450801+0000","last_undegraded":"2023-10-16T20:06:38.450801+0000","last_fullsized":"2023-10-16T20:06:38.450801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882771+0000","last_change":"2023-10-16T20:06:31.758660+0000","last_active":"2023-10-16T20:06:36.882771+0000","last_peered":"2023-10-16T20:06:36.882771+0000","last_clean":"2023-10-16T20:06:36.882771+0000","last_became_active":"2023-10-16T20:06:31.758394+0000","last_became_peered":"2023-10-16T20:06:31.758394+0000","last_unstale":"2023-10-16T20:06:36.882771+0000","last_undegraded":"2023-10-16T20:06:36.882771+0000","last_fullsized":"2023-10-16T20:06:36.882771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:09.405305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894178+0000","last_change":"2023-10-16T20:06:32.755401+0000","last_active":"2023-10-16T20:06:36.894178+0000","last_peered":"2023-10-16T20:06:36.894178+0000","last_clean":"2023-10-16T20:06:36.894178+0000","last_became_active":"2023-10-16T20:06:32.755107+0000","last_became_peered":"2023-10-16T20:06:32.755107+0000","last_unstale":"2023-10-16T20:06:36.894178+0000","last_undegraded":"2023-10-16T20:06:36.894178+0000","last_fullsized":"2023-10-16T20:06:36.894178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878938+0000","last_change":"2023-10-16T20:06:36.896689+0000","last_active":"2023-10-16T20:06:37.878938+0000","last_peered":"2023-10-16T20:06:37.878938+0000","last_clean":"2023-10-16T20:06:37.878938+0000","last_became_active":"2023-10-16T20:06:36.896287+0000","last_became_peered":"2023-10-16T20:06:36.896287+0000","last_unstale":"2023-10-16T20:06:37.878938+0000","last_undegraded":"2023-10-16T20:06:37.878938+0000","last_fullsized":"2023-10-16T20:06:37.878938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:13.728727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.888301+0000","last_change":"2023-10-16T20:06:31.757230+0000","last_active":"2023-10-16T20:06:36.888301+0000","last_peered":"2023-10-16T20:06:36.888301+0000","last_clean":"2023-10-16T20:06:36.888301+0000","last_became_active":"2023-10-16T20:06:31.756944+0000","last_became_peered":"2023-10-16T20:06:31.756944+0000","last_unstale":"2023-10-16T20:06:36.888301+0000","last_undegraded":"2023-10-16T20:06:36.888301+0000","last_fullsized":"2023-10-16T20:06:36.888301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:18.395813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893812+0000","last_change":"2023-10-16T20:06:32.764333+0000","last_active":"2023-10-16T20:06:36.893812+0000","last_peered":"2023-10-16T20:06:36.893812+0000","last_clean":"2023-10-16T20:06:36.893812+0000","last_became_active":"2023-10-16T20:06:32.764136+0000","last_became_peered":"2023-10-16T20:06:32.764136+0000","last_unstale":"2023-10-16T20:06:36.893812+0000","last_undegraded":"2023-10-16T20:06:36.893812+0000","last_fullsized":"2023-10-16T20:06:36.893812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.879154+0000","last_change":"2023-10-16T20:06:36.895534+0000","last_active":"2023-10-16T20:06:37.879154+0000","last_peered":"2023-10-16T20:06:37.879154+0000","last_clean":"2023-10-16T20:06:37.879154+0000","last_became_active":"2023-10-16T20:06:36.895164+0000","last_became_peered":"2023-10-16T20:06:36.895164+0000","last_unstale":"2023-10-16T20:06:37.879154+0000","last_undegraded":"2023-10-16T20:06:37.879154+0000","last_fullsized":"2023-10-16T20:06:37.879154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194973+0000","last_change":"2023-10-16T20:06:31.760505+0000","last_active":"2023-10-16T20:06:37.194973+0000","last_peered":"2023-10-16T20:06:37.194973+0000","last_clean":"2023-10-16T20:06:37.194973+0000","last_became_active":"2023-10-16T20:06:31.760190+0000","last_became_peered":"2023-10-16T20:06:31.760190+0000","last_unstale":"2023-10-16T20:06:37.194973+0000","last_undegraded":"2023-10-16T20:06:37.194973+0000","last_fullsized":"2023-10-16T20:06:37.194973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876944+0000","last_change":"2023-10-16T20:06:32.757975+0000","last_active":"2023-10-16T20:06:36.876944+0000","last_peered":"2023-10-16T20:06:36.876944+0000","last_clean":"2023-10-16T20:06:36.876944+0000","last_became_active":"2023-10-16T20:06:32.757179+0000","last_became_peered":"2023-10-16T20:06:32.757179+0000","last_unstale":"2023-10-16T20:06:36.876944+0000","last_undegraded":"2023-10-16T20:06:36.876944+0000","last_fullsized":"2023-10-16T20:06:36.876944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:29.983467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878473+0000","last_change":"2023-10-16T20:06:37.197542+0000","last_active":"2023-10-16T20:06:37.878473+0000","last_peered":"2023-10-16T20:06:37.878473+0000","last_clean":"2023-10-16T20:06:37.878473+0000","last_became_active":"2023-10-16T20:06:37.196312+0000","last_became_peered":"2023-10-16T20:06:37.196312+0000","last_unstale":"2023-10-16T20:06:37.878473+0000","last_undegraded":"2023-10-16T20:06:37.878473+0000","last_fullsized":"2023-10-16T20:06:37.878473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:40.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876859+0000","last_change":"2023-10-16T20:06:31.763508+0000","last_active":"2023-10-16T20:06:36.876859+0000","last_peered":"2023-10-16T20:06:36.876859+0000","last_clean":"2023-10-16T20:06:36.876859+0000","last_became_active":"2023-10-16T20:06:31.763228+0000","last_became_peered":"2023-10-16T20:06:31.763228+0000","last_unstale":"2023-10-16T20:06:36.876859+0000","last_undegraded":"2023-10-16T20:06:36.876859+0000","last_fullsized":"2023-10-16T20:06:36.876859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:33.157086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195141+0000","last_change":"2023-10-16T20:06:32.767619+0000","last_active":"2023-10-16T20:06:37.195141+0000","last_peered":"2023-10-16T20:06:37.195141+0000","last_clean":"2023-10-16T20:06:37.195141+0000","last_became_active":"2023-10-16T20:06:32.767368+0000","last_became_peered":"2023-10-16T20:06:32.767368+0000","last_unstale":"2023-10-16T20:06:37.195141+0000","last_undegraded":"2023-10-16T20:06:37.195141+0000","last_fullsized":"2023-10-16T20:06:37.195141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449240+0000","last_change":"2023-10-16T20:06:36.896747+0000","last_active":"2023-10-16T20:06:38.449240+0000","last_peered":"2023-10-16T20:06:38.449240+0000","last_clean":"2023-10-16T20:06:38.449240+0000","last_became_active":"2023-10-16T20:06:36.896380+0000","last_became_peered":"2023-10-16T20:06:36.896380+0000","last_unstale":"2023-10-16T20:06:38.449240+0000","last_undegraded":"2023-10-16T20:06:38.449240+0000","last_fullsized":"2023-10-16T20:06:38.449240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:53:20.477418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881480+0000","last_change":"2023-10-16T20:06:31.757781+0000","last_active":"2023-10-16T20:06:36.881480+0000","last_peered":"2023-10-16T20:06:36.881480+0000","last_clean":"2023-10-16T20:06:36.881480+0000","last_became_active":"2023-10-16T20:06:31.757507+0000","last_became_peered":"2023-10-16T20:06:31.757507+0000","last_unstale":"2023-10-16T20:06:36.881480+0000","last_undegraded":"2023-10-16T20:06:36.881480+0000","last_fullsized":"2023-10-16T20:06:36.881480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.762052+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761502+0000","last_became_peered":"2023-10-16T20:06:32.761502+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356361+0000","last_change":"2023-10-16T20:06:37.196931+0000","last_active":"2023-10-16T20:06:38.356361+0000","last_peered":"2023-10-16T20:06:38.356361+0000","last_clean":"2023-10-16T20:06:38.356361+0000","last_became_active":"2023-10-16T20:06:37.196429+0000","last_became_peered":"2023-10-16T20:06:37.196429+0000","last_unstale":"2023-10-16T20:06:38.356361+0000","last_undegraded":"2023-10-16T20:06:38.356361+0000","last_fullsized":"2023-10-16T20:06:38.356361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:39:01.567948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876429+0000","last_change":"2023-10-16T20:06:31.754869+0000","last_active":"2023-10-16T20:06:36.876429+0000","last_peered":"2023-10-16T20:06:36.876429+0000","last_clean":"2023-10-16T20:06:36.876429+0000","last_became_active":"2023-10-16T20:06:31.754563+0000","last_became_peered":"2023-10-16T20:06:31.754563+0000","last_unstale":"2023-10-16T20:06:36.876429+0000","last_undegraded":"2023-10-16T20:06:36.876429+0000","last_fullsized":"2023-10-16T20:06:36.876429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:05.294644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195284+0000","last_change":"2023-10-16T20:06:32.761436+0000","last_active":"2023-10-16T20:06:37.195284+0000","last_peered":"2023-10-16T20:06:37.195284+0000","last_clean":"2023-10-16T20:06:37.195284+0000","last_became_active":"2023-10-16T20:06:32.761077+0000","last_became_peered":"2023-10-16T20:06:32.761077+0000","last_unstale":"2023-10-16T20:06:37.195284+0000","last_undegraded":"2023-10-16T20:06:37.195284+0000","last_fullsized":"2023-10-16T20:06:37.195284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876172+0000","last_change":"2023-10-16T20:06:32.752025+0000","last_active":"2023-10-16T20:06:36.876172+0000","last_peered":"2023-10-16T20:06:36.876172+0000","last_clean":"2023-10-16T20:06:36.876172+0000","last_became_active":"2023-10-16T20:06:32.751719+0000","last_became_peered":"2023-10-16T20:06:32.751719+0000","last_unstale":"2023-10-16T20:06:36.876172+0000","last_undegraded":"2023-10-16T20:06:36.876172+0000","last_fullsized":"2023-10-16T20:06:36.876172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:37.646684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876358+0000","last_change":"2023-10-16T20:06:32.761262+0000","last_active":"2023-10-16T20:06:36.876358+0000","last_peered":"2023-10-16T20:06:36.876358+0000","last_clean":"2023-10-16T20:06:36.876358+0000","last_became_active":"2023-10-16T20:06:32.760953+0000","last_became_peered":"2023-10-16T20:06:32.760953+0000","last_unstale":"2023-10-16T20:06:36.876358+0000","last_undegraded":"2023-10-16T20:06:36.876358+0000","last_fullsized":"2023-10-16T20:06:36.876358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:06.488740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884781+0000","last_change":"2023-10-16T20:06:32.761797+0000","last_active":"2023-10-16T20:06:36.884781+0000","last_peered":"2023-10-16T20:06:36.884781+0000","last_clean":"2023-10-16T20:06:36.884781+0000","last_became_active":"2023-10-16T20:06:32.761070+0000","last_became_peered":"2023-10-16T20:06:32.761070+0000","last_unstale":"2023-10-16T20:06:36.884781+0000","last_undegraded":"2023-10-16T20:06:36.884781+0000","last_fullsized":"2023-10-16T20:06:36.884781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881499+0000","last_change":"2023-10-16T20:06:32.757941+0000","last_active":"2023-10-16T20:06:36.881499+0000","last_peered":"2023-10-16T20:06:36.881499+0000","last_clean":"2023-10-16T20:06:36.881499+0000","last_became_active":"2023-10-16T20:06:32.757491+0000","last_became_peered":"2023-10-16T20:06:32.757491+0000","last_unstale":"2023-10-16T20:06:36.881499+0000","last_undegraded":"2023-10-16T20:06:36.881499+0000","last_fullsized":"2023-10-16T20:06:36.881499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893744+0000","last_change":"2023-10-16T20:06:32.757680+0000","last_active":"2023-10-16T20:06:36.893744+0000","last_peered":"2023-10-16T20:06:36.893744+0000","last_clean":"2023-10-16T20:06:36.893744+0000","last_became_active":"2023-10-16T20:06:32.756906+0000","last_became_peered":"2023-10-16T20:06:32.756906+0000","last_unstale":"2023-10-16T20:06:36.893744+0000","last_undegraded":"2023-10-16T20:06:36.893744+0000","last_fullsized":"2023-10-16T20:06:36.893744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881387+0000","last_change":"2023-10-16T20:06:32.756667+0000","last_active":"2023-10-16T20:06:36.881387+0000","last_peered":"2023-10-16T20:06:36.881387+0000","last_clean":"2023-10-16T20:06:36.881387+0000","last_became_active":"2023-10-16T20:06:32.756338+0000","last_became_peered":"2023-10-16T20:06:32.756338+0000","last_unstale":"2023-10-16T20:06:36.881387+0000","last_undegraded":"2023-10-16T20:06:36.881387+0000","last_fullsized":"2023-10-16T20:06:36.881387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878209+0000","last_change":"2023-10-16T20:06:32.761903+0000","last_active":"2023-10-16T20:06:36.878209+0000","last_peered":"2023-10-16T20:06:36.878209+0000","last_clean":"2023-10-16T20:06:36.878209+0000","last_became_active":"2023-10-16T20:06:32.761404+0000","last_became_peered":"2023-10-16T20:06:32.761404+0000","last_unstale":"2023-10-16T20:06:36.878209+0000","last_undegraded":"2023-10-16T20:06:36.878209+0000","last_fullsized":"2023-10-16T20:06:36.878209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893877+0000","last_change":"2023-10-16T20:06:32.759025+0000","last_active":"2023-10-16T20:06:36.893877+0000","last_peered":"2023-10-16T20:06:36.893877+0000","last_clean":"2023-10-16T20:06:36.893877+0000","last_became_active":"2023-10-16T20:06:32.757378+0000","last_became_peered":"2023-10-16T20:06:32.757378+0000","last_unstale":"2023-10-16T20:06:36.893877+0000","last_undegraded":"2023-10-16T20:06:36.893877+0000","last_fullsized":"2023-10-16T20:06:36.893877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884696+0000","last_change":"2023-10-16T20:06:32.765641+0000","last_active":"2023-10-16T20:06:36.884696+0000","last_peered":"2023-10-16T20:06:36.884696+0000","last_clean":"2023-10-16T20:06:36.884696+0000","last_became_active":"2023-10-16T20:06:32.765108+0000","last_became_peered":"2023-10-16T20:06:32.765108+0000","last_unstale":"2023-10-16T20:06:36.884696+0000","last_undegraded":"2023-10-16T20:06:36.884696+0000","last_fullsized":"2023-10-16T20:06:36.884696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:46.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893441+0000","last_change":"2023-10-16T20:06:32.760384+0000","last_active":"2023-10-16T20:06:36.893441+0000","last_peered":"2023-10-16T20:06:36.893441+0000","last_clean":"2023-10-16T20:06:36.893441+0000","last_became_active":"2023-10-16T20:06:32.760069+0000","last_became_peered":"2023-10-16T20:06:32.760069+0000","last_unstale":"2023-10-16T20:06:36.893441+0000","last_undegraded":"2023-10-16T20:06:36.893441+0000","last_fullsized":"2023-10-16T20:06:36.893441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884891+0000","last_change":"2023-10-16T20:06:32.769882+0000","last_active":"2023-10-16T20:06:36.884891+0000","last_peered":"2023-10-16T20:06:36.884891+0000","last_clean":"2023-10-16T20:06:36.884891+0000","last_became_active":"2023-10-16T20:06:32.769593+0000","last_became_peered":"2023-10-16T20:06:32.769593+0000","last_unstale":"2023-10-16T20:06:36.884891+0000","last_undegraded":"2023-10-16T20:06:36.884891+0000","last_fullsized":"2023-10-16T20:06:36.884891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881557+0000","last_change":"2023-10-16T20:06:32.762249+0000","last_active":"2023-10-16T20:06:36.881557+0000","last_peered":"2023-10-16T20:06:36.881557+0000","last_clean":"2023-10-16T20:06:36.881557+0000","last_became_active":"2023-10-16T20:06:32.761895+0000","last_became_peered":"2023-10-16T20:06:32.761895+0000","last_unstale":"2023-10-16T20:06:36.881557+0000","last_undegraded":"2023-10-16T20:06:36.881557+0000","last_fullsized":"2023-10-16T20:06:36.881557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877279+0000","last_change":"2023-10-16T20:06:32.755725+0000","last_active":"2023-10-16T20:06:36.877279+0000","last_peered":"2023-10-16T20:06:36.877279+0000","last_clean":"2023-10-16T20:06:36.877279+0000","last_became_active":"2023-10-16T20:06:32.755462+0000","last_became_peered":"2023-10-16T20:06:32.755462+0000","last_unstale":"2023-10-16T20:06:36.877279+0000","last_undegraded":"2023-10-16T20:06:36.877279+0000","last_fullsized":"2023-10-16T20:06:36.877279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:22.618540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":697134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":106274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:06:55.752 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:06:55.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.904+0000 7fc9f449c700 1 Processor -- start 2023-10-16T20:06:55.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.904+0000 7fc9f449c700 1 -- start start 2023-10-16T20:06:55.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f449c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc9ec0cf7d0 0x7fc9ec15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f449c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec0cfeb0 con 0x7fc9ec06a820 2023-10-16T20:06:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f449c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec0cfc30 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f449c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0ce410 con 0x7fc9ec0cf7d0 2023-10-16T20:06:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f1a37700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc9ec0cf7d0 0x7fc9ec15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f2238700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc9ec06a820 0x7fc9ec06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39344/0 (socket says 172.21.15.152:39344) 2023-10-16T20:06:55.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.905+0000 7fc9f2238700 1 -- 172.21.15.152:0/166029789 learned_addr learned my addr 172.21.15.152:0/166029789 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:55.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1a37700 1 -- 172.21.15.152:0/166029789 >> v1:172.21.15.163:6789/0 conn(0x7fc9ec0ca7d0 legacy=0x7fc9ec071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:55.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1a37700 1 -- 172.21.15.152:0/166029789 >> v1:172.21.15.152:6789/0 conn(0x7fc9ec06a820 legacy=0x7fc9ec06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1a37700 1 -- 172.21.15.152:0/166029789 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0af9d0 con 0x7fc9ec0cf7d0 2023-10-16T20:06:55.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1236700 1 -- 172.21.15.152:0/166029789 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035699812 0 0) 0x7fc9ec0cfeb0 con 0x7fc9ec06a820 2023-10-16T20:06:55.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1a37700 1 --2- 172.21.15.152:0/166029789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec15e7f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009840 tx=0x7fc9e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc408d3f32f3c545 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:55.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1236700 1 -- 172.21.15.152:0/166029789 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004230 con 0x7fc9ec0cf7d0 2023-10-16T20:06:55.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1236700 1 -- 172.21.15.152:0/166029789 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8004390 con 0x7fc9ec0cf7d0 2023-10-16T20:06:55.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.906+0000 7fc9f1236700 1 -- 172.21.15.152:0/166029789 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80036a0 con 0x7fc9ec0cf7d0 2023-10-16T20:06:55.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 -- 172.21.15.152:0/166029789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0cf7d0 msgr2=0x7fc9ec15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 --2- 172.21.15.152:0/166029789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec15e7f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009840 tx=0x7fc9e8009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:55.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 -- 172.21.15.152:0/166029789 shutdown_connections 2023-10-16T20:06:55.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 --2- 172.21.15.152:0/166029789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec15e7f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 -- 172.21.15.152:0/166029789 >> 172.21.15.152:0/166029789 conn(0x7fc9ec0d0180 msgr2=0x7fc9ec0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:55.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 -- 172.21.15.152:0/166029789 shutdown_connections 2023-10-16T20:06:55.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.907+0000 7fc9f449c700 1 -- 172.21.15.152:0/166029789 wait complete. 2023-10-16T20:06:55.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.908+0000 7fc9f449c700 1 Processor -- start 2023-10-16T20:06:55.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.908+0000 7fc9f449c700 1 -- start start 2023-10-16T20:06:55.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ec06a820 0x7fc9ec0c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 0x7fc9ec0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec159850 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c9470 con 0x7fc9ec0cf7d0 2023-10-16T20:06:55.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c8860 con 0x7fc9ec06a820 2023-10-16T20:06:55.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 0x7fc9ec0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 0x7fc9ec0ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59154/0 (socket says 172.21.15.152:59154) 2023-10-16T20:06:55.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 -- 172.21.15.152:0/2335777766 learned_addr learned my addr 172.21.15.152:0/2335777766 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:55.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f2238700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ec06a820 0x7fc9ec0c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f2a39700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 -- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ec06a820 msgr2=0x7fc9ec0c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ec06a820 0x7fc9ec0c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 -- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ec0cf7d0 msgr2=0x7fc9ec0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:55.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:55.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 -- 172.21.15.152:0/2335777766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80094a0 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f1a37700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 0x7fc9ec0ae0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80090b0 tx=0x7fc9e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:55.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8011630 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8011790 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0c8b40 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8011b40 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.909+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec0c9100 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.910+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec0af6d0 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.911+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc9e8011ca0 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.911+0000 7fc9e2ffd700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc9d006af00 0x7fc9d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:55.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.911+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9e808b260 con 0x7fc9ec0ca7d0 2023-10-16T20:06:55.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.911+0000 7fc9f2238700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc9d006af00 0x7fc9d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:55.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.911+0000 7fc9f2238700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc9d006af00 0x7fc9d006d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000f60 tx=0x7fc9dc007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:55.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:55.915+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9ec0af6d0 con 0x7fc9ec0ca7d0 2023-10-16T20:06:56.101 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.099+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9ec0af410 con 0x7fc9d006af00 2023-10-16T20:06:56.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.108+0000 7fc9e2ffd700 1 -- 172.21.15.152:0/2335777766 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345232 (secure 0 0 0) 0x7fc9dc0012b0 con 0x7fc9d006af00 2023-10-16T20:06:56.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:56.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc9d006af00 msgr2=0x7fc9d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc9d006af00 0x7fc9d006d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000f60 tx=0x7fc9dc007be0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 msgr2=0x7fc9ec0ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 0x7fc9ec0ae0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80090b0 tx=0x7fc9e80047c0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 shutdown_connections 2023-10-16T20:06:56.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc9d006af00 0x7fc9d006d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc9ec06a820 0x7fc9ec0c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ec0cf7d0 0x7fc9ec0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 --2- 172.21.15.152:0/2335777766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9ec0ca7d0 0x7fc9ec0ae0b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 >> 172.21.15.152:0/2335777766 conn(0x7fc9ec0d0180 msgr2=0x7fc9ec159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:56.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 shutdown_connections 2023-10-16T20:06:56.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.112+0000 7fc9f449c700 1 -- 172.21.15.152:0/2335777766 wait complete. 2023-10-16T20:06:56.119 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:06:56.126 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-16T20:06:54.772027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3416064,"data_stored":2039488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008483"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195372+0000","last_change":"2023-10-16T20:06:32.768697+0000","last_active":"2023-10-16T20:06:37.195372+0000","last_peered":"2023-10-16T20:06:37.195372+0000","last_clean":"2023-10-16T20:06:37.195372+0000","last_became_active":"2023-10-16T20:06:32.768425+0000","last_became_peered":"2023-10-16T20:06:32.768425+0000","last_unstale":"2023-10-16T20:06:37.195372+0000","last_undegraded":"2023-10-16T20:06:37.195372+0000","last_fullsized":"2023-10-16T20:06:37.195372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886277+0000","last_change":"2023-10-16T20:06:32.752823+0000","last_active":"2023-10-16T20:06:36.886277+0000","last_peered":"2023-10-16T20:06:36.886277+0000","last_clean":"2023-10-16T20:06:36.886277+0000","last_became_active":"2023-10-16T20:06:32.752488+0000","last_became_peered":"2023-10-16T20:06:32.752488+0000","last_unstale":"2023-10-16T20:06:36.886277+0000","last_undegraded":"2023-10-16T20:06:36.886277+0000","last_fullsized":"2023-10-16T20:06:36.886277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885188+0000","last_change":"2023-10-16T20:06:32.755212+0000","last_active":"2023-10-16T20:06:36.885188+0000","last_peered":"2023-10-16T20:06:36.885188+0000","last_clean":"2023-10-16T20:06:36.885188+0000","last_became_active":"2023-10-16T20:06:32.754919+0000","last_became_peered":"2023-10-16T20:06:32.754919+0000","last_unstale":"2023-10-16T20:06:36.885188+0000","last_undegraded":"2023-10-16T20:06:36.885188+0000","last_fullsized":"2023-10-16T20:06:36.885188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.761928+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761127+0000","last_became_peered":"2023-10-16T20:06:32.761127+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:10.532882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194887+0000","last_change":"2023-10-16T20:06:32.767050+0000","last_active":"2023-10-16T20:06:37.194887+0000","last_peered":"2023-10-16T20:06:37.194887+0000","last_clean":"2023-10-16T20:06:37.194887+0000","last_became_active":"2023-10-16T20:06:32.766739+0000","last_became_peered":"2023-10-16T20:06:32.766739+0000","last_unstale":"2023-10-16T20:06:37.194887+0000","last_undegraded":"2023-10-16T20:06:37.194887+0000","last_fullsized":"2023-10-16T20:06:37.194887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884978+0000","last_change":"2023-10-16T20:06:32.761991+0000","last_active":"2023-10-16T20:06:36.884978+0000","last_peered":"2023-10-16T20:06:36.884978+0000","last_clean":"2023-10-16T20:06:36.884978+0000","last_became_active":"2023-10-16T20:06:32.761421+0000","last_became_peered":"2023-10-16T20:06:32.761421+0000","last_unstale":"2023-10-16T20:06:36.884978+0000","last_undegraded":"2023-10-16T20:06:36.884978+0000","last_fullsized":"2023-10-16T20:06:36.884978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194866+0000","last_change":"2023-10-16T20:06:32.767492+0000","last_active":"2023-10-16T20:06:37.194866+0000","last_peered":"2023-10-16T20:06:37.194866+0000","last_clean":"2023-10-16T20:06:37.194866+0000","last_became_active":"2023-10-16T20:06:32.767148+0000","last_became_peered":"2023-10-16T20:06:32.767148+0000","last_unstale":"2023-10-16T20:06:37.194866+0000","last_undegraded":"2023-10-16T20:06:37.194866+0000","last_fullsized":"2023-10-16T20:06:37.194866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894286+0000","last_change":"2023-10-16T20:06:32.761690+0000","last_active":"2023-10-16T20:06:36.894286+0000","last_peered":"2023-10-16T20:06:36.894286+0000","last_clean":"2023-10-16T20:06:36.894286+0000","last_became_active":"2023-10-16T20:06:32.761353+0000","last_became_peered":"2023-10-16T20:06:32.761353+0000","last_unstale":"2023-10-16T20:06:36.894286+0000","last_undegraded":"2023-10-16T20:06:36.894286+0000","last_fullsized":"2023-10-16T20:06:36.894286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195306+0000","last_change":"2023-10-16T20:06:32.768700+0000","last_active":"2023-10-16T20:06:37.195306+0000","last_peered":"2023-10-16T20:06:37.195306+0000","last_clean":"2023-10-16T20:06:37.195306+0000","last_became_active":"2023-10-16T20:06:32.768467+0000","last_became_peered":"2023-10-16T20:06:32.768467+0000","last_unstale":"2023-10-16T20:06:37.195306+0000","last_undegraded":"2023-10-16T20:06:37.195306+0000","last_fullsized":"2023-10-16T20:06:37.195306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878795+0000","last_change":"2023-10-16T20:06:32.761708+0000","last_active":"2023-10-16T20:06:36.878795+0000","last_peered":"2023-10-16T20:06:36.878795+0000","last_clean":"2023-10-16T20:06:36.878795+0000","last_became_active":"2023-10-16T20:06:32.761049+0000","last_became_peered":"2023-10-16T20:06:32.761049+0000","last_unstale":"2023-10-16T20:06:36.878795+0000","last_undegraded":"2023-10-16T20:06:36.878795+0000","last_fullsized":"2023-10-16T20:06:36.878795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:23.088887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.879062+0000","last_change":"2023-10-16T20:06:32.763671+0000","last_active":"2023-10-16T20:06:36.879062+0000","last_peered":"2023-10-16T20:06:36.879062+0000","last_clean":"2023-10-16T20:06:36.879062+0000","last_became_active":"2023-10-16T20:06:32.763356+0000","last_became_peered":"2023-10-16T20:06:32.763356+0000","last_unstale":"2023-10-16T20:06:36.879062+0000","last_undegraded":"2023-10-16T20:06:36.879062+0000","last_fullsized":"2023-10-16T20:06:36.879062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:47.470974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876982+0000","last_change":"2023-10-16T20:06:32.750776+0000","last_active":"2023-10-16T20:06:36.876982+0000","last_peered":"2023-10-16T20:06:36.876982+0000","last_clean":"2023-10-16T20:06:36.876982+0000","last_became_active":"2023-10-16T20:06:32.750465+0000","last_became_peered":"2023-10-16T20:06:32.750465+0000","last_unstale":"2023-10-16T20:06:36.876982+0000","last_undegraded":"2023-10-16T20:06:36.876982+0000","last_fullsized":"2023-10-16T20:06:36.876982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:30:55.631957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893374+0000","last_change":"2023-10-16T20:06:32.759849+0000","last_active":"2023-10-16T20:06:36.893374+0000","last_peered":"2023-10-16T20:06:36.893374+0000","last_clean":"2023-10-16T20:06:36.893374+0000","last_became_active":"2023-10-16T20:06:32.759521+0000","last_became_peered":"2023-10-16T20:06:32.759521+0000","last_unstale":"2023-10-16T20:06:36.893374+0000","last_undegraded":"2023-10-16T20:06:36.893374+0000","last_fullsized":"2023-10-16T20:06:36.893374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:37:00.865316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881227+0000","last_change":"2023-10-16T20:06:32.758196+0000","last_active":"2023-10-16T20:06:36.881227+0000","last_peered":"2023-10-16T20:06:36.881227+0000","last_clean":"2023-10-16T20:06:36.881227+0000","last_became_active":"2023-10-16T20:06:32.757915+0000","last_became_peered":"2023-10-16T20:06:32.757915+0000","last_unstale":"2023-10-16T20:06:36.881227+0000","last_undegraded":"2023-10-16T20:06:36.881227+0000","last_fullsized":"2023-10-16T20:06:36.881227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882603+0000","last_change":"2023-10-16T20:06:32.745759+0000","last_active":"2023-10-16T20:06:36.882603+0000","last_peered":"2023-10-16T20:06:36.882603+0000","last_clean":"2023-10-16T20:06:36.882603+0000","last_became_active":"2023-10-16T20:06:32.745456+0000","last_became_peered":"2023-10-16T20:06:32.745456+0000","last_unstale":"2023-10-16T20:06:36.882603+0000","last_undegraded":"2023-10-16T20:06:36.882603+0000","last_fullsized":"2023-10-16T20:06:36.882603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884589+0000","last_change":"2023-10-16T20:06:32.762852+0000","last_active":"2023-10-16T20:06:36.884589+0000","last_peered":"2023-10-16T20:06:36.884589+0000","last_clean":"2023-10-16T20:06:36.884589+0000","last_became_active":"2023-10-16T20:06:32.762554+0000","last_became_peered":"2023-10-16T20:06:32.762554+0000","last_unstale":"2023-10-16T20:06:36.884589+0000","last_undegraded":"2023-10-16T20:06:36.884589+0000","last_fullsized":"2023-10-16T20:06:36.884589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885258+0000","last_change":"2023-10-16T20:06:32.769083+0000","last_active":"2023-10-16T20:06:36.885258+0000","last_peered":"2023-10-16T20:06:36.885258+0000","last_clean":"2023-10-16T20:06:36.885258+0000","last_became_active":"2023-10-16T20:06:32.768686+0000","last_became_peered":"2023-10-16T20:06:32.768686+0000","last_unstale":"2023-10-16T20:06:36.885258+0000","last_undegraded":"2023-10-16T20:06:36.885258+0000","last_fullsized":"2023-10-16T20:06:36.885258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:20.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876513+0000","last_change":"2023-10-16T20:06:32.756439+0000","last_active":"2023-10-16T20:06:36.876513+0000","last_peered":"2023-10-16T20:06:36.876513+0000","last_clean":"2023-10-16T20:06:36.876513+0000","last_became_active":"2023-10-16T20:06:32.756183+0000","last_became_peered":"2023-10-16T20:06:32.756183+0000","last_unstale":"2023-10-16T20:06:36.876513+0000","last_undegraded":"2023-10-16T20:06:36.876513+0000","last_fullsized":"2023-10-16T20:06:36.876513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:35.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195238+0000","last_change":"2023-10-16T20:06:32.759997+0000","last_active":"2023-10-16T20:06:37.195238+0000","last_peered":"2023-10-16T20:06:37.195238+0000","last_clean":"2023-10-16T20:06:37.195238+0000","last_became_active":"2023-10-16T20:06:32.759616+0000","last_became_peered":"2023-10-16T20:06:32.759616+0000","last_unstale":"2023-10-16T20:06:37.195238+0000","last_undegraded":"2023-10-16T20:06:37.195238+0000","last_fullsized":"2023-10-16T20:06:37.195238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877453+0000","last_change":"2023-10-16T20:06:37.202706+0000","last_active":"2023-10-16T20:06:37.877453+0000","last_peered":"2023-10-16T20:06:37.877453+0000","last_clean":"2023-10-16T20:06:37.877453+0000","last_became_active":"2023-10-16T20:06:37.201561+0000","last_became_peered":"2023-10-16T20:06:37.201561+0000","last_unstale":"2023-10-16T20:06:37.877453+0000","last_undegraded":"2023-10-16T20:06:37.877453+0000","last_fullsized":"2023-10-16T20:06:37.877453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:54.383396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881285+0000","last_change":"2023-10-16T20:06:31.760708+0000","last_active":"2023-10-16T20:06:36.881285+0000","last_peered":"2023-10-16T20:06:36.881285+0000","last_clean":"2023-10-16T20:06:36.881285+0000","last_became_active":"2023-10-16T20:06:31.760372+0000","last_became_peered":"2023-10-16T20:06:31.760372+0000","last_unstale":"2023-10-16T20:06:36.881285+0000","last_undegraded":"2023-10-16T20:06:36.881285+0000","last_fullsized":"2023-10-16T20:06:36.881285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:34.488224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894537+0000","last_change":"2023-10-16T20:06:32.755438+0000","last_active":"2023-10-16T20:06:36.894537+0000","last_peered":"2023-10-16T20:06:36.894537+0000","last_clean":"2023-10-16T20:06:36.894537+0000","last_became_active":"2023-10-16T20:06:32.755151+0000","last_became_peered":"2023-10-16T20:06:32.755151+0000","last_unstale":"2023-10-16T20:06:36.894537+0000","last_undegraded":"2023-10-16T20:06:36.894537+0000","last_fullsized":"2023-10-16T20:06:36.894537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877813+0000","last_change":"2023-10-16T20:06:36.894982+0000","last_active":"2023-10-16T20:06:37.877813+0000","last_peered":"2023-10-16T20:06:37.877813+0000","last_clean":"2023-10-16T20:06:37.877813+0000","last_became_active":"2023-10-16T20:06:36.894580+0000","last_became_peered":"2023-10-16T20:06:36.894580+0000","last_unstale":"2023-10-16T20:06:37.877813+0000","last_undegraded":"2023-10-16T20:06:37.877813+0000","last_fullsized":"2023-10-16T20:06:37.877813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:01.103828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894628+0000","last_change":"2023-10-16T20:06:31.758252+0000","last_active":"2023-10-16T20:06:36.894628+0000","last_peered":"2023-10-16T20:06:36.894628+0000","last_clean":"2023-10-16T20:06:36.894628+0000","last_became_active":"2023-10-16T20:06:31.758059+0000","last_became_peered":"2023-10-16T20:06:31.758059+0000","last_unstale":"2023-10-16T20:06:36.894628+0000","last_undegraded":"2023-10-16T20:06:36.894628+0000","last_fullsized":"2023-10-16T20:06:36.894628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881181+0000","last_change":"2023-10-16T20:06:32.762874+0000","last_active":"2023-10-16T20:06:36.881181+0000","last_peered":"2023-10-16T20:06:36.881181+0000","last_clean":"2023-10-16T20:06:36.881181+0000","last_became_active":"2023-10-16T20:06:32.762402+0000","last_became_peered":"2023-10-16T20:06:32.762402+0000","last_unstale":"2023-10-16T20:06:36.881181+0000","last_undegraded":"2023-10-16T20:06:36.881181+0000","last_fullsized":"2023-10-16T20:06:36.881181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877518+0000","last_change":"2023-10-16T20:06:36.898631+0000","last_active":"2023-10-16T20:06:37.877518+0000","last_peered":"2023-10-16T20:06:37.877518+0000","last_clean":"2023-10-16T20:06:37.877518+0000","last_became_active":"2023-10-16T20:06:36.898270+0000","last_became_peered":"2023-10-16T20:06:36.898270+0000","last_unstale":"2023-10-16T20:06:37.877518+0000","last_undegraded":"2023-10-16T20:06:37.877518+0000","last_fullsized":"2023-10-16T20:06:37.877518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:51.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195047+0000","last_change":"2023-10-16T20:06:31.760987+0000","last_active":"2023-10-16T20:06:37.195047+0000","last_peered":"2023-10-16T20:06:37.195047+0000","last_clean":"2023-10-16T20:06:37.195047+0000","last_became_active":"2023-10-16T20:06:31.760689+0000","last_became_peered":"2023-10-16T20:06:31.760689+0000","last_unstale":"2023-10-16T20:06:37.195047+0000","last_undegraded":"2023-10-16T20:06:37.195047+0000","last_fullsized":"2023-10-16T20:06:37.195047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:55.970423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884745+0000","last_change":"2023-10-16T20:06:32.761819+0000","last_active":"2023-10-16T20:06:36.884745+0000","last_peered":"2023-10-16T20:06:36.884745+0000","last_clean":"2023-10-16T20:06:36.884745+0000","last_became_active":"2023-10-16T20:06:32.760684+0000","last_became_peered":"2023-10-16T20:06:32.760684+0000","last_unstale":"2023-10-16T20:06:36.884745+0000","last_undegraded":"2023-10-16T20:06:36.884745+0000","last_fullsized":"2023-10-16T20:06:36.884745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.159207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878229+0000","last_change":"2023-10-16T20:06:36.892310+0000","last_active":"2023-10-16T20:06:37.878229+0000","last_peered":"2023-10-16T20:06:37.878229+0000","last_clean":"2023-10-16T20:06:37.878229+0000","last_became_active":"2023-10-16T20:06:36.891929+0000","last_became_peered":"2023-10-16T20:06:36.891929+0000","last_unstale":"2023-10-16T20:06:37.878229+0000","last_undegraded":"2023-10-16T20:06:37.878229+0000","last_fullsized":"2023-10-16T20:06:37.878229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:08.770589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194885+0000","last_change":"2023-10-16T20:06:31.764299+0000","last_active":"2023-10-16T20:06:37.194885+0000","last_peered":"2023-10-16T20:06:37.194885+0000","last_clean":"2023-10-16T20:06:37.194885+0000","last_became_active":"2023-10-16T20:06:31.763992+0000","last_became_peered":"2023-10-16T20:06:31.763992+0000","last_unstale":"2023-10-16T20:06:37.194885+0000","last_undegraded":"2023-10-16T20:06:37.194885+0000","last_fullsized":"2023-10-16T20:06:37.194885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:47.236030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885181+0000","last_change":"2023-10-16T20:06:32.762698+0000","last_active":"2023-10-16T20:06:36.885181+0000","last_peered":"2023-10-16T20:06:36.885181+0000","last_clean":"2023-10-16T20:06:36.885181+0000","last_became_active":"2023-10-16T20:06:32.762260+0000","last_became_peered":"2023-10-16T20:06:32.762260+0000","last_unstale":"2023-10-16T20:06:36.885181+0000","last_undegraded":"2023-10-16T20:06:36.885181+0000","last_fullsized":"2023-10-16T20:06:36.885181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877522+0000","last_change":"2023-10-16T20:06:36.899980+0000","last_active":"2023-10-16T20:06:37.877522+0000","last_peered":"2023-10-16T20:06:37.877522+0000","last_clean":"2023-10-16T20:06:37.877522+0000","last_became_active":"2023-10-16T20:06:36.899573+0000","last_became_peered":"2023-10-16T20:06:36.899573+0000","last_unstale":"2023-10-16T20:06:37.877522+0000","last_undegraded":"2023-10-16T20:06:37.877522+0000","last_fullsized":"2023-10-16T20:06:37.877522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:13.468658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893703+0000","last_change":"2023-10-16T20:06:31.760320+0000","last_active":"2023-10-16T20:06:36.893703+0000","last_peered":"2023-10-16T20:06:36.893703+0000","last_clean":"2023-10-16T20:06:36.893703+0000","last_became_active":"2023-10-16T20:06:31.759976+0000","last_became_peered":"2023-10-16T20:06:31.759976+0000","last_unstale":"2023-10-16T20:06:36.893703+0000","last_undegraded":"2023-10-16T20:06:36.893703+0000","last_fullsized":"2023-10-16T20:06:36.893703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878749+0000","last_change":"2023-10-16T20:06:32.746691+0000","last_active":"2023-10-16T20:06:36.878749+0000","last_peered":"2023-10-16T20:06:36.878749+0000","last_clean":"2023-10-16T20:06:36.878749+0000","last_became_active":"2023-10-16T20:06:32.745389+0000","last_became_peered":"2023-10-16T20:06:32.745389+0000","last_unstale":"2023-10-16T20:06:36.878749+0000","last_undegraded":"2023-10-16T20:06:36.878749+0000","last_fullsized":"2023-10-16T20:06:36.878749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:23:34.748017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450907+0000","last_change":"2023-10-16T20:06:36.900651+0000","last_active":"2023-10-16T20:06:38.450907+0000","last_peered":"2023-10-16T20:06:38.450907+0000","last_clean":"2023-10-16T20:06:38.450907+0000","last_became_active":"2023-10-16T20:06:36.900236+0000","last_became_peered":"2023-10-16T20:06:36.900236+0000","last_unstale":"2023-10-16T20:06:38.450907+0000","last_undegraded":"2023-10-16T20:06:38.450907+0000","last_fullsized":"2023-10-16T20:06:38.450907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:37:01.291449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876809+0000","last_change":"2023-10-16T20:06:31.761790+0000","last_active":"2023-10-16T20:06:36.876809+0000","last_peered":"2023-10-16T20:06:36.876809+0000","last_clean":"2023-10-16T20:06:36.876809+0000","last_became_active":"2023-10-16T20:06:31.761519+0000","last_became_peered":"2023-10-16T20:06:31.761519+0000","last_unstale":"2023-10-16T20:06:36.876809+0000","last_undegraded":"2023-10-16T20:06:36.876809+0000","last_fullsized":"2023-10-16T20:06:36.876809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:28:20.846036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881411+0000","last_change":"2023-10-16T20:06:32.757771+0000","last_active":"2023-10-16T20:06:36.881411+0000","last_peered":"2023-10-16T20:06:36.881411+0000","last_clean":"2023-10-16T20:06:36.881411+0000","last_became_active":"2023-10-16T20:06:32.757124+0000","last_became_peered":"2023-10-16T20:06:32.757124+0000","last_unstale":"2023-10-16T20:06:36.881411+0000","last_undegraded":"2023-10-16T20:06:36.881411+0000","last_fullsized":"2023-10-16T20:06:36.881411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877753+0000","last_change":"2023-10-16T20:06:36.894985+0000","last_active":"2023-10-16T20:06:37.877753+0000","last_peered":"2023-10-16T20:06:37.877753+0000","last_clean":"2023-10-16T20:06:37.877753+0000","last_became_active":"2023-10-16T20:06:36.894583+0000","last_became_peered":"2023-10-16T20:06:36.894583+0000","last_unstale":"2023-10-16T20:06:37.877753+0000","last_undegraded":"2023-10-16T20:06:37.877753+0000","last_fullsized":"2023-10-16T20:06:37.877753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893346+0000","last_change":"2023-10-16T20:06:31.755087+0000","last_active":"2023-10-16T20:06:36.893346+0000","last_peered":"2023-10-16T20:06:36.893346+0000","last_clean":"2023-10-16T20:06:36.893346+0000","last_became_active":"2023-10-16T20:06:31.754799+0000","last_became_peered":"2023-10-16T20:06:31.754799+0000","last_unstale":"2023-10-16T20:06:36.893346+0000","last_undegraded":"2023-10-16T20:06:36.893346+0000","last_fullsized":"2023-10-16T20:06:36.893346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:18:50.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894075+0000","last_change":"2023-10-16T20:06:32.760484+0000","last_active":"2023-10-16T20:06:36.894075+0000","last_peered":"2023-10-16T20:06:36.894075+0000","last_clean":"2023-10-16T20:06:36.894075+0000","last_became_active":"2023-10-16T20:06:32.759921+0000","last_became_peered":"2023-10-16T20:06:32.759921+0000","last_unstale":"2023-10-16T20:06:36.894075+0000","last_undegraded":"2023-10-16T20:06:36.894075+0000","last_fullsized":"2023-10-16T20:06:36.894075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:25.853017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450546+0000","last_change":"2023-10-16T20:06:37.201860+0000","last_active":"2023-10-16T20:06:38.450546+0000","last_peered":"2023-10-16T20:06:38.450546+0000","last_clean":"2023-10-16T20:06:38.450546+0000","last_became_active":"2023-10-16T20:06:37.201460+0000","last_became_peered":"2023-10-16T20:06:37.201460+0000","last_unstale":"2023-10-16T20:06:38.450546+0000","last_undegraded":"2023-10-16T20:06:38.450546+0000","last_fullsized":"2023-10-16T20:06:38.450546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884636+0000","last_change":"2023-10-16T20:06:31.763472+0000","last_active":"2023-10-16T20:06:36.884636+0000","last_peered":"2023-10-16T20:06:36.884636+0000","last_clean":"2023-10-16T20:06:36.884636+0000","last_became_active":"2023-10-16T20:06:31.763182+0000","last_became_peered":"2023-10-16T20:06:31.763182+0000","last_unstale":"2023-10-16T20:06:36.884636+0000","last_undegraded":"2023-10-16T20:06:36.884636+0000","last_fullsized":"2023-10-16T20:06:36.884636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:36.641784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882893+0000","last_change":"2023-10-16T20:06:32.760456+0000","last_active":"2023-10-16T20:06:36.882893+0000","last_peered":"2023-10-16T20:06:36.882893+0000","last_clean":"2023-10-16T20:06:36.882893+0000","last_became_active":"2023-10-16T20:06:32.760213+0000","last_became_peered":"2023-10-16T20:06:32.760213+0000","last_unstale":"2023-10-16T20:06:36.882893+0000","last_undegraded":"2023-10-16T20:06:36.882893+0000","last_fullsized":"2023-10-16T20:06:36.882893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:22:57.831440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877007+0000","last_change":"2023-10-16T20:06:37.202225+0000","last_active":"2023-10-16T20:06:37.877007+0000","last_peered":"2023-10-16T20:06:37.877007+0000","last_clean":"2023-10-16T20:06:37.877007+0000","last_became_active":"2023-10-16T20:06:37.201869+0000","last_became_peered":"2023-10-16T20:06:37.201869+0000","last_unstale":"2023-10-16T20:06:37.877007+0000","last_undegraded":"2023-10-16T20:06:37.877007+0000","last_fullsized":"2023-10-16T20:06:37.877007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878662+0000","last_change":"2023-10-16T20:06:31.760996+0000","last_active":"2023-10-16T20:06:36.878662+0000","last_peered":"2023-10-16T20:06:36.878662+0000","last_clean":"2023-10-16T20:06:36.878662+0000","last_became_active":"2023-10-16T20:06:31.760730+0000","last_became_peered":"2023-10-16T20:06:31.760730+0000","last_unstale":"2023-10-16T20:06:36.878662+0000","last_undegraded":"2023-10-16T20:06:36.878662+0000","last_fullsized":"2023-10-16T20:06:36.878662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:16:41.705266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885662+0000","last_change":"2023-10-16T20:06:32.769034+0000","last_active":"2023-10-16T20:06:36.885662+0000","last_peered":"2023-10-16T20:06:36.885662+0000","last_clean":"2023-10-16T20:06:36.885662+0000","last_became_active":"2023-10-16T20:06:32.768739+0000","last_became_peered":"2023-10-16T20:06:32.768739+0000","last_unstale":"2023-10-16T20:06:36.885662+0000","last_undegraded":"2023-10-16T20:06:36.885662+0000","last_fullsized":"2023-10-16T20:06:36.885662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877177+0000","last_change":"2023-10-16T20:06:36.900254+0000","last_active":"2023-10-16T20:06:37.877177+0000","last_peered":"2023-10-16T20:06:37.877177+0000","last_clean":"2023-10-16T20:06:37.877177+0000","last_became_active":"2023-10-16T20:06:36.899452+0000","last_became_peered":"2023-10-16T20:06:36.899452+0000","last_unstale":"2023-10-16T20:06:37.877177+0000","last_undegraded":"2023-10-16T20:06:37.877177+0000","last_fullsized":"2023-10-16T20:06:37.877177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:44:40.784270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885577+0000","last_change":"2023-10-16T20:06:31.760615+0000","last_active":"2023-10-16T20:06:36.885577+0000","last_peered":"2023-10-16T20:06:36.885577+0000","last_clean":"2023-10-16T20:06:36.885577+0000","last_became_active":"2023-10-16T20:06:31.760334+0000","last_became_peered":"2023-10-16T20:06:31.760334+0000","last_unstale":"2023-10-16T20:06:36.885577+0000","last_undegraded":"2023-10-16T20:06:36.885577+0000","last_fullsized":"2023-10-16T20:06:36.885577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881436+0000","last_change":"2023-10-16T20:06:32.762754+0000","last_active":"2023-10-16T20:06:36.881436+0000","last_peered":"2023-10-16T20:06:36.881436+0000","last_clean":"2023-10-16T20:06:36.881436+0000","last_became_active":"2023-10-16T20:06:32.762465+0000","last_became_peered":"2023-10-16T20:06:32.762465+0000","last_unstale":"2023-10-16T20:06:36.881436+0000","last_undegraded":"2023-10-16T20:06:36.881436+0000","last_fullsized":"2023-10-16T20:06:36.881436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878471+0000","last_change":"2023-10-16T20:06:36.895621+0000","last_active":"2023-10-16T20:06:37.878471+0000","last_peered":"2023-10-16T20:06:37.878471+0000","last_clean":"2023-10-16T20:06:37.878471+0000","last_became_active":"2023-10-16T20:06:36.895207+0000","last_became_peered":"2023-10-16T20:06:36.895207+0000","last_unstale":"2023-10-16T20:06:37.878471+0000","last_undegraded":"2023-10-16T20:06:37.878471+0000","last_fullsized":"2023-10-16T20:06:37.878471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:45.017168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881577+0000","last_change":"2023-10-16T20:06:31.763487+0000","last_active":"2023-10-16T20:06:36.881577+0000","last_peered":"2023-10-16T20:06:36.881577+0000","last_clean":"2023-10-16T20:06:36.881577+0000","last_became_active":"2023-10-16T20:06:31.763173+0000","last_became_peered":"2023-10-16T20:06:31.763173+0000","last_unstale":"2023-10-16T20:06:36.881577+0000","last_undegraded":"2023-10-16T20:06:36.881577+0000","last_fullsized":"2023-10-16T20:06:36.881577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:36:59.860416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876870+0000","last_change":"2023-10-16T20:06:32.759043+0000","last_active":"2023-10-16T20:06:36.876870+0000","last_peered":"2023-10-16T20:06:36.876870+0000","last_clean":"2023-10-16T20:06:36.876870+0000","last_became_active":"2023-10-16T20:06:32.758748+0000","last_became_peered":"2023-10-16T20:06:32.758748+0000","last_unstale":"2023-10-16T20:06:36.876870+0000","last_undegraded":"2023-10-16T20:06:36.876870+0000","last_fullsized":"2023-10-16T20:06:36.876870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:35.526470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449676+0000","last_change":"2023-10-16T20:06:36.903555+0000","last_active":"2023-10-16T20:06:38.449676+0000","last_peered":"2023-10-16T20:06:38.449676+0000","last_clean":"2023-10-16T20:06:38.449676+0000","last_became_active":"2023-10-16T20:06:36.902883+0000","last_became_peered":"2023-10-16T20:06:36.902883+0000","last_unstale":"2023-10-16T20:06:38.449676+0000","last_undegraded":"2023-10-16T20:06:38.449676+0000","last_fullsized":"2023-10-16T20:06:38.449676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:43.155600+0000","last_change":"2023-10-16T20:06:31.754138+0000","last_active":"2023-10-16T20:06:43.155600+0000","last_peered":"2023-10-16T20:06:43.155600+0000","last_clean":"2023-10-16T20:06:43.155600+0000","last_became_active":"2023-10-16T20:06:31.753853+0000","last_became_peered":"2023-10-16T20:06:31.753853+0000","last_unstale":"2023-10-16T20:06:43.155600+0000","last_undegraded":"2023-10-16T20:06:43.155600+0000","last_fullsized":"2023-10-16T20:06:43.155600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:06:42.602521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195144+0000","last_change":"2023-10-16T20:06:32.767119+0000","last_active":"2023-10-16T20:06:37.195144+0000","last_peered":"2023-10-16T20:06:37.195144+0000","last_clean":"2023-10-16T20:06:37.195144+0000","last_became_active":"2023-10-16T20:06:32.766833+0000","last_became_peered":"2023-10-16T20:06:32.766833+0000","last_unstale":"2023-10-16T20:06:37.195144+0000","last_undegraded":"2023-10-16T20:06:37.195144+0000","last_fullsized":"2023-10-16T20:06:37.195144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356888+0000","last_change":"2023-10-16T20:06:37.202116+0000","last_active":"2023-10-16T20:06:38.356888+0000","last_peered":"2023-10-16T20:06:38.356888+0000","last_clean":"2023-10-16T20:06:38.356888+0000","last_became_active":"2023-10-16T20:06:37.201629+0000","last_became_peered":"2023-10-16T20:06:37.201629+0000","last_unstale":"2023-10-16T20:06:38.356888+0000","last_undegraded":"2023-10-16T20:06:38.356888+0000","last_fullsized":"2023-10-16T20:06:38.356888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:05:17.307460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881594+0000","last_change":"2023-10-16T20:06:31.758562+0000","last_active":"2023-10-16T20:06:36.881594+0000","last_peered":"2023-10-16T20:06:36.881594+0000","last_clean":"2023-10-16T20:06:36.881594+0000","last_became_active":"2023-10-16T20:06:31.758280+0000","last_became_peered":"2023-10-16T20:06:31.758280+0000","last_unstale":"2023-10-16T20:06:36.881594+0000","last_undegraded":"2023-10-16T20:06:36.881594+0000","last_fullsized":"2023-10-16T20:06:36.881594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:56.158044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882698+0000","last_change":"2023-10-16T20:06:32.761562+0000","last_active":"2023-10-16T20:06:36.882698+0000","last_peered":"2023-10-16T20:06:36.882698+0000","last_clean":"2023-10-16T20:06:36.882698+0000","last_became_active":"2023-10-16T20:06:32.761271+0000","last_became_peered":"2023-10-16T20:06:32.761271+0000","last_unstale":"2023-10-16T20:06:36.882698+0000","last_undegraded":"2023-10-16T20:06:36.882698+0000","last_fullsized":"2023-10-16T20:06:36.882698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:15.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877847+0000","last_change":"2023-10-16T20:06:37.196752+0000","last_active":"2023-10-16T20:06:37.877847+0000","last_peered":"2023-10-16T20:06:37.877847+0000","last_clean":"2023-10-16T20:06:37.877847+0000","last_became_active":"2023-10-16T20:06:37.196349+0000","last_became_peered":"2023-10-16T20:06:37.196349+0000","last_unstale":"2023-10-16T20:06:37.877847+0000","last_undegraded":"2023-10-16T20:06:37.877847+0000","last_fullsized":"2023-10-16T20:06:37.877847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:17:44.546135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885198+0000","last_change":"2023-10-16T20:06:31.760198+0000","last_active":"2023-10-16T20:06:36.885198+0000","last_peered":"2023-10-16T20:06:36.885198+0000","last_clean":"2023-10-16T20:06:36.885198+0000","last_became_active":"2023-10-16T20:06:31.759876+0000","last_became_peered":"2023-10-16T20:06:31.759876+0000","last_unstale":"2023-10-16T20:06:36.885198+0000","last_undegraded":"2023-10-16T20:06:36.885198+0000","last_fullsized":"2023-10-16T20:06:36.885198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194983+0000","last_change":"2023-10-16T20:06:32.766888+0000","last_active":"2023-10-16T20:06:37.194983+0000","last_peered":"2023-10-16T20:06:37.194983+0000","last_clean":"2023-10-16T20:06:37.194983+0000","last_became_active":"2023-10-16T20:06:32.766622+0000","last_became_peered":"2023-10-16T20:06:32.766622+0000","last_unstale":"2023-10-16T20:06:37.194983+0000","last_undegraded":"2023-10-16T20:06:37.194983+0000","last_fullsized":"2023-10-16T20:06:37.194983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:09.600221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878288+0000","last_change":"2023-10-16T20:06:37.203326+0000","last_active":"2023-10-16T20:06:37.878288+0000","last_peered":"2023-10-16T20:06:37.878288+0000","last_clean":"2023-10-16T20:06:37.878288+0000","last_became_active":"2023-10-16T20:06:37.202984+0000","last_became_peered":"2023-10-16T20:06:37.202984+0000","last_unstale":"2023-10-16T20:06:37.878288+0000","last_undegraded":"2023-10-16T20:06:37.878288+0000","last_fullsized":"2023-10-16T20:06:37.878288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:14.463170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876269+0000","last_change":"2023-10-16T20:06:31.753359+0000","last_active":"2023-10-16T20:06:36.876269+0000","last_peered":"2023-10-16T20:06:36.876269+0000","last_clean":"2023-10-16T20:06:36.876269+0000","last_became_active":"2023-10-16T20:06:31.753077+0000","last_became_peered":"2023-10-16T20:06:31.753077+0000","last_unstale":"2023-10-16T20:06:36.876269+0000","last_undegraded":"2023-10-16T20:06:36.876269+0000","last_fullsized":"2023-10-16T20:06:36.876269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:33:34.708942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876082+0000","last_change":"2023-10-16T20:06:32.751058+0000","last_active":"2023-10-16T20:06:36.876082+0000","last_peered":"2023-10-16T20:06:36.876082+0000","last_clean":"2023-10-16T20:06:36.876082+0000","last_became_active":"2023-10-16T20:06:32.750777+0000","last_became_peered":"2023-10-16T20:06:32.750777+0000","last_unstale":"2023-10-16T20:06:36.876082+0000","last_undegraded":"2023-10-16T20:06:36.876082+0000","last_fullsized":"2023-10-16T20:06:36.876082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:58.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450353+0000","last_change":"2023-10-16T20:06:36.902623+0000","last_active":"2023-10-16T20:06:38.450353+0000","last_peered":"2023-10-16T20:06:38.450353+0000","last_clean":"2023-10-16T20:06:38.450353+0000","last_became_active":"2023-10-16T20:06:36.902228+0000","last_became_peered":"2023-10-16T20:06:36.902228+0000","last_unstale":"2023-10-16T20:06:38.450353+0000","last_undegraded":"2023-10-16T20:06:38.450353+0000","last_fullsized":"2023-10-16T20:06:38.450353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:04.142891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876268+0000","last_change":"2023-10-16T20:06:31.755895+0000","last_active":"2023-10-16T20:06:36.876268+0000","last_peered":"2023-10-16T20:06:36.876268+0000","last_clean":"2023-10-16T20:06:36.876268+0000","last_became_active":"2023-10-16T20:06:31.753514+0000","last_became_peered":"2023-10-16T20:06:31.753514+0000","last_unstale":"2023-10-16T20:06:36.876268+0000","last_undegraded":"2023-10-16T20:06:36.876268+0000","last_fullsized":"2023-10-16T20:06:36.876268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:14:56.622454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194950+0000","last_change":"2023-10-16T20:06:32.761296+0000","last_active":"2023-10-16T20:06:37.194950+0000","last_peered":"2023-10-16T20:06:37.194950+0000","last_clean":"2023-10-16T20:06:37.194950+0000","last_became_active":"2023-10-16T20:06:32.759859+0000","last_became_peered":"2023-10-16T20:06:32.759859+0000","last_unstale":"2023-10-16T20:06:37.194950+0000","last_undegraded":"2023-10-16T20:06:37.194950+0000","last_fullsized":"2023-10-16T20:06:37.194950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:51:31.604677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877930+0000","last_change":"2023-10-16T20:06:36.895213+0000","last_active":"2023-10-16T20:06:37.877930+0000","last_peered":"2023-10-16T20:06:37.877930+0000","last_clean":"2023-10-16T20:06:37.877930+0000","last_became_active":"2023-10-16T20:06:36.894773+0000","last_became_peered":"2023-10-16T20:06:36.894773+0000","last_unstale":"2023-10-16T20:06:37.877930+0000","last_undegraded":"2023-10-16T20:06:37.877930+0000","last_fullsized":"2023-10-16T20:06:37.877930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:50:27.217392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876800+0000","last_change":"2023-10-16T20:06:31.757448+0000","last_active":"2023-10-16T20:06:36.876800+0000","last_peered":"2023-10-16T20:06:36.876800+0000","last_clean":"2023-10-16T20:06:36.876800+0000","last_became_active":"2023-10-16T20:06:31.757148+0000","last_became_peered":"2023-10-16T20:06:31.757148+0000","last_unstale":"2023-10-16T20:06:36.876800+0000","last_undegraded":"2023-10-16T20:06:36.876800+0000","last_fullsized":"2023-10-16T20:06:36.876800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:53:58.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195129+0000","last_change":"2023-10-16T20:06:32.760468+0000","last_active":"2023-10-16T20:06:37.195129+0000","last_peered":"2023-10-16T20:06:37.195129+0000","last_clean":"2023-10-16T20:06:37.195129+0000","last_became_active":"2023-10-16T20:06:32.760170+0000","last_became_peered":"2023-10-16T20:06:32.760170+0000","last_unstale":"2023-10-16T20:06:37.195129+0000","last_undegraded":"2023-10-16T20:06:37.195129+0000","last_fullsized":"2023-10-16T20:06:37.195129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:21:54.422703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449538+0000","last_change":"2023-10-16T20:06:36.903294+0000","last_active":"2023-10-16T20:06:38.449538+0000","last_peered":"2023-10-16T20:06:38.449538+0000","last_clean":"2023-10-16T20:06:38.449538+0000","last_became_active":"2023-10-16T20:06:36.902123+0000","last_became_peered":"2023-10-16T20:06:36.902123+0000","last_unstale":"2023-10-16T20:06:38.449538+0000","last_undegraded":"2023-10-16T20:06:38.449538+0000","last_fullsized":"2023-10-16T20:06:38.449538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885520+0000","last_change":"2023-10-16T20:06:31.754709+0000","last_active":"2023-10-16T20:06:36.885520+0000","last_peered":"2023-10-16T20:06:36.885520+0000","last_clean":"2023-10-16T20:06:36.885520+0000","last_became_active":"2023-10-16T20:06:31.754401+0000","last_became_peered":"2023-10-16T20:06:31.754401+0000","last_unstale":"2023-10-16T20:06:36.885520+0000","last_undegraded":"2023-10-16T20:06:36.885520+0000","last_fullsized":"2023-10-16T20:06:36.885520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:17.452414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885290+0000","last_change":"2023-10-16T20:06:32.761804+0000","last_active":"2023-10-16T20:06:36.885290+0000","last_peered":"2023-10-16T20:06:36.885290+0000","last_clean":"2023-10-16T20:06:36.885290+0000","last_became_active":"2023-10-16T20:06:32.760958+0000","last_became_peered":"2023-10-16T20:06:32.760958+0000","last_unstale":"2023-10-16T20:06:36.885290+0000","last_undegraded":"2023-10-16T20:06:36.885290+0000","last_fullsized":"2023-10-16T20:06:36.885290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:28.721797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449849+0000","last_change":"2023-10-16T20:06:36.903445+0000","last_active":"2023-10-16T20:06:38.449849+0000","last_peered":"2023-10-16T20:06:38.449849+0000","last_clean":"2023-10-16T20:06:38.449849+0000","last_became_active":"2023-10-16T20:06:36.903063+0000","last_became_peered":"2023-10-16T20:06:36.903063+0000","last_unstale":"2023-10-16T20:06:38.449849+0000","last_undegraded":"2023-10-16T20:06:38.449849+0000","last_fullsized":"2023-10-16T20:06:38.449849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884659+0000","last_change":"2023-10-16T20:06:31.763443+0000","last_active":"2023-10-16T20:06:36.884659+0000","last_peered":"2023-10-16T20:06:36.884659+0000","last_clean":"2023-10-16T20:06:36.884659+0000","last_became_active":"2023-10-16T20:06:31.763163+0000","last_became_peered":"2023-10-16T20:06:31.763163+0000","last_unstale":"2023-10-16T20:06:36.884659+0000","last_undegraded":"2023-10-16T20:06:36.884659+0000","last_fullsized":"2023-10-16T20:06:36.884659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:56:57.275970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878335+0000","last_change":"2023-10-16T20:06:32.752504+0000","last_active":"2023-10-16T20:06:36.878335+0000","last_peered":"2023-10-16T20:06:36.878335+0000","last_clean":"2023-10-16T20:06:36.878335+0000","last_became_active":"2023-10-16T20:06:32.752221+0000","last_became_peered":"2023-10-16T20:06:32.752221+0000","last_unstale":"2023-10-16T20:06:36.878335+0000","last_undegraded":"2023-10-16T20:06:36.878335+0000","last_fullsized":"2023-10-16T20:06:36.878335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:06.823167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450660+0000","last_change":"2023-10-16T20:06:36.904832+0000","last_active":"2023-10-16T20:06:38.450660+0000","last_peered":"2023-10-16T20:06:38.450660+0000","last_clean":"2023-10-16T20:06:38.450660+0000","last_became_active":"2023-10-16T20:06:36.902946+0000","last_became_peered":"2023-10-16T20:06:36.902946+0000","last_unstale":"2023-10-16T20:06:38.450660+0000","last_undegraded":"2023-10-16T20:06:38.450660+0000","last_fullsized":"2023-10-16T20:06:38.450660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886854+0000","last_change":"2023-10-16T20:06:32.754410+0000","last_active":"2023-10-16T20:06:36.886854+0000","last_peered":"2023-10-16T20:06:36.886854+0000","last_clean":"2023-10-16T20:06:36.886854+0000","last_became_active":"2023-10-16T20:06:32.752138+0000","last_became_peered":"2023-10-16T20:06:32.752138+0000","last_unstale":"2023-10-16T20:06:36.886854+0000","last_undegraded":"2023-10-16T20:06:36.886854+0000","last_fullsized":"2023-10-16T20:06:36.886854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876274+0000","last_change":"2023-10-16T20:06:31.754288+0000","last_active":"2023-10-16T20:06:36.876274+0000","last_peered":"2023-10-16T20:06:36.876274+0000","last_clean":"2023-10-16T20:06:36.876274+0000","last_became_active":"2023-10-16T20:06:31.753897+0000","last_became_peered":"2023-10-16T20:06:31.753897+0000","last_unstale":"2023-10-16T20:06:36.876274+0000","last_undegraded":"2023-10-16T20:06:36.876274+0000","last_fullsized":"2023-10-16T20:06:36.876274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:50.340924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.877991+0000","last_change":"2023-10-16T20:06:37.196921+0000","last_active":"2023-10-16T20:06:37.877991+0000","last_peered":"2023-10-16T20:06:37.877991+0000","last_clean":"2023-10-16T20:06:37.877991+0000","last_became_active":"2023-10-16T20:06:37.196485+0000","last_became_peered":"2023-10-16T20:06:37.196485+0000","last_unstale":"2023-10-16T20:06:37.877991+0000","last_undegraded":"2023-10-16T20:06:37.877991+0000","last_fullsized":"2023-10-16T20:06:37.877991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893852+0000","last_change":"2023-10-16T20:06:32.763195+0000","last_active":"2023-10-16T20:06:36.893852+0000","last_peered":"2023-10-16T20:06:36.893852+0000","last_clean":"2023-10-16T20:06:36.893852+0000","last_became_active":"2023-10-16T20:06:32.762891+0000","last_became_peered":"2023-10-16T20:06:32.762891+0000","last_unstale":"2023-10-16T20:06:36.893852+0000","last_undegraded":"2023-10-16T20:06:36.893852+0000","last_fullsized":"2023-10-16T20:06:36.893852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885155+0000","last_change":"2023-10-16T20:06:31.759832+0000","last_active":"2023-10-16T20:06:36.885155+0000","last_peered":"2023-10-16T20:06:36.885155+0000","last_clean":"2023-10-16T20:06:36.885155+0000","last_became_active":"2023-10-16T20:06:31.759343+0000","last_became_peered":"2023-10-16T20:06:31.759343+0000","last_unstale":"2023-10-16T20:06:36.885155+0000","last_undegraded":"2023-10-16T20:06:36.885155+0000","last_fullsized":"2023-10-16T20:06:36.885155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:28.978568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194365+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:06:37.194365+0000","last_peered":"2023-10-16T20:06:37.194365+0000","last_clean":"2023-10-16T20:06:37.194365+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:06:37.194365+0000","last_undegraded":"2023-10-16T20:06:37.194365+0000","last_fullsized":"2023-10-16T20:06:37.194365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450435+0000","last_change":"2023-10-16T20:06:37.201901+0000","last_active":"2023-10-16T20:06:38.450435+0000","last_peered":"2023-10-16T20:06:38.450435+0000","last_clean":"2023-10-16T20:06:38.450435+0000","last_became_active":"2023-10-16T20:06:37.201501+0000","last_became_peered":"2023-10-16T20:06:37.201501+0000","last_unstale":"2023-10-16T20:06:38.450435+0000","last_undegraded":"2023-10-16T20:06:38.450435+0000","last_fullsized":"2023-10-16T20:06:38.450435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:07:22.908125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.880899+0000","last_change":"2023-10-16T20:06:32.757110+0000","last_active":"2023-10-16T20:06:36.880899+0000","last_peered":"2023-10-16T20:06:36.880899+0000","last_clean":"2023-10-16T20:06:36.880899+0000","last_became_active":"2023-10-16T20:06:32.756814+0000","last_became_peered":"2023-10-16T20:06:32.756814+0000","last_unstale":"2023-10-16T20:06:36.880899+0000","last_undegraded":"2023-10-16T20:06:36.880899+0000","last_fullsized":"2023-10-16T20:06:36.880899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:16:18.457314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194766+0000","last_change":"2023-10-16T20:06:31.757582+0000","last_active":"2023-10-16T20:06:37.194766+0000","last_peered":"2023-10-16T20:06:37.194766+0000","last_clean":"2023-10-16T20:06:37.194766+0000","last_became_active":"2023-10-16T20:06:31.757284+0000","last_became_peered":"2023-10-16T20:06:31.757284+0000","last_unstale":"2023-10-16T20:06:37.194766+0000","last_undegraded":"2023-10-16T20:06:37.194766+0000","last_fullsized":"2023-10-16T20:06:37.194766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:34.521571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449383+0000","last_change":"2023-10-16T20:06:37.196738+0000","last_active":"2023-10-16T20:06:38.449383+0000","last_peered":"2023-10-16T20:06:38.449383+0000","last_clean":"2023-10-16T20:06:38.449383+0000","last_became_active":"2023-10-16T20:06:37.196358+0000","last_became_peered":"2023-10-16T20:06:37.196358+0000","last_unstale":"2023-10-16T20:06:38.449383+0000","last_undegraded":"2023-10-16T20:06:38.449383+0000","last_fullsized":"2023-10-16T20:06:38.449383+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:31:49.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195027+0000","last_change":"2023-10-16T20:06:31.763235+0000","last_active":"2023-10-16T20:06:37.195027+0000","last_peered":"2023-10-16T20:06:37.195027+0000","last_clean":"2023-10-16T20:06:37.195027+0000","last_became_active":"2023-10-16T20:06:31.762917+0000","last_became_peered":"2023-10-16T20:06:31.762917+0000","last_unstale":"2023-10-16T20:06:37.195027+0000","last_undegraded":"2023-10-16T20:06:37.195027+0000","last_fullsized":"2023-10-16T20:06:37.195027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:21.613640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.885559+0000","last_change":"2023-10-16T20:06:32.753815+0000","last_active":"2023-10-16T20:06:36.885559+0000","last_peered":"2023-10-16T20:06:36.885559+0000","last_clean":"2023-10-16T20:06:36.885559+0000","last_became_active":"2023-10-16T20:06:32.753504+0000","last_became_peered":"2023-10-16T20:06:32.753504+0000","last_unstale":"2023-10-16T20:06:36.885559+0000","last_undegraded":"2023-10-16T20:06:36.885559+0000","last_fullsized":"2023-10-16T20:06:36.885559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.876963+0000","last_change":"2023-10-16T20:06:37.202096+0000","last_active":"2023-10-16T20:06:37.876963+0000","last_peered":"2023-10-16T20:06:37.876963+0000","last_clean":"2023-10-16T20:06:37.876963+0000","last_became_active":"2023-10-16T20:06:37.201491+0000","last_became_peered":"2023-10-16T20:06:37.201491+0000","last_unstale":"2023-10-16T20:06:37.876963+0000","last_undegraded":"2023-10-16T20:06:37.876963+0000","last_fullsized":"2023-10-16T20:06:37.876963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:15.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886132+0000","last_change":"2023-10-16T20:06:31.757976+0000","last_active":"2023-10-16T20:06:36.886132+0000","last_peered":"2023-10-16T20:06:36.886132+0000","last_clean":"2023-10-16T20:06:36.886132+0000","last_became_active":"2023-10-16T20:06:31.757076+0000","last_became_peered":"2023-10-16T20:06:31.757076+0000","last_unstale":"2023-10-16T20:06:36.886132+0000","last_undegraded":"2023-10-16T20:06:36.886132+0000","last_fullsized":"2023-10-16T20:06:36.886132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:14.095040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893777+0000","last_change":"2023-10-16T20:06:32.762472+0000","last_active":"2023-10-16T20:06:36.893777+0000","last_peered":"2023-10-16T20:06:36.893777+0000","last_clean":"2023-10-16T20:06:36.893777+0000","last_became_active":"2023-10-16T20:06:32.762178+0000","last_became_peered":"2023-10-16T20:06:32.762178+0000","last_unstale":"2023-10-16T20:06:36.893777+0000","last_undegraded":"2023-10-16T20:06:36.893777+0000","last_fullsized":"2023-10-16T20:06:36.893777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:18:26.723407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878094+0000","last_change":"2023-10-16T20:06:37.197304+0000","last_active":"2023-10-16T20:06:37.878094+0000","last_peered":"2023-10-16T20:06:37.878094+0000","last_clean":"2023-10-16T20:06:37.878094+0000","last_became_active":"2023-10-16T20:06:37.196929+0000","last_became_peered":"2023-10-16T20:06:37.196929+0000","last_unstale":"2023-10-16T20:06:37.878094+0000","last_undegraded":"2023-10-16T20:06:37.878094+0000","last_fullsized":"2023-10-16T20:06:37.878094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:50.138290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878557+0000","last_change":"2023-10-16T20:06:31.757280+0000","last_active":"2023-10-16T20:06:36.878557+0000","last_peered":"2023-10-16T20:06:36.878557+0000","last_clean":"2023-10-16T20:06:36.878557+0000","last_became_active":"2023-10-16T20:06:31.756978+0000","last_became_peered":"2023-10-16T20:06:31.756978+0000","last_unstale":"2023-10-16T20:06:36.878557+0000","last_undegraded":"2023-10-16T20:06:36.878557+0000","last_fullsized":"2023-10-16T20:06:36.878557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:06:45.721286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.886554+0000","last_change":"2023-10-16T20:06:32.758662+0000","last_active":"2023-10-16T20:06:36.886554+0000","last_peered":"2023-10-16T20:06:36.886554+0000","last_clean":"2023-10-16T20:06:36.886554+0000","last_became_active":"2023-10-16T20:06:32.758318+0000","last_became_peered":"2023-10-16T20:06:32.758318+0000","last_unstale":"2023-10-16T20:06:36.886554+0000","last_undegraded":"2023-10-16T20:06:36.886554+0000","last_fullsized":"2023-10-16T20:06:36.886554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878944+0000","last_change":"2023-10-16T20:06:36.898893+0000","last_active":"2023-10-16T20:06:37.878944+0000","last_peered":"2023-10-16T20:06:37.878944+0000","last_clean":"2023-10-16T20:06:37.878944+0000","last_became_active":"2023-10-16T20:06:36.898502+0000","last_became_peered":"2023-10-16T20:06:36.898502+0000","last_unstale":"2023-10-16T20:06:37.878944+0000","last_undegraded":"2023-10-16T20:06:37.878944+0000","last_fullsized":"2023-10-16T20:06:37.878944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:16:24.286026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194284+0000","last_change":"2023-10-16T20:06:31.763222+0000","last_active":"2023-10-16T20:06:37.194284+0000","last_peered":"2023-10-16T20:06:37.194284+0000","last_clean":"2023-10-16T20:06:37.194284+0000","last_became_active":"2023-10-16T20:06:31.762927+0000","last_became_peered":"2023-10-16T20:06:31.762927+0000","last_unstale":"2023-10-16T20:06:37.194284+0000","last_undegraded":"2023-10-16T20:06:37.194284+0000","last_fullsized":"2023-10-16T20:06:37.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:39:05.818268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877358+0000","last_change":"2023-10-16T20:06:32.751479+0000","last_active":"2023-10-16T20:06:36.877358+0000","last_peered":"2023-10-16T20:06:36.877358+0000","last_clean":"2023-10-16T20:06:36.877358+0000","last_became_active":"2023-10-16T20:06:32.751190+0000","last_became_peered":"2023-10-16T20:06:32.751190+0000","last_unstale":"2023-10-16T20:06:36.877358+0000","last_undegraded":"2023-10-16T20:06:36.877358+0000","last_fullsized":"2023-10-16T20:06:36.877358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:48:45.349066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.450801+0000","last_change":"2023-10-16T20:06:37.197326+0000","last_active":"2023-10-16T20:06:38.450801+0000","last_peered":"2023-10-16T20:06:38.450801+0000","last_clean":"2023-10-16T20:06:38.450801+0000","last_became_active":"2023-10-16T20:06:37.196386+0000","last_became_peered":"2023-10-16T20:06:37.196386+0000","last_unstale":"2023-10-16T20:06:38.450801+0000","last_undegraded":"2023-10-16T20:06:38.450801+0000","last_fullsized":"2023-10-16T20:06:38.450801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:06:38.711176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.882771+0000","last_change":"2023-10-16T20:06:31.758660+0000","last_active":"2023-10-16T20:06:36.882771+0000","last_peered":"2023-10-16T20:06:36.882771+0000","last_clean":"2023-10-16T20:06:36.882771+0000","last_became_active":"2023-10-16T20:06:31.758394+0000","last_became_peered":"2023-10-16T20:06:31.758394+0000","last_unstale":"2023-10-16T20:06:36.882771+0000","last_undegraded":"2023-10-16T20:06:36.882771+0000","last_fullsized":"2023-10-16T20:06:36.882771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:04:09.405305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.894178+0000","last_change":"2023-10-16T20:06:32.755401+0000","last_active":"2023-10-16T20:06:36.894178+0000","last_peered":"2023-10-16T20:06:36.894178+0000","last_clean":"2023-10-16T20:06:36.894178+0000","last_became_active":"2023-10-16T20:06:32.755107+0000","last_became_peered":"2023-10-16T20:06:32.755107+0000","last_unstale":"2023-10-16T20:06:36.894178+0000","last_undegraded":"2023-10-16T20:06:36.894178+0000","last_fullsized":"2023-10-16T20:06:36.894178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:18.002350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878938+0000","last_change":"2023-10-16T20:06:36.896689+0000","last_active":"2023-10-16T20:06:37.878938+0000","last_peered":"2023-10-16T20:06:37.878938+0000","last_clean":"2023-10-16T20:06:37.878938+0000","last_became_active":"2023-10-16T20:06:36.896287+0000","last_became_peered":"2023-10-16T20:06:36.896287+0000","last_unstale":"2023-10-16T20:06:37.878938+0000","last_undegraded":"2023-10-16T20:06:37.878938+0000","last_fullsized":"2023-10-16T20:06:37.878938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:13.728727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.888301+0000","last_change":"2023-10-16T20:06:31.757230+0000","last_active":"2023-10-16T20:06:36.888301+0000","last_peered":"2023-10-16T20:06:36.888301+0000","last_clean":"2023-10-16T20:06:36.888301+0000","last_became_active":"2023-10-16T20:06:31.756944+0000","last_became_peered":"2023-10-16T20:06:31.756944+0000","last_unstale":"2023-10-16T20:06:36.888301+0000","last_undegraded":"2023-10-16T20:06:36.888301+0000","last_fullsized":"2023-10-16T20:06:36.888301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:21:18.395813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893812+0000","last_change":"2023-10-16T20:06:32.764333+0000","last_active":"2023-10-16T20:06:36.893812+0000","last_peered":"2023-10-16T20:06:36.893812+0000","last_clean":"2023-10-16T20:06:36.893812+0000","last_became_active":"2023-10-16T20:06:32.764136+0000","last_became_peered":"2023-10-16T20:06:32.764136+0000","last_unstale":"2023-10-16T20:06:36.893812+0000","last_undegraded":"2023-10-16T20:06:36.893812+0000","last_fullsized":"2023-10-16T20:06:36.893812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:04.600915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.879154+0000","last_change":"2023-10-16T20:06:36.895534+0000","last_active":"2023-10-16T20:06:37.879154+0000","last_peered":"2023-10-16T20:06:37.879154+0000","last_clean":"2023-10-16T20:06:37.879154+0000","last_became_active":"2023-10-16T20:06:36.895164+0000","last_became_peered":"2023-10-16T20:06:36.895164+0000","last_unstale":"2023-10-16T20:06:37.879154+0000","last_undegraded":"2023-10-16T20:06:37.879154+0000","last_fullsized":"2023-10-16T20:06:37.879154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:32.850303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.194973+0000","last_change":"2023-10-16T20:06:31.760505+0000","last_active":"2023-10-16T20:06:37.194973+0000","last_peered":"2023-10-16T20:06:37.194973+0000","last_clean":"2023-10-16T20:06:37.194973+0000","last_became_active":"2023-10-16T20:06:31.760190+0000","last_became_peered":"2023-10-16T20:06:31.760190+0000","last_unstale":"2023-10-16T20:06:37.194973+0000","last_undegraded":"2023-10-16T20:06:37.194973+0000","last_fullsized":"2023-10-16T20:06:37.194973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:46.466074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876944+0000","last_change":"2023-10-16T20:06:32.757975+0000","last_active":"2023-10-16T20:06:36.876944+0000","last_peered":"2023-10-16T20:06:36.876944+0000","last_clean":"2023-10-16T20:06:36.876944+0000","last_became_active":"2023-10-16T20:06:32.757179+0000","last_became_peered":"2023-10-16T20:06:32.757179+0000","last_unstale":"2023-10-16T20:06:36.876944+0000","last_undegraded":"2023-10-16T20:06:36.876944+0000","last_fullsized":"2023-10-16T20:06:36.876944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:46:29.983467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.878473+0000","last_change":"2023-10-16T20:06:37.197542+0000","last_active":"2023-10-16T20:06:37.878473+0000","last_peered":"2023-10-16T20:06:37.878473+0000","last_clean":"2023-10-16T20:06:37.878473+0000","last_became_active":"2023-10-16T20:06:37.196312+0000","last_became_peered":"2023-10-16T20:06:37.196312+0000","last_unstale":"2023-10-16T20:06:37.878473+0000","last_undegraded":"2023-10-16T20:06:37.878473+0000","last_fullsized":"2023-10-16T20:06:37.878473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:40.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876859+0000","last_change":"2023-10-16T20:06:31.763508+0000","last_active":"2023-10-16T20:06:36.876859+0000","last_peered":"2023-10-16T20:06:36.876859+0000","last_clean":"2023-10-16T20:06:36.876859+0000","last_became_active":"2023-10-16T20:06:31.763228+0000","last_became_peered":"2023-10-16T20:06:31.763228+0000","last_unstale":"2023-10-16T20:06:36.876859+0000","last_undegraded":"2023-10-16T20:06:36.876859+0000","last_fullsized":"2023-10-16T20:06:36.876859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:20:33.157086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195141+0000","last_change":"2023-10-16T20:06:32.767619+0000","last_active":"2023-10-16T20:06:37.195141+0000","last_peered":"2023-10-16T20:06:37.195141+0000","last_clean":"2023-10-16T20:06:37.195141+0000","last_became_active":"2023-10-16T20:06:32.767368+0000","last_became_peered":"2023-10-16T20:06:32.767368+0000","last_unstale":"2023-10-16T20:06:37.195141+0000","last_undegraded":"2023-10-16T20:06:37.195141+0000","last_fullsized":"2023-10-16T20:06:37.195141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.449240+0000","last_change":"2023-10-16T20:06:36.896747+0000","last_active":"2023-10-16T20:06:38.449240+0000","last_peered":"2023-10-16T20:06:38.449240+0000","last_clean":"2023-10-16T20:06:38.449240+0000","last_became_active":"2023-10-16T20:06:36.896380+0000","last_became_peered":"2023-10-16T20:06:36.896380+0000","last_unstale":"2023-10-16T20:06:38.449240+0000","last_undegraded":"2023-10-16T20:06:38.449240+0000","last_fullsized":"2023-10-16T20:06:38.449240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:53:20.477418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881480+0000","last_change":"2023-10-16T20:06:31.757781+0000","last_active":"2023-10-16T20:06:36.881480+0000","last_peered":"2023-10-16T20:06:36.881480+0000","last_clean":"2023-10-16T20:06:36.881480+0000","last_became_active":"2023-10-16T20:06:31.757507+0000","last_became_peered":"2023-10-16T20:06:31.757507+0000","last_unstale":"2023-10-16T20:06:36.881480+0000","last_undegraded":"2023-10-16T20:06:36.881480+0000","last_fullsized":"2023-10-16T20:06:36.881480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:45:02.885573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884841+0000","last_change":"2023-10-16T20:06:32.762052+0000","last_active":"2023-10-16T20:06:36.884841+0000","last_peered":"2023-10-16T20:06:36.884841+0000","last_clean":"2023-10-16T20:06:36.884841+0000","last_became_active":"2023-10-16T20:06:32.761502+0000","last_became_peered":"2023-10-16T20:06:32.761502+0000","last_unstale":"2023-10-16T20:06:36.884841+0000","last_undegraded":"2023-10-16T20:06:36.884841+0000","last_fullsized":"2023-10-16T20:06:36.884841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:05:51.536004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T20:06:38.356361+0000","last_change":"2023-10-16T20:06:37.196931+0000","last_active":"2023-10-16T20:06:38.356361+0000","last_peered":"2023-10-16T20:06:38.356361+0000","last_clean":"2023-10-16T20:06:38.356361+0000","last_became_active":"2023-10-16T20:06:37.196429+0000","last_became_peered":"2023-10-16T20:06:37.196429+0000","last_unstale":"2023-10-16T20:06:38.356361+0000","last_undegraded":"2023-10-16T20:06:38.356361+0000","last_fullsized":"2023-10-16T20:06:38.356361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:35.859763+0000","last_clean_scrub_stamp":"2023-10-16T20:06:35.859763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:39:01.567948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876429+0000","last_change":"2023-10-16T20:06:31.754869+0000","last_active":"2023-10-16T20:06:36.876429+0000","last_peered":"2023-10-16T20:06:36.876429+0000","last_clean":"2023-10-16T20:06:36.876429+0000","last_became_active":"2023-10-16T20:06:31.754563+0000","last_became_peered":"2023-10-16T20:06:31.754563+0000","last_unstale":"2023-10-16T20:06:36.876429+0000","last_undegraded":"2023-10-16T20:06:36.876429+0000","last_fullsized":"2023-10-16T20:06:36.876429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:30.726358+0000","last_clean_scrub_stamp":"2023-10-16T20:06:30.726358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:28:05.294644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:37.195284+0000","last_change":"2023-10-16T20:06:32.761436+0000","last_active":"2023-10-16T20:06:37.195284+0000","last_peered":"2023-10-16T20:06:37.195284+0000","last_clean":"2023-10-16T20:06:37.195284+0000","last_became_active":"2023-10-16T20:06:32.761077+0000","last_became_peered":"2023-10-16T20:06:32.761077+0000","last_unstale":"2023-10-16T20:06:37.195284+0000","last_undegraded":"2023-10-16T20:06:37.195284+0000","last_fullsized":"2023-10-16T20:06:37.195284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:40.888663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876172+0000","last_change":"2023-10-16T20:06:32.752025+0000","last_active":"2023-10-16T20:06:36.876172+0000","last_peered":"2023-10-16T20:06:36.876172+0000","last_clean":"2023-10-16T20:06:36.876172+0000","last_became_active":"2023-10-16T20:06:32.751719+0000","last_became_peered":"2023-10-16T20:06:32.751719+0000","last_unstale":"2023-10-16T20:06:36.876172+0000","last_undegraded":"2023-10-16T20:06:36.876172+0000","last_fullsized":"2023-10-16T20:06:36.876172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:37.646684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.876358+0000","last_change":"2023-10-16T20:06:32.761262+0000","last_active":"2023-10-16T20:06:36.876358+0000","last_peered":"2023-10-16T20:06:36.876358+0000","last_clean":"2023-10-16T20:06:36.876358+0000","last_became_active":"2023-10-16T20:06:32.760953+0000","last_became_peered":"2023-10-16T20:06:32.760953+0000","last_unstale":"2023-10-16T20:06:36.876358+0000","last_undegraded":"2023-10-16T20:06:36.876358+0000","last_fullsized":"2023-10-16T20:06:36.876358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:20:06.488740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884781+0000","last_change":"2023-10-16T20:06:32.761797+0000","last_active":"2023-10-16T20:06:36.884781+0000","last_peered":"2023-10-16T20:06:36.884781+0000","last_clean":"2023-10-16T20:06:36.884781+0000","last_became_active":"2023-10-16T20:06:32.761070+0000","last_became_peered":"2023-10-16T20:06:32.761070+0000","last_unstale":"2023-10-16T20:06:36.884781+0000","last_undegraded":"2023-10-16T20:06:36.884781+0000","last_fullsized":"2023-10-16T20:06:36.884781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:56.575082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881499+0000","last_change":"2023-10-16T20:06:32.757941+0000","last_active":"2023-10-16T20:06:36.881499+0000","last_peered":"2023-10-16T20:06:36.881499+0000","last_clean":"2023-10-16T20:06:36.881499+0000","last_became_active":"2023-10-16T20:06:32.757491+0000","last_became_peered":"2023-10-16T20:06:32.757491+0000","last_unstale":"2023-10-16T20:06:36.881499+0000","last_undegraded":"2023-10-16T20:06:36.881499+0000","last_fullsized":"2023-10-16T20:06:36.881499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:08:09.863486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893744+0000","last_change":"2023-10-16T20:06:32.757680+0000","last_active":"2023-10-16T20:06:36.893744+0000","last_peered":"2023-10-16T20:06:36.893744+0000","last_clean":"2023-10-16T20:06:36.893744+0000","last_became_active":"2023-10-16T20:06:32.756906+0000","last_became_peered":"2023-10-16T20:06:32.756906+0000","last_unstale":"2023-10-16T20:06:36.893744+0000","last_undegraded":"2023-10-16T20:06:36.893744+0000","last_fullsized":"2023-10-16T20:06:36.893744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:31:55.560826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881387+0000","last_change":"2023-10-16T20:06:32.756667+0000","last_active":"2023-10-16T20:06:36.881387+0000","last_peered":"2023-10-16T20:06:36.881387+0000","last_clean":"2023-10-16T20:06:36.881387+0000","last_became_active":"2023-10-16T20:06:32.756338+0000","last_became_peered":"2023-10-16T20:06:32.756338+0000","last_unstale":"2023-10-16T20:06:36.881387+0000","last_undegraded":"2023-10-16T20:06:36.881387+0000","last_fullsized":"2023-10-16T20:06:36.881387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.878209+0000","last_change":"2023-10-16T20:06:32.761903+0000","last_active":"2023-10-16T20:06:36.878209+0000","last_peered":"2023-10-16T20:06:36.878209+0000","last_clean":"2023-10-16T20:06:36.878209+0000","last_became_active":"2023-10-16T20:06:32.761404+0000","last_became_peered":"2023-10-16T20:06:32.761404+0000","last_unstale":"2023-10-16T20:06:36.878209+0000","last_undegraded":"2023-10-16T20:06:36.878209+0000","last_fullsized":"2023-10-16T20:06:36.878209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:24:56.975322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893877+0000","last_change":"2023-10-16T20:06:32.759025+0000","last_active":"2023-10-16T20:06:36.893877+0000","last_peered":"2023-10-16T20:06:36.893877+0000","last_clean":"2023-10-16T20:06:36.893877+0000","last_became_active":"2023-10-16T20:06:32.757378+0000","last_became_peered":"2023-10-16T20:06:32.757378+0000","last_unstale":"2023-10-16T20:06:36.893877+0000","last_undegraded":"2023-10-16T20:06:36.893877+0000","last_fullsized":"2023-10-16T20:06:36.893877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:28:50.170743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884696+0000","last_change":"2023-10-16T20:06:32.765641+0000","last_active":"2023-10-16T20:06:36.884696+0000","last_peered":"2023-10-16T20:06:36.884696+0000","last_clean":"2023-10-16T20:06:36.884696+0000","last_became_active":"2023-10-16T20:06:32.765108+0000","last_became_peered":"2023-10-16T20:06:32.765108+0000","last_unstale":"2023-10-16T20:06:36.884696+0000","last_undegraded":"2023-10-16T20:06:36.884696+0000","last_fullsized":"2023-10-16T20:06:36.884696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:46.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.893441+0000","last_change":"2023-10-16T20:06:32.760384+0000","last_active":"2023-10-16T20:06:36.893441+0000","last_peered":"2023-10-16T20:06:36.893441+0000","last_clean":"2023-10-16T20:06:36.893441+0000","last_became_active":"2023-10-16T20:06:32.760069+0000","last_became_peered":"2023-10-16T20:06:32.760069+0000","last_unstale":"2023-10-16T20:06:36.893441+0000","last_undegraded":"2023-10-16T20:06:36.893441+0000","last_fullsized":"2023-10-16T20:06:36.893441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.884891+0000","last_change":"2023-10-16T20:06:32.769882+0000","last_active":"2023-10-16T20:06:36.884891+0000","last_peered":"2023-10-16T20:06:36.884891+0000","last_clean":"2023-10-16T20:06:36.884891+0000","last_became_active":"2023-10-16T20:06:32.769593+0000","last_became_peered":"2023-10-16T20:06:32.769593+0000","last_unstale":"2023-10-16T20:06:36.884891+0000","last_undegraded":"2023-10-16T20:06:36.884891+0000","last_fullsized":"2023-10-16T20:06:36.884891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:04.642084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.881557+0000","last_change":"2023-10-16T20:06:32.762249+0000","last_active":"2023-10-16T20:06:36.881557+0000","last_peered":"2023-10-16T20:06:36.881557+0000","last_clean":"2023-10-16T20:06:36.881557+0000","last_became_active":"2023-10-16T20:06:32.761895+0000","last_became_peered":"2023-10-16T20:06:32.761895+0000","last_unstale":"2023-10-16T20:06:36.881557+0000","last_undegraded":"2023-10-16T20:06:36.881557+0000","last_fullsized":"2023-10-16T20:06:36.881557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:51:14.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T20:06:36.877279+0000","last_change":"2023-10-16T20:06:32.755725+0000","last_active":"2023-10-16T20:06:36.877279+0000","last_peered":"2023-10-16T20:06:36.877279+0000","last_clean":"2023-10-16T20:06:36.877279+0000","last_became_active":"2023-10-16T20:06:32.755462+0000","last_became_peered":"2023-10-16T20:06:32.755462+0000","last_unstale":"2023-10-16T20:06:36.877279+0000","last_undegraded":"2023-10-16T20:06:36.877279+0000","last_fullsized":"2023-10-16T20:06:36.877279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:31.731258+0000","last_clean_scrub_stamp":"2023-10-16T20:06:31.731258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:22.618540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":697134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":106344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":697190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":106184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":110026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":106310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":106274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:06:56.133 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T20:06:56.133 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T20:06:56.134 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T20:06:56.134 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T20:06:56.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.284+0000 7f81cd7b2700 1 Processor -- start 2023-10-16T20:06:56.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.284+0000 7f81cd7b2700 1 -- start start 2023-10-16T20:06:56.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81cd7b2700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 0x7f81c806e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81cd7b2700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c806ec50 con 0x7f81c806b430 2023-10-16T20:06:56.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81cd7b2700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c8158120 con 0x7f81c8071210 2023-10-16T20:06:56.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81cd7b2700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c806cd80 con 0x7f81c806bf80 2023-10-16T20:06:56.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81c67fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f81c806b430 0x7f81c8161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39360/0 (socket says 172.21.15.152:39360) 2023-10-16T20:06:56.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81c67fc700 1 -- 172.21.15.152:0/2313456529 learned_addr learned my addr 172.21.15.152:0/2313456529 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:56.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81c77fe700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 0x7f81c806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.285+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439032817 0 0) 0x7f81c806ec50 con 0x7f81c806b430 2023-10-16T20:06:56.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b00035b0 con 0x7f81c806b430 2023-10-16T20:06:56.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682448128 0 0) 0x7f81c8158120 con 0x7f81c8071210 2023-10-16T20:06:56.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c806ec50 con 0x7f81c8071210 2023-10-16T20:06:56.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873051952 0 0) 0x7f81b00035b0 con 0x7f81c806b430 2023-10-16T20:06:56.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 msgr2=0x7f81c806e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:56.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 0x7f81c806e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 >> v1:172.21.15.163:6789/0 conn(0x7f81c8071210 legacy=0x7f81c80715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c806e970 con 0x7f81c806b430 2023-10-16T20:06:56.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f81b8001670 con 0x7f81c806b430 2023-10-16T20:06:56.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 >> v1:172.21.15.152:6789/0 conn(0x7f81c806b430 legacy=0x7f81c8161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81b0003bc0 0x7f81b0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b0004850 0x7f81b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 0x7f81b0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c806cd80 con 0x7f81b0004850 2023-10-16T20:06:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b000bb20 con 0x7f81b0003bc0 2023-10-16T20:06:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b000bce0 con 0x7f81c806bf80 2023-10-16T20:06:56.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b0004850 0x7f81b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c6ffd700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81b0003bc0 0x7f81b0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c77fe700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 0x7f81b0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 -- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 msgr2=0x7f81b0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:56.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81c806bf80 0x7f81b0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 -- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81b0003bc0 msgr2=0x7f81b0003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:56.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81b0003bc0 0x7f81b0003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 -- 172.21.15.152:0/2313456529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b00035b0 con 0x7f81b0004850 2023-10-16T20:06:56.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.286+0000 7f81c67fc700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b0004850 0x7f81b0004cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c210 tx=0x7f81b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8a2579111c70f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:56.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800cd50 con 0x7f81b0004850 2023-10-16T20:06:56.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8005960 con 0x7f81b0004850 2023-10-16T20:06:56.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81c5ffb700 1 -- 172.21.15.152:0/2313456529 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8005d10 con 0x7f81b0004850 2023-10-16T20:06:56.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81cd7b2700 1 -- 172.21.15.152:0/2313456529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b0004850 msgr2=0x7f81b0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/2313456529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81b0004850 0x7f81b0004cd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c210 tx=0x7f81b0005880 comp rx=0 tx=0).stop 2023-10-16T20:06:56.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81c77fe700 1 -- 172.21.15.152:0/2313456529 reap_dead start 2023-10-16T20:06:56.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81cd7b2700 1 -- 172.21.15.152:0/2313456529 shutdown_connections 2023-10-16T20:06:56.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81cd7b2700 1 -- 172.21.15.152:0/2313456529 >> 172.21.15.152:0/2313456529 conn(0x7f81c80cfcd0 msgr2=0x7f81c80d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:56.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81cd7b2700 1 -- 172.21.15.152:0/2313456529 shutdown_connections 2023-10-16T20:06:56.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.287+0000 7f81cd7b2700 1 -- 172.21.15.152:0/2313456529 wait complete. 2023-10-16T20:06:56.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.288+0000 7f81cd7b2700 1 Processor -- start 2023-10-16T20:06:56.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 -- start start 2023-10-16T20:06:56.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81b0004850 0x7f81c80c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 0x7f81c81f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81c8152280 0x7f81c80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c81f7690 con 0x7f81c80c5dc0 2023-10-16T20:06:56.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80c9690 con 0x7f81c8152280 2023-10-16T20:06:56.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81cd7b2700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8152700 con 0x7f81b0004850 2023-10-16T20:06:56.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81c67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 0x7f81c81f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81c67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 0x7f81c81f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59174/0 (socket says 172.21.15.152:59174) 2023-10-16T20:06:56.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81c67fc700 1 -- 172.21.15.152:0/1529936652 learned_addr learned my addr 172.21.15.152:0/1529936652 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:56.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81c6ffd700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81b0004850 0x7f81c80c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.289+0000 7f81c77fe700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81c8152280 0x7f81c80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c67fc700 1 -- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81b0004850 msgr2=0x7f81c80c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c67fc700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81b0004850 0x7f81c80c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c67fc700 1 -- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81c8152280 msgr2=0x7f81c80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c67fc700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81c8152280 0x7f81c80b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c67fc700 1 -- 172.21.15.152:0/1529936652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80c4d20 con 0x7f81c80c5dc0 2023-10-16T20:06:56.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c77fe700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81c8152280 0x7f81c80b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:56.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81c67fc700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 0x7f81c81f7150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c800 tx=0x7f81b8001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:56.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8004870 con 0x7f81c80c5dc0 2023-10-16T20:06:56.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b80049d0 con 0x7f81c80c5dc0 2023-10-16T20:06:56.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c80c5000 con 0x7f81c80c5dc0 2023-10-16T20:06:56.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8004d40 con 0x7f81c80c5dc0 2023-10-16T20:06:56.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.290+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c80c55c0 con 0x7f81c80c5dc0 2023-10-16T20:06:56.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.291+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c80c5c10 con 0x7f81c80c5dc0 2023-10-16T20:06:56.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.291+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81b80070d0 con 0x7f81c80c5dc0 2023-10-16T20:06:56.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.292+0000 7f81af7fe700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f81b406af00 0x7f81b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.292+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81b808aa00 con 0x7f81c80c5dc0 2023-10-16T20:06:56.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.292+0000 7f81c6ffd700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f81b406af00 0x7f81b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.292+0000 7f81c6ffd700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f81b406af00 0x7f81b406d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81c81f66a0 tx=0x7f81bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:56.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.296+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81b8055850 con 0x7f81c80c5dc0 2023-10-16T20:06:56.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.528+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81c806a920 con 0x7f81c80c5dc0 2023-10-16T20:06:56.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.529+0000 7f81af7fe700 1 -- 172.21.15.152:0/1529936652 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f81b8058e70 con 0x7f81c80c5dc0 2023-10-16T20:06:56.531 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:56.531 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T20:06:56.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f81b406af00 msgr2=0x7f81b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f81b406af00 0x7f81b406d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f81c81f66a0 tx=0x7f81bc009040 comp rx=0 tx=0).stop 2023-10-16T20:06:56.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 msgr2=0x7f81c81f7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 0x7f81c81f7150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f81b800c800 tx=0x7f81b8001980 comp rx=0 tx=0).stop 2023-10-16T20:06:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 shutdown_connections 2023-10-16T20:06:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f81b406af00 0x7f81b406d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f81b0004850 0x7f81c80c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81c8152280 0x7f81c80b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 --2- 172.21.15.152:0/1529936652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81c80c5dc0 0x7f81c81f7150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 >> 172.21.15.152:0/1529936652 conn(0x7f81c80cfcd0 msgr2=0x7f81c8152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:56.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 shutdown_connections 2023-10-16T20:06:56.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.531+0000 7f81cd7b2700 1 -- 172.21.15.152:0/1529936652 wait complete. 2023-10-16T20:06:56.545 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T20:06:56.545 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:56.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.664+0000 7fea67583700 1 Processor -- start 2023-10-16T20:06:56.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.664+0000 7fea67583700 1 -- start start 2023-10-16T20:06:56.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea67583700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fea600cd4b0 0x7fea6006e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea67583700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea600cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea67583700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6015ec80 con 0x7fea6006d070 2023-10-16T20:06:56.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea67583700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea60161260 con 0x7fea600cd4b0 2023-10-16T20:06:56.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea67583700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60161b00 con 0x7fea6006bf80 2023-10-16T20:06:56.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea64b1e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea600cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea6531f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fea600cd4b0 0x7fea6006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea65b20700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fea6006d070 0x7fea6006d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54562/0 (socket says 172.21.15.152:54562) 2023-10-16T20:06:56.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea65b20700 1 -- 172.21.15.152:0/860476792 learned_addr learned my addr 172.21.15.152:0/860476792 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:56.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea64b1e700 1 -- 172.21.15.152:0/860476792 >> v2:172.21.15.163:3300/0 conn(0x7fea600cd4b0 msgr2=0x7fea6006e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:56.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea64b1e700 1 --2- 172.21.15.152:0/860476792 >> v2:172.21.15.163:3300/0 conn(0x7fea600cd4b0 0x7fea6006e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea64b1e700 1 -- 172.21.15.152:0/860476792 >> v1:172.21.15.163:6789/0 conn(0x7fea6006d070 legacy=0x7fea6006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea64b1e700 1 -- 172.21.15.152:0/860476792 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6006e7d0 con 0x7fea6006bf80 2023-10-16T20:06:56.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.665+0000 7fea64b1e700 1 --2- 172.21.15.152:0/860476792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea600cd890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea50009840 tx=0x7fea50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb39febacc4cbf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:56.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea57fff700 1 -- 172.21.15.152:0/860476792 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50011830 con 0x7fea6006bf80 2023-10-16T20:06:56.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea57fff700 1 -- 172.21.15.152:0/860476792 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50011990 con 0x7fea6006bf80 2023-10-16T20:06:56.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea57fff700 1 -- 172.21.15.152:0/860476792 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50011d20 con 0x7fea6006bf80 2023-10-16T20:06:56.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 -- 172.21.15.152:0/860476792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 msgr2=0x7fea600cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 --2- 172.21.15.152:0/860476792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea600cd890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea50009840 tx=0x7fea50009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:56.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 -- 172.21.15.152:0/860476792 shutdown_connections 2023-10-16T20:06:56.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 --2- 172.21.15.152:0/860476792 >> v2:172.21.15.163:3300/0 conn(0x7fea600cd4b0 0x7fea6006e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 --2- 172.21.15.152:0/860476792 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea600cd890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 -- 172.21.15.152:0/860476792 >> 172.21.15.152:0/860476792 conn(0x7fea600cfcd0 msgr2=0x7fea600d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:56.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 -- 172.21.15.152:0/860476792 shutdown_connections 2023-10-16T20:06:56.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.666+0000 7fea67583700 1 -- 172.21.15.152:0/860476792 wait complete. 2023-10-16T20:06:56.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.667+0000 7fea67583700 1 Processor -- start 2023-10-16T20:06:56.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.667+0000 7fea67583700 1 -- start start 2023-10-16T20:06:56.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea67583700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea601e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea67583700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 0x7fea601f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea67583700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea600cd4b0 0x7fea601f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea67583700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600ae1e0 con 0x7fea6006d070 2023-10-16T20:06:56.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea67583700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600ad560 con 0x7fea600cd4b0 2023-10-16T20:06:56.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea67583700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600ad840 con 0x7fea6006bf80 2023-10-16T20:06:56.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea64b1e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 0x7fea601f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea64b1e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 0x7fea601f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59188/0 (socket says 172.21.15.152:59188) 2023-10-16T20:06:56.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea64b1e700 1 -- 172.21.15.152:0/3994449926 learned_addr learned my addr 172.21.15.152:0/3994449926 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:56.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea65b20700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea600cd4b0 0x7fea601f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.668+0000 7fea6531f700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea601e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea64b1e700 1 -- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 msgr2=0x7fea601e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea64b1e700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea601e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea64b1e700 1 -- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea600cd4b0 msgr2=0x7fea601f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea64b1e700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea600cd4b0 0x7fea601f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea64b1e700 1 -- 172.21.15.152:0/3994449926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500094a0 con 0x7fea6006d070 2023-10-16T20:06:56.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea64b1e700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 0x7fea601f6550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea50009fd0 tx=0x7fea50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:56.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500036a0 con 0x7fea6006d070 2023-10-16T20:06:56.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5001f070 con 0x7fea6006d070 2023-10-16T20:06:56.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea600adb20 con 0x7fea6006d070 2023-10-16T20:06:56.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003a60 con 0x7fea6006d070 2023-10-16T20:06:56.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.669+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea60156ad0 con 0x7fea6006d070 2023-10-16T20:06:56.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.670+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6004ebb0 con 0x7fea6006d070 2023-10-16T20:06:56.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.670+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea50003bc0 con 0x7fea6006d070 2023-10-16T20:06:56.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.671+0000 7fea55ffb700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fea4406af00 0x7fea4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:56.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.671+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea50021070 con 0x7fea6006d070 2023-10-16T20:06:56.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.671+0000 7fea6531f700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fea4406af00 0x7fea4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:56.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.671+0000 7fea6531f700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fea4406af00 0x7fea4406d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea601545e0 tx=0x7fea5c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:56.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.675+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea50055d90 con 0x7fea6006d070 2023-10-16T20:06:56.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.869+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea6015d6b0 con 0x7fea6006d070 2023-10-16T20:06:56.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.870+0000 7fea55ffb700 1 -- 172.21.15.152:0/3994449926 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fea50015020 con 0x7fea6006d070 2023-10-16T20:06:56.872 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:56.872 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:56.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fea4406af00 msgr2=0x7fea4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fea4406af00 0x7fea4406d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea601545e0 tx=0x7fea5c009210 comp rx=0 tx=0).stop 2023-10-16T20:06:56.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 msgr2=0x7fea601f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:56.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 0x7fea601f6550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea50009fd0 tx=0x7fea50004750 comp rx=0 tx=0).stop 2023-10-16T20:06:56.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 shutdown_connections 2023-10-16T20:06:56.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fea4406af00 0x7fea4406d3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fea6006bf80 0x7fea601e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea600cd4b0 0x7fea601f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 --2- 172.21.15.152:0/3994449926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea6006d070 0x7fea601f6550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:56.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 >> 172.21.15.152:0/3994449926 conn(0x7fea600cfcd0 msgr2=0x7fea60153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:56.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 shutdown_connections 2023-10-16T20:06:56.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:56.872+0000 7fea67583700 1 -- 172.21.15.152:0/3994449926 wait complete. 2023-10-16T20:06:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:06:56.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:06:57.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.010+0000 7f9dc26ad700 1 Processor -- start 2023-10-16T20:06:57.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.010+0000 7f9dc26ad700 1 -- start start 2023-10-16T20:06:57.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.011+0000 7f9dc26ad700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9dbc15a250 0x7f9dbc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.011+0000 7f9dc26ad700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9dbc06dcc0 0x7f9dbc0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.011+0000 7f9dc26ad700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dbc0cba90 con 0x7f9dbc15dec0 2023-10-16T20:06:57.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.011+0000 7f9dc26ad700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc0cb510 con 0x7f9dbc15a250 2023-10-16T20:06:57.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.011+0000 7f9dc26ad700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dbc15ee40 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9dbc15a250 0x7f9dbc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9dbc15a250 0x7f9dbc0717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59194/0 (socket says 172.21.15.152:59194) 2023-10-16T20:06:57.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 -- 172.21.15.152:0/3918977913 learned_addr learned my addr 172.21.15.152:0/3918977913 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:57.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 -- 172.21.15.152:0/3918977913 >> v2:172.21.15.163:3300/0 conn(0x7f9dbc06dcc0 msgr2=0x7f9dbc0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:57.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dc0c4a700 1 --2- 172.21.15.152:0/3918977913 >> v2:172.21.15.163:3300/0 conn(0x7f9dbc06dcc0 0x7f9dbc0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 --2- 172.21.15.152:0/3918977913 >> v2:172.21.15.163:3300/0 conn(0x7f9dbc06dcc0 0x7f9dbc0cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 -- 172.21.15.152:0/3918977913 >> v1:172.21.15.163:6789/0 conn(0x7f9dbc15dec0 legacy=0x7f9dbc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:57.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 -- 172.21.15.152:0/3918977913 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc15e880 con 0x7f9dbc15a250 2023-10-16T20:06:57.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbbfff700 1 --2- 172.21.15.152:0/3918977913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc15a250 0x7f9dbc0717b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc067ac0 tx=0x7f9dac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77c31ab9753e779 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbaffd700 1 -- 172.21.15.152:0/3918977913 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac004230 con 0x7f9dbc15a250 2023-10-16T20:06:57.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbaffd700 1 -- 172.21.15.152:0/3918977913 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac004390 con 0x7f9dbc15a250 2023-10-16T20:06:57.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.012+0000 7f9dbaffd700 1 -- 172.21.15.152:0/3918977913 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0036a0 con 0x7f9dbc15a250 2023-10-16T20:06:57.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 -- 172.21.15.152:0/3918977913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc15a250 msgr2=0x7f9dbc0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/3918977913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc15a250 0x7f9dbc0717b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc067ac0 tx=0x7f9dac009bd0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 -- 172.21.15.152:0/3918977913 shutdown_connections 2023-10-16T20:06:57.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/3918977913 >> v2:172.21.15.163:3300/0 conn(0x7f9dbc06dcc0 0x7f9dbc0cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/3918977913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc15a250 0x7f9dbc0717b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 -- 172.21.15.152:0/3918977913 >> 172.21.15.152:0/3918977913 conn(0x7f9dbc0ccbe0 msgr2=0x7f9dbc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:57.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 -- 172.21.15.152:0/3918977913 shutdown_connections 2023-10-16T20:06:57.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.013+0000 7f9dc26ad700 1 -- 172.21.15.152:0/3918977913 wait complete. 2023-10-16T20:06:57.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.014+0000 7f9dc26ad700 1 Processor -- start 2023-10-16T20:06:57.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.014+0000 7f9dc26ad700 1 -- start start 2023-10-16T20:06:57.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc26ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 0x7f9dbc0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc26ad700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9dbc15a250 0x7f9dbc06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc26ad700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dbc15dec0 0x7f9dbc06f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc26ad700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1f0a30 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc26ad700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0b4e40 con 0x7f9dbc15dec0 2023-10-16T20:06:57.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc26ad700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc1f0750 con 0x7f9dbc15a250 2023-10-16T20:06:57.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 0x7f9dbc0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 0x7f9dbc0b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59200/0 (socket says 172.21.15.152:59200) 2023-10-16T20:06:57.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 -- 172.21.15.152:0/1203278106 learned_addr learned my addr 172.21.15.152:0/1203278106 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:57.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dc0c4a700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dbc15dec0 0x7f9dbc06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbb7fe700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9dbc15a250 0x7f9dbc06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 -- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9dbc15a250 msgr2=0x7f9dbc06f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9dbc15a250 0x7f9dbc06f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 -- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dbc15dec0 msgr2=0x7f9dbc06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dbc15dec0 0x7f9dbc06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.015+0000 7f9dbbfff700 1 -- 172.21.15.152:0/1203278106 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac009550 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.016+0000 7f9dbbfff700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 0x7f9dbc0b3310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc067ec0 tx=0x7f9dac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.016+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac003c90 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.016+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac020070 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.016+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc0b50a0 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.016+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac013840 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.016+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc0b5660 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.017+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc04ebb0 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.017+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9dac022030 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.018+0000 7f9db8ff9700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9da806af00 0x7f9da806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.018+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9dac08d3d0 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.018+0000 7f9dbb7fe700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9da806af00 0x7f9da806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.018+0000 7f9dbb7fe700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9da806af00 0x7f9da806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0b0400 tx=0x7f9db0007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.022+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9dac058180 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.211+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9dbc0b60e0 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.212+0000 7f9db8ff9700 1 -- 172.21.15.152:0/1203278106 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9dac05b7a0 con 0x7f9dbc06dcc0 2023-10-16T20:06:57.214 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:06:57.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9da806af00 msgr2=0x7f9da806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9da806af00 0x7f9da806d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0b0400 tx=0x7f9db0007ec0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 msgr2=0x7f9dbc0b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 0x7f9dbc0b3310 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc067ec0 tx=0x7f9dac004750 comp rx=0 tx=0).stop 2023-10-16T20:06:57.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 shutdown_connections 2023-10-16T20:06:57.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9da806af00 0x7f9da806d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dbc15dec0 0x7f9dbc06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dbc06dcc0 0x7f9dbc0b3310 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 --2- 172.21.15.152:0/1203278106 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9dbc15a250 0x7f9dbc06f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 >> 172.21.15.152:0/1203278106 conn(0x7f9dbc0ccbe0 msgr2=0x7f9dbc0cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:57.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 shutdown_connections 2023-10-16T20:06:57.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.214+0000 7f9dc26ad700 1 -- 172.21.15.152:0/1203278106 wait complete. 2023-10-16T20:06:57.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:06:57.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.350+0000 7fa8d2afa700 1 Processor -- start 2023-10-16T20:06:57.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.350+0000 7fa8d2afa700 1 -- start start 2023-10-16T20:06:57.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8d2afa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8d2afa700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc161360 con 0x7fa8cc06a820 2023-10-16T20:06:57.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8d2afa700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc06b750 con 0x7fa8cc0cdd30 2023-10-16T20:06:57.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8d2afa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc06dcc0 con 0x7fa8cc06b370 2023-10-16T20:06:57.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8cbfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa8cc06a820 0x7fa8cc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39406/0 (socket says 172.21.15.152:39406) 2023-10-16T20:06:57.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8cbfff700 1 -- 172.21.15.152:0/1560964289 learned_addr learned my addr 172.21.15.152:0/1560964289 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:57.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.351+0000 7fa8d0896700 1 --2- 172.21.15.152:0/1560964289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564580377 0 0) 0x7fa8cc161360 con 0x7fa8cc06a820 2023-10-16T20:06:57.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc0035b0 con 0x7fa8cc06a820 2023-10-16T20:06:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873021812 0 0) 0x7fa8cc06b750 con 0x7fa8cc0cdd30 2023-10-16T20:06:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8cc161360 con 0x7fa8cc0cdd30 2023-10-16T20:06:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8d0896700 1 -- 172.21.15.152:0/1560964289 >> v1:172.21.15.163:6789/0 conn(0x7fa8cc0cdd30 legacy=0x7fa8cc1617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8d0896700 1 -- 172.21.15.152:0/1560964289 >> v1:172.21.15.152:6789/0 conn(0x7fa8cc06a820 legacy=0x7fa8cc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8d0896700 1 -- 172.21.15.152:0/1560964289 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc15e300 con 0x7fa8cc06b370 2023-10-16T20:06:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8d0896700 1 --2- 172.21.15.152:0/1560964289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc15dcb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009870 tx=0x7fa8c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92cb52a97a15039d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0011830 con 0x7fa8cc06b370 2023-10-16T20:06:57.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c0011990 con 0x7fa8cc06b370 2023-10-16T20:06:57.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.352+0000 7fa8cb7fe700 1 -- 172.21.15.152:0/1560964289 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0011d20 con 0x7fa8cc06b370 2023-10-16T20:06:57.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 -- 172.21.15.152:0/1560964289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 msgr2=0x7fa8cc15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/1560964289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc15dcb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009870 tx=0x7fa8c0009b80 comp rx=0 tx=0).stop 2023-10-16T20:06:57.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 -- 172.21.15.152:0/1560964289 shutdown_connections 2023-10-16T20:06:57.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/1560964289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc15dcb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 -- 172.21.15.152:0/1560964289 >> 172.21.15.152:0/1560964289 conn(0x7fa8cc0ccbe0 msgr2=0x7fa8cc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:57.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 -- 172.21.15.152:0/1560964289 shutdown_connections 2023-10-16T20:06:57.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.353+0000 7fa8d2afa700 1 -- 172.21.15.152:0/1560964289 wait complete. 2023-10-16T20:06:57.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.354+0000 7fa8d2afa700 1 Processor -- start 2023-10-16T20:06:57.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.354+0000 7fa8d2afa700 1 -- start start 2023-10-16T20:06:57.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d2afa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 0x7fa8cc15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d2afa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d2afa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8cc0cdd30 0x7fa8cc0ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d2afa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0aea80 con 0x7fa8cc06a820 2023-10-16T20:06:57.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d2afa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0ae850 con 0x7fa8cc0cdd30 2023-10-16T20:06:57.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d2afa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc15a320 con 0x7fa8cc06b370 2023-10-16T20:06:57.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 0x7fa8cc15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 0x7fa8cc15dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59214/0 (socket says 172.21.15.152:59214) 2023-10-16T20:06:57.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 -- 172.21.15.152:0/3475177247 learned_addr learned my addr 172.21.15.152:0/3475177247 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:57.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d1097700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8cc0cdd30 0x7fa8cc0ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8cbfff700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 -- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 msgr2=0x7fa8cc151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 -- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8cc0cdd30 msgr2=0x7fa8cc0ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8cc0cdd30 0x7fa8cc0ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 -- 172.21.15.152:0/3475177247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00094a0 con 0x7fa8cc06a820 2023-10-16T20:06:57.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.355+0000 7fa8d0896700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 0x7fa8cc15dca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0014040 tx=0x7fa8c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.356+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001a6e0 con 0x7fa8cc06a820 2023-10-16T20:06:57.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.356+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc15a600 con 0x7fa8cc06a820 2023-10-16T20:06:57.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.356+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c001a840 con 0x7fa8cc06a820 2023-10-16T20:06:57.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.356+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c001abb0 con 0x7fa8cc06a820 2023-10-16T20:06:57.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.356+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc15abc0 con 0x7fa8cc06a820 2023-10-16T20:06:57.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.357+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc15ad50 con 0x7fa8cc06a820 2023-10-16T20:06:57.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.357+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8c0022070 con 0x7fa8cc06a820 2023-10-16T20:06:57.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.357+0000 7fa8c97fa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa8b006af00 0x7fa8b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.357+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8c008a430 con 0x7fa8cc06a820 2023-10-16T20:06:57.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.358+0000 7fa8cbfff700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa8b006af00 0x7fa8b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.358+0000 7fa8cbfff700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa8b006af00 0x7fa8b006d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc15f110 tx=0x7fa8b8007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.362+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8c0055220 con 0x7fa8cc06a820 2023-10-16T20:06:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.557+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8cc072d10 con 0x7fa8cc06a820 2023-10-16T20:06:57.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.557+0000 7fa8c97fa700 1 -- 172.21.15.152:0/3475177247 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8c0058840 con 0x7fa8cc06a820 2023-10-16T20:06:57.560 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa8b006af00 msgr2=0x7fa8b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa8b006af00 0x7fa8b006d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc15f110 tx=0x7fa8b8007dc0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 msgr2=0x7fa8cc15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 0x7fa8cc15dca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0014040 tx=0x7fa8c0004750 comp rx=0 tx=0).stop 2023-10-16T20:06:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 shutdown_connections 2023-10-16T20:06:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa8b006af00 0x7fa8b006d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8cc0cdd30 0x7fa8cc0ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8cc06a820 0x7fa8cc15dca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 --2- 172.21.15.152:0/3475177247 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa8cc06b370 0x7fa8cc151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 >> 172.21.15.152:0/3475177247 conn(0x7fa8cc0ccbe0 msgr2=0x7fa8cc15f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 shutdown_connections 2023-10-16T20:06:57.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.559+0000 7fa8d2afa700 1 -- 172.21.15.152:0/3475177247 wait complete. 2023-10-16T20:06:57.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:06:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.695+0000 7fab07466700 1 Processor -- start 2023-10-16T20:06:57.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.696+0000 7fab07466700 1 -- start start 2023-10-16T20:06:57.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.696+0000 7fab07466700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab0015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.696+0000 7fab07466700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fab0006a820 0x7fab0006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab07466700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab00161360 con 0x7fab000cdd30 2023-10-16T20:06:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab07466700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0006b750 con 0x7fab0006a820 2023-10-16T20:06:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab07466700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0015e300 con 0x7fab0006b370 2023-10-16T20:06:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05202700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab0015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05a03700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fab000cdd30 0x7fab001617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54604/0 (socket says 172.21.15.152:54604) 2023-10-16T20:06:57.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab04a01700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fab0006a820 0x7fab0006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05a03700 1 -- 172.21.15.152:0/1910154235 learned_addr learned my addr 172.21.15.152:0/1910154235 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:57.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7faaf7fff700 1 -- 172.21.15.152:0/1910154235 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658240235 0 0) 0x7fab00161360 con 0x7fab000cdd30 2023-10-16T20:06:57.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05202700 1 -- 172.21.15.152:0/1910154235 >> v2:172.21.15.163:3300/0 conn(0x7fab0006a820 msgr2=0x7fab0006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:57.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05202700 1 --2- 172.21.15.152:0/1910154235 >> v2:172.21.15.163:3300/0 conn(0x7fab0006a820 0x7fab0006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05202700 1 -- 172.21.15.152:0/1910154235 >> v1:172.21.15.163:6789/0 conn(0x7fab000cdd30 legacy=0x7fab001617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05202700 1 -- 172.21.15.152:0/1910154235 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0015e5e0 con 0x7fab0006b370 2023-10-16T20:06:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.697+0000 7fab05202700 1 --2- 172.21.15.152:0/1910154235 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab0015dcb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009840 tx=0x7faaf0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba9c7e5e060e5b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7faaf7fff700 1 -- 172.21.15.152:0/1910154235 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011830 con 0x7fab0006b370 2023-10-16T20:06:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7faaf7fff700 1 -- 172.21.15.152:0/1910154235 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0011990 con 0x7fab0006b370 2023-10-16T20:06:57.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7faaf7fff700 1 -- 172.21.15.152:0/1910154235 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011d20 con 0x7fab0006b370 2023-10-16T20:06:57.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 -- 172.21.15.152:0/1910154235 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 msgr2=0x7fab0015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 --2- 172.21.15.152:0/1910154235 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab0015dcb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009840 tx=0x7faaf0009b50 comp rx=0 tx=0).stop 2023-10-16T20:06:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 -- 172.21.15.152:0/1910154235 shutdown_connections 2023-10-16T20:06:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 --2- 172.21.15.152:0/1910154235 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab0015dcb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 --2- 172.21.15.152:0/1910154235 >> v2:172.21.15.163:3300/0 conn(0x7fab0006a820 0x7fab0006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 -- 172.21.15.152:0/1910154235 >> 172.21.15.152:0/1910154235 conn(0x7fab000ccbe0 msgr2=0x7fab000ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:57.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 -- 172.21.15.152:0/1910154235 shutdown_connections 2023-10-16T20:06:57.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.698+0000 7fab07466700 1 -- 172.21.15.152:0/1910154235 wait complete. 2023-10-16T20:06:57.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 Processor -- start 2023-10-16T20:06:57.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 -- start start 2023-10-16T20:06:57.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab0006a820 0x7fab00156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab000cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 0x7fab000cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b47a0 con 0x7fab000cdd30 2023-10-16T20:06:57.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00157040 con 0x7fab0006a820 2023-10-16T20:06:57.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.700+0000 7fab07466700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b49b0 con 0x7fab0006b370 2023-10-16T20:06:57.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 0x7fab000cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 0x7fab000cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59232/0 (socket says 172.21.15.152:59232) 2023-10-16T20:06:57.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 -- 172.21.15.152:0/509867842 learned_addr learned my addr 172.21.15.152:0/509867842 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:57.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab04a01700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab000cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05202700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab0006a820 0x7fab00156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 -- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 msgr2=0x7fab000cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab000cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 -- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab0006a820 msgr2=0x7fab00156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab0006a820 0x7fab00156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 -- 172.21.15.152:0/509867842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00094a0 con 0x7fab000cdd30 2023-10-16T20:06:57.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05202700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab0006a820 0x7fab00156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:57.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab04a01700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab000cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab05a03700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 0x7fab000cc620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faaf8002230 tx=0x7faaf800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800ac20 con 0x7fab000cdd30 2023-10-16T20:06:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800ada0 con 0x7fab000cdd30 2023-10-16T20:06:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab000b4c90 con 0x7fab000cdd30 2023-10-16T20:06:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8007310 con 0x7fab000cdd30 2023-10-16T20:06:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.701+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab000b5250 con 0x7fab000cdd30 2023-10-16T20:06:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.702+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab00072d10 con 0x7fab000cdd30 2023-10-16T20:06:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.703+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faaf8007470 con 0x7fab000cdd30 2023-10-16T20:06:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.703+0000 7faaf5ffb700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faae406af00 0x7faae406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.703+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faaf8089820 con 0x7fab000cdd30 2023-10-16T20:06:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.703+0000 7fab05202700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faae406af00 0x7faae406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.704+0000 7fab05202700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faae406af00 0x7faae406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faaf00090b0 tx=0x7faaf0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:57.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.708+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faaf80545e0 con 0x7fab000cdd30 2023-10-16T20:06:57.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.901+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab0015b660 con 0x7fab000cdd30 2023-10-16T20:06:57.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.901+0000 7faaf5ffb700 1 -- 172.21.15.152:0/509867842 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7faaf80180a0 con 0x7fab000cdd30 2023-10-16T20:06:57.904 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:06:57.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faae406af00 msgr2=0x7faae406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faae406af00 0x7faae406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faaf00090b0 tx=0x7faaf0008030 comp rx=0 tx=0).stop 2023-10-16T20:06:57.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 msgr2=0x7fab000cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:57.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 0x7fab000cc620 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faaf8002230 tx=0x7faaf800a060 comp rx=0 tx=0).stop 2023-10-16T20:06:57.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 shutdown_connections 2023-10-16T20:06:57.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faae406af00 0x7faae406d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab000cdd30 0x7fab000cc620 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab0006a820 0x7fab00156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 --2- 172.21.15.152:0/509867842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fab0006b370 0x7fab000cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:57.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 >> 172.21.15.152:0/509867842 conn(0x7fab000ccbe0 msgr2=0x7fab00157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:57.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 shutdown_connections 2023-10-16T20:06:57.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:57.904+0000 7fab07466700 1 -- 172.21.15.152:0/509867842 wait complete. 2023-10-16T20:06:57.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:06:58.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.040+0000 7fb7e06f7700 1 Processor -- start 2023-10-16T20:06:58.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.040+0000 7fb7e06f7700 1 -- start start 2023-10-16T20:06:58.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.041+0000 7fb7e06f7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d815a250 0x7fb7d80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.041+0000 7fb7e06f7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb7d815dec0 0x7fb7d806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.041+0000 7fb7e06f7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80cba90 con 0x7fb7d815e350 2023-10-16T20:06:58.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.041+0000 7fb7e06f7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d80cb510 con 0x7fb7d815a250 2023-10-16T20:06:58.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.041+0000 7fb7e06f7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d815ee40 con 0x7fb7d815dec0 2023-10-16T20:06:58.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.041+0000 7fb7de493700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d815a250 0x7fb7d80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d815a250 0x7fb7d80717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59236/0 (socket says 172.21.15.152:59236) 2023-10-16T20:06:58.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 -- 172.21.15.152:0/1805262426 learned_addr learned my addr 172.21.15.152:0/1805262426 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:58.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7ddc92700 1 --2- 172.21.15.152:0/1805262426 >> v2:172.21.15.163:3300/0 conn(0x7fb7d815dec0 0x7fb7d806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 -- 172.21.15.152:0/1805262426 >> v2:172.21.15.163:3300/0 conn(0x7fb7d815dec0 msgr2=0x7fb7d806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 --2- 172.21.15.152:0/1805262426 >> v2:172.21.15.163:3300/0 conn(0x7fb7d815dec0 0x7fb7d806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 -- 172.21.15.152:0/1805262426 >> v1:172.21.15.163:6789/0 conn(0x7fb7d815e350 legacy=0x7fb7d80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 -- 172.21.15.152:0/1805262426 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d815e880 con 0x7fb7d815a250 2023-10-16T20:06:58.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7de493700 1 --2- 172.21.15.152:0/1805262426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815a250 0x7fb7d80717b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80af840 tx=0x7fb7c800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae15edf18b53c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7dd491700 1 -- 172.21.15.152:0/1805262426 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800dd30 con 0x7fb7d815a250 2023-10-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7dd491700 1 -- 172.21.15.152:0/1805262426 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800de90 con 0x7fb7d815a250 2023-10-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.042+0000 7fb7dd491700 1 -- 172.21.15.152:0/1805262426 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8010690 con 0x7fb7d815a250 2023-10-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 -- 172.21.15.152:0/1805262426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815a250 msgr2=0x7fb7d80717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/1805262426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815a250 0x7fb7d80717b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80af840 tx=0x7fb7c800be70 comp rx=0 tx=0).stop 2023-10-16T20:06:58.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 -- 172.21.15.152:0/1805262426 shutdown_connections 2023-10-16T20:06:58.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/1805262426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815a250 0x7fb7d80717b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/1805262426 >> v2:172.21.15.163:3300/0 conn(0x7fb7d815dec0 0x7fb7d806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 -- 172.21.15.152:0/1805262426 >> 172.21.15.152:0/1805262426 conn(0x7fb7d80ccbe0 msgr2=0x7fb7d80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:58.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 -- 172.21.15.152:0/1805262426 shutdown_connections 2023-10-16T20:06:58.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.043+0000 7fb7e06f7700 1 -- 172.21.15.152:0/1805262426 wait complete. 2023-10-16T20:06:58.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.044+0000 7fb7e06f7700 1 Processor -- start 2023-10-16T20:06:58.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.044+0000 7fb7e06f7700 1 -- start start 2023-10-16T20:06:58.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7e06f7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d815a250 0x7fb7d80c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7e06f7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7d815dec0 0x7fb7d8071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7e06f7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 0x7fb7d81ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7e06f7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c8680 con 0x7fb7d815e350 2023-10-16T20:06:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7e06f7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c8c40 con 0x7fb7d815a250 2023-10-16T20:06:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7e06f7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8071cd0 con 0x7fb7d815dec0 2023-10-16T20:06:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7dec94700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 0x7fb7d81ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7dec94700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 0x7fb7d81ee480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59246/0 (socket says 172.21.15.152:59246) 2023-10-16T20:06:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7dec94700 1 -- 172.21.15.152:0/3817155111 learned_addr learned my addr 172.21.15.152:0/3817155111 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:58.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7de493700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d815a250 0x7fb7d80c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.045+0000 7fb7ddc92700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7d815dec0 0x7fb7d8071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7dec94700 1 -- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7d815dec0 msgr2=0x7fb7d8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7dec94700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7d815dec0 0x7fb7d8071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7dec94700 1 -- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d815a250 msgr2=0x7fb7d80c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7dec94700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d815a250 0x7fb7d80c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7dec94700 1 -- 172.21.15.152:0/3817155111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c800b7f0 con 0x7fb7d815e350 2023-10-16T20:06:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7de493700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d815a250 0x7fb7d80c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:06:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7dec94700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 0x7fb7d81ee480 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000cc50 tx=0x7fb7d000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0003c00 con 0x7fb7d815e350 2023-10-16T20:06:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0003d60 con 0x7fb7d815e350 2023-10-16T20:06:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000ab60 con 0x7fb7d815e350 2023-10-16T20:06:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8071f70 con 0x7fb7d815e350 2023-10-16T20:06:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.046+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d80c8860 con 0x7fb7d815e350 2023-10-16T20:06:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.047+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d80c8d80 con 0x7fb7d815e350 2023-10-16T20:06:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.047+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb7d000acc0 con 0x7fb7d815e350 2023-10-16T20:06:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.048+0000 7fb7ceffd700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb7bc06af00 0x7fb7bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.048+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7d00898a0 con 0x7fb7d815e350 2023-10-16T20:06:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.048+0000 7fb7de493700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb7bc06af00 0x7fb7bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.048+0000 7fb7de493700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb7bc06af00 0x7fb7bc06d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800b7c0 tx=0x7fb7c8012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.052+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb7d80c8d80 con 0x7fb7d815e350 2023-10-16T20:06:58.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.240+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb7d80c8d80 con 0x7fb7d815e350 2023-10-16T20:06:58.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.240+0000 7fb7ceffd700 1 -- 172.21.15.152:0/3817155111 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb7d80c8d80 con 0x7fb7d815e350 2023-10-16T20:06:58.243 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:58.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb7bc06af00 msgr2=0x7fb7bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb7bc06af00 0x7fb7bc06d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800b7c0 tx=0x7fb7c8012000 comp rx=0 tx=0).stop 2023-10-16T20:06:58.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 msgr2=0x7fb7d81ee480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 0x7fb7d81ee480 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000cc50 tx=0x7fb7d000cf60 comp rx=0 tx=0).stop 2023-10-16T20:06:58.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 shutdown_connections 2023-10-16T20:06:58.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb7bc06af00 0x7fb7bc06d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d815e350 0x7fb7d81ee480 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d815a250 0x7fb7d80c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.242+0000 7fb7e06f7700 1 --2- 172.21.15.152:0/3817155111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb7d815dec0 0x7fb7d8071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.243+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 >> 172.21.15.152:0/3817155111 conn(0x7fb7d80ccbe0 msgr2=0x7fb7d80afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:58.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.243+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 shutdown_connections 2023-10-16T20:06:58.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.243+0000 7fb7e06f7700 1 -- 172.21.15.152:0/3817155111 wait complete. 2023-10-16T20:06:58.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:06:58.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.376+0000 7f4276ea4700 1 Processor -- start 2023-10-16T20:06:58.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.376+0000 7f4276ea4700 1 -- start start 2023-10-16T20:06:58.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.376+0000 7f4276ea4700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f42700cd570 0x7f42700cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.376+0000 7f4276ea4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42700cbe10 con 0x7f4270152470 2023-10-16T20:06:58.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4276ea4700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4270070d70 con 0x7f42700b3410 2023-10-16T20:06:58.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4276ea4700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4270071200 con 0x7f42700cd570 2023-10-16T20:06:58.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4274c40700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4270152470 0x7f42700b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39448/0 (socket says 172.21.15.152:39448) 2023-10-16T20:06:58.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4274c40700 1 -- 172.21.15.152:0/441171973 learned_addr learned my addr 172.21.15.152:0/441171973 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:58.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4275441700 1 --2- 172.21.15.152:0/441171973 >> v2:172.21.15.163:3300/0 conn(0x7f42700cd570 0x7f42700cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951805735 0 0) 0x7f42700cbe10 con 0x7f4270152470 2023-10-16T20:06:58.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42600035b0 con 0x7f4270152470 2023-10-16T20:06:58.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335384442 0 0) 0x7f42600035b0 con 0x7f4270152470 2023-10-16T20:06:58.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 >> v2:172.21.15.163:3300/0 conn(0x7f42700cd570 msgr2=0x7f42700cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:58.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 --2- 172.21.15.152:0/441171973 >> v2:172.21.15.163:3300/0 conn(0x7f42700cd570 0x7f42700cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 >> v1:172.21.15.163:6789/0 conn(0x7f42700b3410 legacy=0x7f42700b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427015c990 con 0x7f4270152470 2023-10-16T20:06:58.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f4264001670 con 0x7f4270152470 2023-10-16T20:06:58.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 >> v1:172.21.15.152:6789/0 conn(0x7f4270152470 legacy=0x7f42700b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4260003a00 0x7f4260003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4260004850 0x7f4260004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260005330 0x7f426000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270071200 con 0x7f4260003a00 2023-10-16T20:06:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426000c200 con 0x7f4260004850 2023-10-16T20:06:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426000c3c0 con 0x7f4260005330 2023-10-16T20:06:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4274c40700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4260003a00 0x7f4260003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f426ffff700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4260004850 0x7f4260004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.377+0000 7f4275441700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260005330 0x7f426000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4274c40700 1 -- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260005330 msgr2=0x7f426000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:58.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4274c40700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260005330 0x7f426000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4274c40700 1 -- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4260004850 msgr2=0x7f4260004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:58.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4274c40700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4260004850 0x7f4260004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4275441700 1 -- 172.21.15.152:0/441171973 reap_dead start 2023-10-16T20:06:58.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4274c40700 1 -- 172.21.15.152:0/441171973 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600035b0 con 0x7f4260003a00 2023-10-16T20:06:58.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4274c40700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4260003a00 0x7f4260003e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f426400c270 tx=0x7f4260005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4de7f73238c7d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264007c10 con 0x7f4260003a00 2023-10-16T20:06:58.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400cd30 con 0x7f4260003a00 2023-10-16T20:06:58.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f426f7fe700 1 -- 172.21.15.152:0/441171973 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400cea0 con 0x7f4260003a00 2023-10-16T20:06:58.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4276ea4700 1 -- 172.21.15.152:0/441171973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4260003a00 msgr2=0x7f4260003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4276ea4700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4260003a00 0x7f4260003e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f426400c270 tx=0x7f4260005880 comp rx=0 tx=0).stop 2023-10-16T20:06:58.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4276ea4700 1 -- 172.21.15.152:0/441171973 shutdown_connections 2023-10-16T20:06:58.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4276ea4700 1 --2- 172.21.15.152:0/441171973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4260003a00 0x7f4260003e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.378+0000 7f4276ea4700 1 -- 172.21.15.152:0/441171973 >> 172.21.15.152:0/441171973 conn(0x7f42700cdd00 msgr2=0x7f42700ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.379+0000 7f4276ea4700 1 -- 172.21.15.152:0/441171973 shutdown_connections 2023-10-16T20:06:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.379+0000 7f4276ea4700 1 -- 172.21.15.152:0/441171973 wait complete. 2023-10-16T20:06:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.380+0000 7f4276ea4700 1 Processor -- start 2023-10-16T20:06:58.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.380+0000 7f4276ea4700 1 -- start start 2023-10-16T20:06:58.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260003a00 0x7f42700c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 0x7f42700c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42700c5780 0x7f42700c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42700c6170 con 0x7f4270158950 2023-10-16T20:06:58.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42700ca2f0 con 0x7f42700c5780 2023-10-16T20:06:58.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4270158dd0 con 0x7f4260003a00 2023-10-16T20:06:58.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 0x7f42700c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 0x7f42700c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59264/0 (socket says 172.21.15.152:59264) 2023-10-16T20:06:58.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 -- 172.21.15.152:0/2199145433 learned_addr learned my addr 172.21.15.152:0/2199145433 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4275441700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42700c5780 0x7f42700c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4274c40700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260003a00 0x7f42700c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 -- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260003a00 msgr2=0x7f42700c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260003a00 0x7f42700c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 -- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42700c5780 msgr2=0x7f42700c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42700c5780 0x7f42700c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 -- 172.21.15.152:0/2199145433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700ca520 con 0x7f4270158950 2023-10-16T20:06:58.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426ffff700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 0x7f42700c9db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f425c00f880 tx=0x7f425c00fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0050d0 con 0x7f4270158950 2023-10-16T20:06:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c005230 con 0x7f4270158950 2023-10-16T20:06:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c003680 con 0x7f4270158950 2023-10-16T20:06:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42700ca800 con 0x7f4270158950 2023-10-16T20:06:58.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.381+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427006bba0 con 0x7f4270158950 2023-10-16T20:06:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.382+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427006bd60 con 0x7f4270158950 2023-10-16T20:06:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.383+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f425c0037e0 con 0x7f4270158950 2023-10-16T20:06:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.383+0000 7f426d7fa700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f425406af00 0x7f425406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.383+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f425c089580 con 0x7f4270158950 2023-10-16T20:06:58.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.383+0000 7f4274c40700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f425406af00 0x7f425406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.383+0000 7f4274c40700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f425406af00 0x7f425406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4264000c00 tx=0x7f4264007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.387+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f425c054340 con 0x7f4270158950 2023-10-16T20:06:58.621 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.619+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f427006b9e0 con 0x7f4270158950 2023-10-16T20:06:58.622 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.620+0000 7f426d7fa700 1 -- 172.21.15.152:0/2199145433 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f425c057960 con 0x7f4270158950 2023-10-16T20:06:58.622 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:58.622 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:06:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f425406af00 msgr2=0x7f425406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f425406af00 0x7f425406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4264000c00 tx=0x7f4264007000 comp rx=0 tx=0).stop 2023-10-16T20:06:58.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 msgr2=0x7f42700c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 0x7f42700c9db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f425c00f880 tx=0x7f425c00fc40 comp rx=0 tx=0).stop 2023-10-16T20:06:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 shutdown_connections 2023-10-16T20:06:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f425406af00 0x7f425406d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4260003a00 0x7f42700c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42700c5780 0x7f42700c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 --2- 172.21.15.152:0/2199145433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4270158950 0x7f42700c9db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 >> 172.21.15.152:0/2199145433 conn(0x7f42700cdd00 msgr2=0x7f427015cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 shutdown_connections 2023-10-16T20:06:58.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.622+0000 7f4276ea4700 1 -- 172.21.15.152:0/2199145433 wait complete. 2023-10-16T20:06:58.627 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:06:58.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:06:58.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.755+0000 7fe3d0074700 1 Processor -- start 2023-10-16T20:06:58.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.755+0000 7fe3d0074700 1 -- start start 2023-10-16T20:06:58.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3d0074700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3c8152470 0x7fe3c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3d0074700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c80b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3d0074700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c8070d70 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3d0074700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c8071200 con 0x7fe3c8152470 2023-10-16T20:06:58.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3d0074700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80cbd80 con 0x7fe3c80b3410 2023-10-16T20:06:58.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3cde10700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe3c8152470 0x7fe3c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3cd60f700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe3c80cb8d0 0x7fe3c80b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54648/0 (socket says 172.21.15.152:54648) 2023-10-16T20:06:58.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3cd60f700 1 -- 172.21.15.152:0/234341659 learned_addr learned my addr 172.21.15.152:0/234341659 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:58.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3ce611700 1 --2- 172.21.15.152:0/234341659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c80b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3ce611700 1 -- 172.21.15.152:0/234341659 >> v2:172.21.15.163:3300/0 conn(0x7fe3c8152470 msgr2=0x7fe3c80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:58.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3ce611700 1 --2- 172.21.15.152:0/234341659 >> v2:172.21.15.163:3300/0 conn(0x7fe3c8152470 0x7fe3c80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3ce611700 1 -- 172.21.15.152:0/234341659 >> v1:172.21.15.163:6789/0 conn(0x7fe3c80cb8d0 legacy=0x7fe3c80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3ce611700 1 -- 172.21.15.152:0/234341659 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8070440 con 0x7fe3c80b3410 2023-10-16T20:06:58.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.756+0000 7fe3cde10700 1 --2- 172.21.15.152:0/234341659 >> v2:172.21.15.163:3300/0 conn(0x7fe3c8152470 0x7fe3c80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:58.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3ce611700 1 --2- 172.21.15.152:0/234341659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c80b60f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009d90 tx=0x7fe3c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136ae0f74e04039d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3cce0e700 1 -- 172.21.15.152:0/234341659 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000e070 con 0x7fe3c80b3410 2023-10-16T20:06:58.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3cce0e700 1 -- 172.21.15.152:0/234341659 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000bb20 con 0x7fe3c80b3410 2023-10-16T20:06:58.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3cce0e700 1 -- 172.21.15.152:0/234341659 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0012430 con 0x7fe3c80b3410 2023-10-16T20:06:58.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 -- 172.21.15.152:0/234341659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 msgr2=0x7fe3c80b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 --2- 172.21.15.152:0/234341659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c80b60f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009d90 tx=0x7fe3c000b330 comp rx=0 tx=0).stop 2023-10-16T20:06:58.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 -- 172.21.15.152:0/234341659 shutdown_connections 2023-10-16T20:06:58.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 --2- 172.21.15.152:0/234341659 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c80b60f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 --2- 172.21.15.152:0/234341659 >> v2:172.21.15.163:3300/0 conn(0x7fe3c8152470 0x7fe3c80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 -- 172.21.15.152:0/234341659 >> 172.21.15.152:0/234341659 conn(0x7fe3c80cdd00 msgr2=0x7fe3c80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:58.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 -- 172.21.15.152:0/234341659 shutdown_connections 2023-10-16T20:06:58.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.757+0000 7fe3d0074700 1 -- 172.21.15.152:0/234341659 wait complete. 2023-10-16T20:06:58.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 Processor -- start 2023-10-16T20:06:58.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 -- start start 2023-10-16T20:06:58.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 0x7fe3c815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3c8152470 0x7fe3c815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80ca050 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80ca330 con 0x7fe3c8152470 2023-10-16T20:06:58.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.759+0000 7fe3d0074700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80ca610 con 0x7fe3c80b3410 2023-10-16T20:06:58.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 0x7fe3c815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 0x7fe3c815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59276/0 (socket says 172.21.15.152:59276) 2023-10-16T20:06:58.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 -- 172.21.15.152:0/2092480153 learned_addr learned my addr 172.21.15.152:0/2092480153 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:58.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cde10700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3ce611700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3c8152470 0x7fe3c815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 -- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 msgr2=0x7fe3c814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 -- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3c8152470 msgr2=0x7fe3c815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3c8152470 0x7fe3c815ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 -- 172.21.15.152:0/2092480153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40094a0 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3cd60f700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 0x7fe3c815a5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800c490 tx=0x7fe3b800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800cea0 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8005d70 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c0009a70 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80072f0 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.760+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c80cabd0 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.761+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c804ebb0 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.761+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe3b8007450 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.762+0000 7fe3be7fc700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe3ac06af00 0x7fe3ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:58.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.762+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3b8088c30 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.762+0000 7fe3cde10700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe3ac06af00 0x7fe3ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:58.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.762+0000 7fe3cde10700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe3ac06af00 0x7fe3ac06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009cd0 tx=0x7fe3c4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:58.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.766+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3b8053a00 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.957+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c806f630 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.958+0000 7fe3be7fc700 1 -- 172.21.15.152:0/2092480153 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7fe3b8057020 con 0x7fe3c80cb8d0 2023-10-16T20:06:58.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:06:58.960 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:06:58.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe3ac06af00 msgr2=0x7fe3ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe3ac06af00 0x7fe3ac06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009cd0 tx=0x7fe3c4009210 comp rx=0 tx=0).stop 2023-10-16T20:06:58.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 msgr2=0x7fe3c815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:58.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 0x7fe3c815a5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800c490 tx=0x7fe3b800c7a0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 shutdown_connections 2023-10-16T20:06:58.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe3ac06af00 0x7fe3ac06d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe3c80b3410 0x7fe3c814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3c8152470 0x7fe3c815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 --2- 172.21.15.152:0/2092480153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3c80cb8d0 0x7fe3c815a5f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:58.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 >> 172.21.15.152:0/2092480153 conn(0x7fe3c80cdd00 msgr2=0x7fe3c80b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:58.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 shutdown_connections 2023-10-16T20:06:58.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:58.960+0000 7fe3d0074700 1 -- 172.21.15.152:0/2092480153 wait complete. 2023-10-16T20:06:58.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:06:58.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:06:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.097+0000 7f59e7182700 1 Processor -- start 2023-10-16T20:06:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.097+0000 7f59e7182700 1 -- start start 2023-10-16T20:06:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e7182700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59e00b33f0 0x7f59e0168540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e7182700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e01612e0 con 0x7f59e00cee30 2023-10-16T20:06:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e7182700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e01615c0 con 0x7f59e015ef90 2023-10-16T20:06:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e7182700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e01618a0 con 0x7f59e00b33f0 2023-10-16T20:06:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e571f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59e00b33f0 0x7f59e0168540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e4f1e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f59e00cee30 0x7f59e00cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39480/0 (socket says 172.21.15.152:39480) 2023-10-16T20:06:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e4f1e700 1 -- 172.21.15.152:0/2393740537 learned_addr learned my addr 172.21.15.152:0/2393740537 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e571f700 1 -- 172.21.15.152:0/2393740537 >> v1:172.21.15.163:6789/0 conn(0x7f59e015ef90 legacy=0x7f59e00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e571f700 1 -- 172.21.15.152:0/2393740537 >> v1:172.21.15.152:6789/0 conn(0x7f59e00cee30 legacy=0x7f59e00cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e571f700 1 -- 172.21.15.152:0/2393740537 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0161b80 con 0x7f59e00b33f0 2023-10-16T20:06:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59df7fe700 1 -- 172.21.15.152:0/2393740537 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259091797 0 0) 0x7f59e01612e0 con 0x7f59e00cee30 2023-10-16T20:06:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.098+0000 7f59e571f700 1 --2- 172.21.15.152:0/2393740537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e00b33f0 0x7f59e0168540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a438c47687bbc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59df7fe700 1 -- 172.21.15.152:0/2393740537 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800e070 con 0x7f59e00b33f0 2023-10-16T20:06:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59df7fe700 1 -- 172.21.15.152:0/2393740537 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d800bbd0 con 0x7f59e00b33f0 2023-10-16T20:06:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59df7fe700 1 -- 172.21.15.152:0/2393740537 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8012430 con 0x7f59e00b33f0 2023-10-16T20:06:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 -- 172.21.15.152:0/2393740537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e00b33f0 msgr2=0x7f59e0168540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 --2- 172.21.15.152:0/2393740537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e00b33f0 0x7f59e0168540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d800b330 comp rx=0 tx=0).stop 2023-10-16T20:06:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 -- 172.21.15.152:0/2393740537 shutdown_connections 2023-10-16T20:06:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 --2- 172.21.15.152:0/2393740537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e00b33f0 0x7f59e0168540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 -- 172.21.15.152:0/2393740537 >> 172.21.15.152:0/2393740537 conn(0x7f59e00cdce0 msgr2=0x7f59e00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 -- 172.21.15.152:0/2393740537 shutdown_connections 2023-10-16T20:06:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.099+0000 7f59e7182700 1 -- 172.21.15.152:0/2393740537 wait complete. 2023-10-16T20:06:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.100+0000 7f59e7182700 1 Processor -- start 2023-10-16T20:06:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.100+0000 7f59e7182700 1 -- start start 2023-10-16T20:06:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e7182700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59e00b33f0 0x7f59e015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e7182700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59e00cee30 0x7f59e00c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e7182700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 0x7f59e00b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e7182700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e00c94b0 con 0x7f59e015ef90 2023-10-16T20:06:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e7182700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01f2e60 con 0x7f59e00cee30 2023-10-16T20:06:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e7182700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01f39e0 con 0x7f59e00b33f0 2023-10-16T20:06:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e571f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 0x7f59e00b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e571f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 0x7f59e00b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59290/0 (socket says 172.21.15.152:59290) 2023-10-16T20:06:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.101+0000 7f59e571f700 1 -- 172.21.15.152:0/381317771 learned_addr learned my addr 172.21.15.152:0/381317771 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e571f700 1 -- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59e00b33f0 msgr2=0x7f59e015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e571f700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59e00b33f0 0x7f59e015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59dffff700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59e00cee30 0x7f59e00c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e571f700 1 -- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59e00cee30 msgr2=0x7f59e00c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e571f700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59e00cee30 0x7f59e00c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e571f700 1 -- 172.21.15.152:0/381317771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8009a70 con 0x7f59e015ef90 2023-10-16T20:06:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e571f700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 0x7f59e00b5980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f59d8014040 tx=0x7f59d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d801b810 con 0x7f59e015ef90 2023-10-16T20:06:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8020070 con 0x7f59e015ef90 2023-10-16T20:06:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d801bbb0 con 0x7f59e015ef90 2023-10-16T20:06:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e01f3e70 con 0x7f59e015ef90 2023-10-16T20:06:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.102+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e01f3390 con 0x7f59e015ef90 2023-10-16T20:06:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.103+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e004ebb0 con 0x7f59e015ef90 2023-10-16T20:06:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.103+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f59d801bd10 con 0x7f59e015ef90 2023-10-16T20:06:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.104+0000 7f59dd7fa700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f59c406af00 0x7f59c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.104+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59d8022070 con 0x7f59e015ef90 2023-10-16T20:06:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.104+0000 7f59e4f1e700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f59c406af00 0x7f59c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.104+0000 7f59e4f1e700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f59c406af00 0x7f59c406d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59d4000c00 tx=0x7f59d4007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.108+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f59d805a6c0 con 0x7f59e015ef90 2023-10-16T20:06:59.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.299+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59e0161e30 con 0x7f59e015ef90 2023-10-16T20:06:59.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.299+0000 7f59dd7fa700 1 -- 172.21.15.152:0/381317771 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59d802c020 con 0x7f59e015ef90 2023-10-16T20:06:59.302 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:06:59.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.301+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f59c406af00 msgr2=0x7f59c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.301+0000 7f59e7182700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f59c406af00 0x7f59c406d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f59d4000c00 tx=0x7f59d4007990 comp rx=0 tx=0).stop 2023-10-16T20:06:59.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.301+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 msgr2=0x7f59e00b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.301+0000 7f59e7182700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 0x7f59e00b5980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f59d8014040 tx=0x7f59d8004ad0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 shutdown_connections 2023-10-16T20:06:59.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f59c406af00 0x7f59c406d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f59e00b33f0 0x7f59e015c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015ef90 0x7f59e00b5980 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 --2- 172.21.15.152:0/381317771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59e00cee30 0x7f59e00c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 >> 172.21.15.152:0/381317771 conn(0x7f59e00cdce0 msgr2=0x7f59e015dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:59.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 shutdown_connections 2023-10-16T20:06:59.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.302+0000 7f59e7182700 1 -- 172.21.15.152:0/381317771 wait complete. 2023-10-16T20:06:59.316 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:06:59.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.437+0000 7f75e77cc700 1 Processor -- start 2023-10-16T20:06:59.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.437+0000 7f75e77cc700 1 -- start start 2023-10-16T20:06:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e77cc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e0159d10 0x7f75e00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e77cc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e00cab20 0x7f75e00cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e77cc700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00b1b50 con 0x7f75e00726e0 2023-10-16T20:06:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e77cc700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e00b1e30 con 0x7f75e00cab20 2023-10-16T20:06:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e77cc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0071c00 con 0x7f75e0159d10 2023-10-16T20:06:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e5d69700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e00cab20 0x7f75e00cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e5d69700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75e00cab20 0x7f75e00cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59298/0 (socket says 172.21.15.152:59298) 2023-10-16T20:06:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.438+0000 7f75e5d69700 1 -- 172.21.15.152:0/2272103436 learned_addr learned my addr 172.21.15.152:0/2272103436 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5568700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e0159d10 0x7f75e00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5d69700 1 -- 172.21.15.152:0/2272103436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e0159d10 msgr2=0x7f75e00c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5d69700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e0159d10 0x7f75e00c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5d69700 1 -- 172.21.15.152:0/2272103436 >> v1:172.21.15.163:6789/0 conn(0x7f75e00726e0 legacy=0x7f75e00ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5d69700 1 -- 172.21.15.152:0/2272103436 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0071ee0 con 0x7f75e00cab20 2023-10-16T20:06:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5568700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e0159d10 0x7f75e00c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75e5d69700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e00cd0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098f0 tx=0x7f75d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43881a8eaaefe48f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75dffff700 1 -- 172.21.15.152:0/2272103436 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4004230 con 0x7f75e00cab20 2023-10-16T20:06:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75dffff700 1 -- 172.21.15.152:0/2272103436 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4004390 con 0x7f75e00cab20 2023-10-16T20:06:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.439+0000 7f75dffff700 1 -- 172.21.15.152:0/2272103436 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40036a0 con 0x7f75e00cab20 2023-10-16T20:06:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 -- 172.21.15.152:0/2272103436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 msgr2=0x7f75e00cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e00cd0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098f0 tx=0x7f75d4009c00 comp rx=0 tx=0).stop 2023-10-16T20:06:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 -- 172.21.15.152:0/2272103436 shutdown_connections 2023-10-16T20:06:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e0159d10 0x7f75e00c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2272103436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e00cd0f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 -- 172.21.15.152:0/2272103436 >> 172.21.15.152:0/2272103436 conn(0x7f75e00cbfa0 msgr2=0x7f75e00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 -- 172.21.15.152:0/2272103436 shutdown_connections 2023-10-16T20:06:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.440+0000 7f75e77cc700 1 -- 172.21.15.152:0/2272103436 wait complete. 2023-10-16T20:06:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.441+0000 7f75e77cc700 1 Processor -- start 2023-10-16T20:06:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.441+0000 7f75e77cc700 1 -- start start 2023-10-16T20:06:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e00726e0 0x7f75e0156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75e0159d10 0x7f75e0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e015b040 con 0x7f75e00cab20 2023-10-16T20:06:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00b28e0 con 0x7f75e0159d10 2023-10-16T20:06:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00b2bc0 con 0x7f75e00726e0 2023-10-16T20:06:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e015ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59302/0 (socket says 172.21.15.152:59302) 2023-10-16T20:06:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 -- 172.21.15.152:0/2808933135 learned_addr learned my addr 172.21.15.152:0/2808933135 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e5d69700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75e0159d10 0x7f75e0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e5568700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e00726e0 0x7f75e0156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 -- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e00726e0 msgr2=0x7f75e0156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e00726e0 0x7f75e0156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 -- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75e0159d10 msgr2=0x7f75e0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75e0159d10 0x7f75e0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 -- 172.21.15.152:0/2808933135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009550 con 0x7f75e00cab20 2023-10-16T20:06:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e5d69700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75e0159d10 0x7f75e0155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e5568700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e00726e0 0x7f75e0156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:06:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e4d67700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e015ab00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75d00049f0 tx=0x7f75d000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011670 con 0x7f75e00cab20 2023-10-16T20:06:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d00117d0 con 0x7f75e00cab20 2023-10-16T20:06:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e015a270 con 0x7f75e00cab20 2023-10-16T20:06:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.442+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011b80 con 0x7f75e00cab20 2023-10-16T20:06:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.443+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e00b3180 con 0x7f75e00cab20 2023-10-16T20:06:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.444+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e004ebb0 con 0x7f75e00cab20 2023-10-16T20:06:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.444+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75d0011ce0 con 0x7f75e00cab20 2023-10-16T20:06:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.444+0000 7f75ddffb700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75cc06af30 0x7f75cc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.444+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75d008c460 con 0x7f75e00cab20 2023-10-16T20:06:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.444+0000 7f75e5568700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75cc06af30 0x7f75cc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.445+0000 7f75e5568700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75cc06af30 0x7f75cc06d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75e00c5ae0 tx=0x7f75d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.449+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75d00572b0 con 0x7f75e00cab20 2023-10-16T20:06:59.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.639+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75e00b54a0 con 0x7f75e00cab20 2023-10-16T20:06:59.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.639+0000 7f75ddffb700 1 -- 172.21.15.152:0/2808933135 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75d005a8d0 con 0x7f75e00cab20 2023-10-16T20:06:59.641 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:06:59.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75cc06af30 msgr2=0x7f75cc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75cc06af30 0x7f75cc06d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f75e00c5ae0 tx=0x7f75d8008040 comp rx=0 tx=0).stop 2023-10-16T20:06:59.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 msgr2=0x7f75e015ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e015ab00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75d00049f0 tx=0x7f75d000c550 comp rx=0 tx=0).stop 2023-10-16T20:06:59.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 shutdown_connections 2023-10-16T20:06:59.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f75cc06af30 0x7f75cc06d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75e00726e0 0x7f75e0156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75e0159d10 0x7f75e0155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 --2- 172.21.15.152:0/2808933135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75e00cab20 0x7f75e015ab00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 >> 172.21.15.152:0/2808933135 conn(0x7f75e00cbfa0 msgr2=0x7f75e0157300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:59.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 shutdown_connections 2023-10-16T20:06:59.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.641+0000 7f75e77cc700 1 -- 172.21.15.152:0/2808933135 wait complete. 2023-10-16T20:06:59.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:06:59.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.777+0000 7f79088a0700 1 Processor -- start 2023-10-16T20:06:59.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.777+0000 7f79088a0700 1 -- start start 2023-10-16T20:06:59.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f79088a0700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f79040b33f0 0x7f790406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f79088a0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79040cd770 0x7f79040b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f79088a0700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7904070620 con 0x7f790415b4e0 2023-10-16T20:06:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f79088a0700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7904070900 con 0x7f79040b33f0 2023-10-16T20:06:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f79088a0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7904070be0 con 0x7f79040cd770 2023-10-16T20:06:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f790259c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f790415b4e0 0x7f79040b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39506/0 (socket says 172.21.15.152:39506) 2023-10-16T20:06:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f790259c700 1 -- 172.21.15.152:0/1797687038 learned_addr learned my addr 172.21.15.152:0/1797687038 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:06:59.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f7901d9b700 1 --2- 172.21.15.152:0/1797687038 >> v2:172.21.15.163:3300/0 conn(0x7f79040b33f0 0x7f790406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f7902d9d700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79040cd770 0x7f79040b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.778+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578727914 0 0) 0x7f7904070620 con 0x7f790415b4e0 2023-10-16T20:06:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec0035b0 con 0x7f790415b4e0 2023-10-16T20:06:59.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851294813 0 0) 0x7f78ec0035b0 con 0x7f790415b4e0 2023-10-16T20:06:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79040cd770 msgr2=0x7f79040b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79040cd770 0x7f79040b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 >> v2:172.21.15.163:3300/0 conn(0x7f79040b33f0 msgr2=0x7f790406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 --2- 172.21.15.152:0/1797687038 >> v2:172.21.15.163:3300/0 conn(0x7f79040b33f0 0x7f790406f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904070ec0 con 0x7f790415b4e0 2023-10-16T20:06:59.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f78f8001670 con 0x7f790415b4e0 2023-10-16T20:06:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 >> v1:172.21.15.152:6789/0 conn(0x7f790415b4e0 legacy=0x7f79040b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec003a00 0x7f78ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78ec004850 0x7f78ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78ec005210 0x7f78ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904070900 con 0x7f78ec005210 2023-10-16T20:06:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904070be0 con 0x7f78ec003a00 2023-10-16T20:06:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec00bf50 con 0x7f78ec004850 2023-10-16T20:06:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7901d9b700 1 --2- 172.21.15.152:0/1797687038 >> v2:172.21.15.163:3300/0 conn(0x7f79040b33f0 0x7f790406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:59.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f79040cd770 0x7f79040b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:06:59.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78ec005210 0x7f78ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790259c700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec003a00 0x7f78ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7901d9b700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78ec004850 0x7f78ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 -- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78ec004850 msgr2=0x7f78ec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f78ec004850 0x7f78ec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 -- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec003a00 msgr2=0x7f78ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:06:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec003a00 0x7f78ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 -- 172.21.15.152:0/1797687038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0035b0 con 0x7f78ec005210 2023-10-16T20:06:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f7902d9d700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78ec005210 0x7f78ec00ba10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f79040cdb50 tx=0x7f78ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ecf85c57982ffe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.779+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc003c20 con 0x7f78ec005210 2023-10-16T20:06:59.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc00f040 con 0x7f78ec005210 2023-10-16T20:06:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f790159a700 1 -- 172.21.15.152:0/1797687038 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00ea30 con 0x7f78ec005210 2023-10-16T20:06:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f79088a0700 1 -- 172.21.15.152:0/1797687038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78ec005210 msgr2=0x7f78ec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f79088a0700 1 --2- 172.21.15.152:0/1797687038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78ec005210 0x7f78ec00ba10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f79040cdb50 tx=0x7f78ec005880 comp rx=0 tx=0).stop 2023-10-16T20:06:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f7902d9d700 1 -- 172.21.15.152:0/1797687038 reap_dead start 2023-10-16T20:06:59.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f79088a0700 1 -- 172.21.15.152:0/1797687038 shutdown_connections 2023-10-16T20:06:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f79088a0700 1 -- 172.21.15.152:0/1797687038 >> 172.21.15.152:0/1797687038 conn(0x7f79040cdce0 msgr2=0x7f79040ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f79088a0700 1 -- 172.21.15.152:0/1797687038 shutdown_connections 2023-10-16T20:06:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.780+0000 7f79088a0700 1 -- 172.21.15.152:0/1797687038 wait complete. 2023-10-16T20:06:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.781+0000 7f79088a0700 1 Processor -- start 2023-10-16T20:06:59.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 -- start start 2023-10-16T20:06:59.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec005210 0x7f7904157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7904145580 0x7f79040ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 0x7f79040cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79040ca5a0 con 0x7f79040caf00 2023-10-16T20:06:59.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904158110 con 0x7f78ec005210 2023-10-16T20:06:59.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f79088a0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040c99d0 con 0x7f7904145580 2023-10-16T20:06:59.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f7902d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 0x7f79040cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f7902d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 0x7f79040cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59320/0 (socket says 172.21.15.152:59320) 2023-10-16T20:06:59.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f7902d9d700 1 -- 172.21.15.152:0/91513509 learned_addr learned my addr 172.21.15.152:0/91513509 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:06:59.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f790259c700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec005210 0x7f7904157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.782+0000 7f7901d9b700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7904145580 0x7f79040ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f7902d9d700 1 -- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7904145580 msgr2=0x7f79040ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f7902d9d700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7904145580 0x7f79040ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f7902d9d700 1 -- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec005210 msgr2=0x7f7904157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f7902d9d700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec005210 0x7f7904157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f7902d9d700 1 -- 172.21.15.152:0/91513509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904158330 con 0x7f79040caf00 2023-10-16T20:06:59.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f7902d9d700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 0x7f79040cb390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f78ec004700 tx=0x7f78fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004230 con 0x7f79040caf00 2023-10-16T20:06:59.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc004390 con 0x7f79040caf00 2023-10-16T20:06:59.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79040c9c00 con 0x7f79040caf00 2023-10-16T20:06:59.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004740 con 0x7f79040caf00 2023-10-16T20:06:59.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.783+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79040ca1c0 con 0x7f79040caf00 2023-10-16T20:06:59.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.784+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79040ca6e0 con 0x7f79040caf00 2023-10-16T20:06:59.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.784+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78fc025020 con 0x7f79040caf00 2023-10-16T20:06:59.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.785+0000 7f78f2ffd700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f78e406af00 0x7f78e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:06:59.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.785+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78fc08b4d0 con 0x7f79040caf00 2023-10-16T20:06:59.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.785+0000 7f790259c700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f78e406af00 0x7f78e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:06:59.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.785+0000 7f790259c700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f78e406af00 0x7f78e406d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:06:59.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.789+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79040ca6e0 con 0x7f79040caf00 2023-10-16T20:06:59.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.977+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79040ca6e0 con 0x7f79040caf00 2023-10-16T20:06:59.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.977+0000 7f78f2ffd700 1 -- 172.21.15.152:0/91513509 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79040ca6e0 con 0x7f79040caf00 2023-10-16T20:06:59.980 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:06:59.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.979+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f78e406af00 msgr2=0x7f78e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.979+0000 7f79088a0700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f78e406af00 0x7f78e406d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8000f80 comp rx=0 tx=0).stop 2023-10-16T20:06:59.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 msgr2=0x7f79040cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:06:59.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 0x7f79040cb390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f78ec004700 tx=0x7f78fc009750 comp rx=0 tx=0).stop 2023-10-16T20:06:59.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 shutdown_connections 2023-10-16T20:06:59.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f78e406af00 0x7f78e406d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79040caf00 0x7f79040cb390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78ec005210 0x7f7904157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 --2- 172.21.15.152:0/91513509 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7904145580 0x7f79040ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:06:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 >> 172.21.15.152:0/91513509 conn(0x7f79040cdce0 msgr2=0x7f790415a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:06:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 shutdown_connections 2023-10-16T20:06:59.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:06:59.980+0000 7f79088a0700 1 -- 172.21.15.152:0/91513509 wait complete. 2023-10-16T20:06:59.993 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.116+0000 7f148993a700 1 Processor -- start 2023-10-16T20:07:00.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.116+0000 7f148993a700 1 -- start start 2023-10-16T20:07:00.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f148993a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f148415d760 0x7f14840b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f148993a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f148406b7e0 0x7f148406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f148993a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840cf420 con 0x7f14840ce0a0 2023-10-16T20:07:00.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f148993a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14840b95a0 con 0x7f148415d760 2023-10-16T20:07:00.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f148993a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148406c1b0 con 0x7f148406b7e0 2023-10-16T20:07:00.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1482ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f148415d760 0x7f14840b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f14827fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f14840ce0a0 0x7f14840cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39522/0 (socket says 172.21.15.152:39522) 2023-10-16T20:07:00.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f14827fc700 1 -- 172.21.15.152:0/568253393 learned_addr learned my addr 172.21.15.152:0/568253393 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:00.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1482ffd700 1 -- 172.21.15.152:0/568253393 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f148406b7e0 msgr2=0x7f148406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:00.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1482ffd700 1 --2- 172.21.15.152:0/568253393 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f148406b7e0 0x7f148406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1482ffd700 1 -- 172.21.15.152:0/568253393 >> v1:172.21.15.152:6789/0 conn(0x7f14840ce0a0 legacy=0x7f14840cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1481ffb700 1 -- 172.21.15.152:0/568253393 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614240303 0 0) 0x7f14840cf420 con 0x7f14840ce0a0 2023-10-16T20:07:00.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1482ffd700 1 -- 172.21.15.152:0/568253393 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840ce810 con 0x7f148415d760 2023-10-16T20:07:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1482ffd700 1 --2- 172.21.15.152:0/568253393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f14840b9060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1474009840 tx=0x7f1474009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64314e323147ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1481ffb700 1 -- 172.21.15.152:0/568253393 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011830 con 0x7f148415d760 2023-10-16T20:07:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1481ffb700 1 -- 172.21.15.152:0/568253393 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474011990 con 0x7f148415d760 2023-10-16T20:07:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.117+0000 7f1481ffb700 1 -- 172.21.15.152:0/568253393 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011d20 con 0x7f148415d760 2023-10-16T20:07:00.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 -- 172.21.15.152:0/568253393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 msgr2=0x7f14840b9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 --2- 172.21.15.152:0/568253393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f14840b9060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1474009840 tx=0x7f1474009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 -- 172.21.15.152:0/568253393 shutdown_connections 2023-10-16T20:07:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 --2- 172.21.15.152:0/568253393 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f148406b7e0 0x7f148406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 --2- 172.21.15.152:0/568253393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f14840b9060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 -- 172.21.15.152:0/568253393 >> 172.21.15.152:0/568253393 conn(0x7f1484072340 msgr2=0x7f1484072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:00.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 -- 172.21.15.152:0/568253393 shutdown_connections 2023-10-16T20:07:00.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.118+0000 7f148993a700 1 -- 172.21.15.152:0/568253393 wait complete. 2023-10-16T20:07:00.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.119+0000 7f148993a700 1 Processor -- start 2023-10-16T20:07:00.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.119+0000 7f148993a700 1 -- start start 2023-10-16T20:07:00.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f148993a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f148406b7e0 0x7f14841f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f148993a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14840ce0a0 0x7f148415ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f148993a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f1484160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f148993a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840cbda0 con 0x7f148415d760 2023-10-16T20:07:00.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f148993a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840cb1d0 con 0x7f148406b7e0 2023-10-16T20:07:00.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f148993a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840cb470 con 0x7f14840ce0a0 2023-10-16T20:07:00.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f1484160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f1484160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59334/0 (socket says 172.21.15.152:59334) 2023-10-16T20:07:00.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 -- 172.21.15.152:0/3737480519 learned_addr learned my addr 172.21.15.152:0/3737480519 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:00.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14827fc700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14840ce0a0 0x7f148415ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f1482ffd700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f148406b7e0 0x7f14841f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 -- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14840ce0a0 msgr2=0x7f148415ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14840ce0a0 0x7f148415ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 -- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f148406b7e0 msgr2=0x7f14841f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f148406b7e0 0x7f14841f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.120+0000 7f14837fe700 1 -- 172.21.15.152:0/3737480519 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740094a0 con 0x7f148415d760 2023-10-16T20:07:00.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.121+0000 7f14837fe700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f1484160500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b970 tx=0x7f147c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.121+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00c9b0 con 0x7f148415d760 2023-10-16T20:07:00.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.121+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00cb30 con 0x7f148415d760 2023-10-16T20:07:00.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.121+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14840cb750 con 0x7f148415d760 2023-10-16T20:07:00.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.121+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c014440 con 0x7f148415d760 2023-10-16T20:07:00.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.121+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840cd370 con 0x7f148415d760 2023-10-16T20:07:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.122+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148404ebb0 con 0x7f148415d760 2023-10-16T20:07:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.122+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f147c01d3b0 con 0x7f148415d760 2023-10-16T20:07:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.122+0000 7f146bfff700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f147006af00 0x7f147006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.123+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f147c006e40 con 0x7f148415d760 2023-10-16T20:07:00.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.123+0000 7f1482ffd700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f147006af00 0x7f147006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.123+0000 7f1482ffd700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f147006af00 0x7f147006d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14740090b0 tx=0x7f147401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.127+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f147c054460 con 0x7f148415d760 2023-10-16T20:07:00.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.316+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f14840b8cd0 con 0x7f148415d760 2023-10-16T20:07:00.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.317+0000 7f146bfff700 1 -- 172.21.15.152:0/3737480519 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f147c057a80 con 0x7f148415d760 2023-10-16T20:07:00.319 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:00.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f147006af00 msgr2=0x7f147006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f147006af00 0x7f147006d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14740090b0 tx=0x7f147401c040 comp rx=0 tx=0).stop 2023-10-16T20:07:00.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 msgr2=0x7f1484160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f1484160500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b970 tx=0x7f147c00bd30 comp rx=0 tx=0).stop 2023-10-16T20:07:00.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 shutdown_connections 2023-10-16T20:07:00.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f147006af00 0x7f147006d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f148415d760 0x7f1484160500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f148406b7e0 0x7f14841f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 --2- 172.21.15.152:0/3737480519 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f14840ce0a0 0x7f148415ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 >> 172.21.15.152:0/3737480519 conn(0x7f1484072340 msgr2=0x7f14840c71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:00.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 shutdown_connections 2023-10-16T20:07:00.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.319+0000 7f148993a700 1 -- 172.21.15.152:0/3737480519 wait complete. 2023-10-16T20:07:00.333 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:00.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.451+0000 7ff2ab9ae700 1 Processor -- start 2023-10-16T20:07:00.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.452+0000 7ff2ab9ae700 1 -- start start 2023-10-16T20:07:00.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.452+0000 7ff2ab9ae700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff2a40cf7d0 0x7ff2a415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.452+0000 7ff2ab9ae700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40cfeb0 con 0x7ff2a406a820 2023-10-16T20:07:00.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.452+0000 7ff2ab9ae700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40cfc30 con 0x7ff2a40ca7d0 2023-10-16T20:07:00.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.452+0000 7ff2ab9ae700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40ce410 con 0x7ff2a40cf7d0 2023-10-16T20:07:00.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.452+0000 7ff2a974a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff2a406a820 0x7ff2a406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39536/0 (socket says 172.21.15.152:39536) 2023-10-16T20:07:00.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a974a700 1 -- 172.21.15.152:0/2292633500 learned_addr learned my addr 172.21.15.152:0/2292633500 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:00.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2292633500 >> v2:172.21.15.163:3300/0 conn(0x7ff2a40cf7d0 0x7ff2a415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144618644 0 0) 0x7ff2a40cfeb0 con 0x7ff2a406a820 2023-10-16T20:07:00.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2900035b0 con 0x7ff2a406a820 2023-10-16T20:07:00.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3331099887 0 0) 0x7ff2900035b0 con 0x7ff2a406a820 2023-10-16T20:07:00.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 >> v2:172.21.15.163:3300/0 conn(0x7ff2a40cf7d0 msgr2=0x7ff2a415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 --2- 172.21.15.152:0/2292633500 >> v2:172.21.15.163:3300/0 conn(0x7ff2a40cf7d0 0x7ff2a415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 >> v1:172.21.15.163:6789/0 conn(0x7ff2a40ca7d0 legacy=0x7ff2a4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40af9d0 con 0x7ff2a406a820 2023-10-16T20:07:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7ff294001670 con 0x7ff2a406a820 2023-10-16T20:07:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 >> v1:172.21.15.152:6789/0 conn(0x7ff2a406a820 legacy=0x7ff2a406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff290003a00 0x7ff290003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff290004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff290005210 0x7ff29000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40ce410 con 0x7ff290004850 2023-10-16T20:07:00.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29000c1b0 con 0x7ff290005210 2023-10-16T20:07:00.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29000c370 con 0x7ff290003a00 2023-10-16T20:07:00.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff290004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a974a700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff290003a00 0x7ff290003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a9f4b700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff290005210 0x7ff29000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 -- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff290003a00 msgr2=0x7ff290003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:00.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff290003a00 0x7ff290003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 -- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff290005210 msgr2=0x7ff29000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff290005210 0x7ff29000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a9f4b700 1 -- 172.21.15.152:0/2292633500 reap_dead start 2023-10-16T20:07:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.453+0000 7ff2a8f49700 1 -- 172.21.15.152:0/2292633500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900035b0 con 0x7ff290004850 2023-10-16T20:07:00.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff290004cd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009b60 tx=0x7ff290005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a3e90c8bafbd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000e6c0 con 0x7ff290004850 2023-10-16T20:07:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a000e820 con 0x7ff290004850 2023-10-16T20:07:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff29bfff700 1 -- 172.21.15.152:0/2292633500 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000eb90 con 0x7ff290004850 2023-10-16T20:07:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2292633500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 msgr2=0x7ff290004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff290004cd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009b60 tx=0x7ff290005880 comp rx=0 tx=0).stop 2023-10-16T20:07:00.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2292633500 shutdown_connections 2023-10-16T20:07:00.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2292633500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff290004cd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2292633500 >> 172.21.15.152:0/2292633500 conn(0x7ff2a40d0180 msgr2=0x7ff2a40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:00.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2292633500 shutdown_connections 2023-10-16T20:07:00.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.454+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2292633500 wait complete. 2023-10-16T20:07:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 Processor -- start 2023-10-16T20:07:00.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 -- start start 2023-10-16T20:07:00.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff2a41521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2a406d100 0x7ff2a40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2a4156b40 0x7ff2a4156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40af0f0 con 0x7ff290004850 2023-10-16T20:07:00.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4157500 con 0x7ff2a406d100 2023-10-16T20:07:00.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2ab9ae700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a406e460 con 0x7ff2a4156b40 2023-10-16T20:07:00.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.456+0000 7ff2a974a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff2a41521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff2a41521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59350/0 (socket says 172.21.15.152:59350) 2023-10-16T20:07:00.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 -- 172.21.15.152:0/2905419868 learned_addr learned my addr 172.21.15.152:0/2905419868 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:00.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a9f4b700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2a4156b40 0x7ff2a4156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2a406d100 0x7ff2a40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 -- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2a4156b40 msgr2=0x7ff2a4156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2a4156b40 0x7ff2a4156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 -- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2a406d100 msgr2=0x7ff2a40aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2a406d100 0x7ff2a40aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 -- 172.21.15.152:0/2905419868 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a406d580 con 0x7ff290004850 2023-10-16T20:07:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2a974a700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff2a41521f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2940072c0 tx=0x7ff2940075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400f660 con 0x7ff290004850 2023-10-16T20:07:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400f7c0 con 0x7ff290004850 2023-10-16T20:07:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a406d850 con 0x7ff290004850 2023-10-16T20:07:00.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400fb70 con 0x7ff290004850 2023-10-16T20:07:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.457+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a406de10 con 0x7ff290004850 2023-10-16T20:07:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.458+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a404ebb0 con 0x7ff290004850 2023-10-16T20:07:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.458+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff29400fcd0 con 0x7ff290004850 2023-10-16T20:07:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.459+0000 7ff299ffb700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff28806af00 0x7ff28806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.459+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2940897a0 con 0x7ff290004850 2023-10-16T20:07:00.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.459+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff28806af00 0x7ff28806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.459+0000 7ff2a8f49700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff28806af00 0x7ff28806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00090b0 tx=0x7ff2a001e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.463+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2940546a0 con 0x7ff290004850 2023-10-16T20:07:00.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.693+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2a40af6c0 con 0x7ff290004850 2023-10-16T20:07:00.696 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.694+0000 7ff299ffb700 1 -- 172.21.15.152:0/2905419868 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7ff294057cc0 con 0x7ff290004850 2023-10-16T20:07:00.696 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:00.696 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:07:00.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.695+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff28806af00 msgr2=0x7ff28806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.695+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff28806af00 0x7ff28806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00090b0 tx=0x7ff2a001e040 comp rx=0 tx=0).stop 2023-10-16T20:07:00.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 msgr2=0x7ff2a41521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff2a41521f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2940072c0 tx=0x7ff2940075d0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 shutdown_connections 2023-10-16T20:07:00.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff28806af00 0x7ff28806d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff2a4156b40 0x7ff2a4156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff290004850 0x7ff2a41521f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 --2- 172.21.15.152:0/2905419868 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2a406d100 0x7ff2a40aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 >> 172.21.15.152:0/2905419868 conn(0x7ff2a40d0180 msgr2=0x7ff2a40cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:00.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 shutdown_connections 2023-10-16T20:07:00.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.696+0000 7ff2ab9ae700 1 -- 172.21.15.152:0/2905419868 wait complete. 2023-10-16T20:07:00.701 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:07:00.710 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:00.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:00.776 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:00.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.830+0000 7f88061f6700 1 Processor -- start 2023-10-16T20:07:00.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.831+0000 7f88061f6700 1 -- start start 2023-10-16T20:07:00.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.831+0000 7f88061f6700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8800152470 0x7f88000cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.831+0000 7f88061f6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8800070d70 con 0x7f88000cb8d0 2023-10-16T20:07:00.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.831+0000 7f88061f6700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880015c990 con 0x7f88000b3410 2023-10-16T20:07:00.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.831+0000 7f88061f6700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800071200 con 0x7f8800152470 2023-10-16T20:07:00.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.831+0000 7f87feffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f88000cb8d0 0x7f88000b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39556/0 (socket says 172.21.15.152:39556) 2023-10-16T20:07:00.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87feffd700 1 -- 172.21.15.152:0/3775993294 learned_addr learned my addr 172.21.15.152:0/3775993294 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:00.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87ff7fe700 1 --2- 172.21.15.152:0/3775993294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8800152470 0x7f88000cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739768192 0 0) 0x7f8800070d70 con 0x7f88000cb8d0 2023-10-16T20:07:00.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ec0035b0 con 0x7f88000cb8d0 2023-10-16T20:07:00.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147910686 0 0) 0x7f880015c990 con 0x7f88000b3410 2023-10-16T20:07:00.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8800070d70 con 0x7f88000b3410 2023-10-16T20:07:00.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4266207208 0 0) 0x7f87ec0035b0 con 0x7f88000cb8d0 2023-10-16T20:07:00.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87ff7fe700 1 -- 172.21.15.152:0/3775993294 >> v1:172.21.15.163:6789/0 conn(0x7f88000b3410 legacy=0x7f88000b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87ff7fe700 1 -- 172.21.15.152:0/3775993294 >> v1:172.21.15.152:6789/0 conn(0x7f88000cb8d0 legacy=0x7f88000b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87ff7fe700 1 -- 172.21.15.152:0/3775993294 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800070440 con 0x7f8800152470 2023-10-16T20:07:00.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87ff7fe700 1 --2- 172.21.15.152:0/3775993294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8800152470 0x7f88000cd570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e2afb75b71a72b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0001670 con 0x7f8800152470 2023-10-16T20:07:00.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8004030 con 0x7f8800152470 2023-10-16T20:07:00.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.832+0000 7f87fe7fc700 1 -- 172.21.15.152:0/3775993294 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80043a0 con 0x7f8800152470 2023-10-16T20:07:00.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 -- 172.21.15.152:0/3775993294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8800152470 msgr2=0x7f88000cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 --2- 172.21.15.152:0/3775993294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8800152470 0x7f88000cd570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009870 tx=0x7f87e8009b80 comp rx=0 tx=0).stop 2023-10-16T20:07:00.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 -- 172.21.15.152:0/3775993294 shutdown_connections 2023-10-16T20:07:00.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 --2- 172.21.15.152:0/3775993294 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8800152470 0x7f88000cd570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 -- 172.21.15.152:0/3775993294 >> 172.21.15.152:0/3775993294 conn(0x7f88000cdd00 msgr2=0x7f88000ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:00.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 -- 172.21.15.152:0/3775993294 shutdown_connections 2023-10-16T20:07:00.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.833+0000 7f88061f6700 1 -- 172.21.15.152:0/3775993294 wait complete. 2023-10-16T20:07:00.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.834+0000 7f88061f6700 1 Processor -- start 2023-10-16T20:07:00.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.834+0000 7f88061f6700 1 -- start start 2023-10-16T20:07:00.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f88061f6700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88000b3410 0x7f88001f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f88061f6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88000cb8d0 0x7f88000c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f88061f6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 0x7f88000b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f88061f6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c6eb0 con 0x7f8800152470 2023-10-16T20:07:00.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f88061f6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c6340 con 0x7f88000cb8d0 2023-10-16T20:07:00.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f88061f6700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c6610 con 0x7f88000b3410 2023-10-16T20:07:00.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.835+0000 7f87fffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 0x7f88000b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 0x7f88000b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59368/0 (socket says 172.21.15.152:59368) 2023-10-16T20:07:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 -- 172.21.15.152:0/4017549530 learned_addr learned my addr 172.21.15.152:0/4017549530 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87feffd700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88000cb8d0 0x7f88000c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87ff7fe700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88000b3410 0x7f88001f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 -- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88000b3410 msgr2=0x7f88001f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88000b3410 0x7f88001f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 -- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88000cb8d0 msgr2=0x7f88000c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:00.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88000cb8d0 0x7f88000c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:00.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 -- 172.21.15.152:0/4017549530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80094a0 con 0x7f8800152470 2023-10-16T20:07:00.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87ff7fe700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88000b3410 0x7f88001f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:00.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87feffd700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88000cb8d0 0x7f88000c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:00.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87fffff700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 0x7f88000b2700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f87f800cbc0 tx=0x7f87f800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8003c00 con 0x7f8800152470 2023-10-16T20:07:00.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8003d60 con 0x7f8800152470 2023-10-16T20:07:00.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88000c68f0 con 0x7f8800152470 2023-10-16T20:07:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800abb0 con 0x7f8800152470 2023-10-16T20:07:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.836+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88000c9f40 con 0x7f8800152470 2023-10-16T20:07:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.837+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88000c9da0 con 0x7f8800152470 2023-10-16T20:07:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.838+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f87f800ad10 con 0x7f8800152470 2023-10-16T20:07:00.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.838+0000 7f87f7fff700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f87e006af00 0x7f87e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.838+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87f8089ac0 con 0x7f8800152470 2023-10-16T20:07:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.838+0000 7f87ff7fe700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f87e006af00 0x7f87e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.838+0000 7f87ff7fe700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f87e006af00 0x7f87e006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f87e8000c00 tx=0x7f87e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:00.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:00.842+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88000c9da0 con 0x7f8800152470 2023-10-16T20:07:01.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.039+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88000c9da0 con 0x7f8800152470 2023-10-16T20:07:01.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.041+0000 7f87f7fff700 1 -- 172.21.15.152:0/4017549530 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f88000c9da0 con 0x7f8800152470 2023-10-16T20:07:01.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:01.043 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f87e006af00 msgr2=0x7f87e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f87e006af00 0x7f87e006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f87e8000c00 tx=0x7f87e8008030 comp rx=0 tx=0).stop 2023-10-16T20:07:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 msgr2=0x7f88000b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 0x7f88000b2700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f87f800cbc0 tx=0x7f87f800cf80 comp rx=0 tx=0).stop 2023-10-16T20:07:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 shutdown_connections 2023-10-16T20:07:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f87e006af00 0x7f87e006d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f88000b3410 0x7f88001f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8800152470 0x7f88000b2700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 --2- 172.21.15.152:0/4017549530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88000cb8d0 0x7f88000c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 >> 172.21.15.152:0/4017549530 conn(0x7f88000cdd00 msgr2=0x7f880015e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 shutdown_connections 2023-10-16T20:07:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.043+0000 7f88061f6700 1 -- 172.21.15.152:0/4017549530 wait complete. 2023-10-16T20:07:01.057 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:01.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.217+0000 7fe55da3d700 1 Processor -- start 2023-10-16T20:07:01.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.217+0000 7fe55da3d700 1 -- start start 2023-10-16T20:07:01.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe55da3d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe5580b3410 0x7fe5580cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe55da3d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558161180 con 0x7fe55815b300 2023-10-16T20:07:01.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe55da3d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558161460 con 0x7fe5580cf4e0 2023-10-16T20:07:01.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe55da3d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580cf970 con 0x7fe5580b3410 2023-10-16T20:07:01.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe556ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe55815b300 0x7fe5580b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39570/0 (socket says 172.21.15.152:39570) 2023-10-16T20:07:01.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe556ffd700 1 -- 172.21.15.152:0/3144048523 learned_addr learned my addr 172.21.15.152:0/3144048523 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:01.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088128900 0 0) 0x7fe558161180 con 0x7fe55815b300 2023-10-16T20:07:01.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.218+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5440035b0 con 0x7fe55815b300 2023-10-16T20:07:01.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5567fc700 1 --2- 172.21.15.152:0/3144048523 >> v2:172.21.15.163:3300/0 conn(0x7fe5580b3410 0x7fe5580cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2037570301 0 0) 0x7fe5440035b0 con 0x7fe55815b300 2023-10-16T20:07:01.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 >> v2:172.21.15.163:3300/0 conn(0x7fe5580b3410 msgr2=0x7fe5580cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:01.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 --2- 172.21.15.152:0/3144048523 >> v2:172.21.15.163:3300/0 conn(0x7fe5580b3410 0x7fe5580cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 >> v1:172.21.15.163:6789/0 conn(0x7fe5580cf4e0 legacy=0x7fe55806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558161740 con 0x7fe55815b300 2023-10-16T20:07:01.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fe5480019f0 con 0x7fe55815b300 2023-10-16T20:07:01.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 >> v1:172.21.15.152:6789/0 conn(0x7fe55815b300 legacy=0x7fe5580b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe544003a00 0x7fe544003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544004850 0x7fe544004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe544005210 0x7fe54400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580cf970 con 0x7fe544005210 2023-10-16T20:07:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54400c160 con 0x7fe544004850 2023-10-16T20:07:01.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54400c320 con 0x7fe544003a00 2023-10-16T20:07:01.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe544005210 0x7fe54400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5567fc700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544004850 0x7fe544004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe556ffd700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe544003a00 0x7fe544003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 -- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe544003a00 msgr2=0x7fe544003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:01.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe544003a00 0x7fe544003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 -- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544004850 msgr2=0x7fe544004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544004850 0x7fe544004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 -- 172.21.15.152:0/3144048523 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440035b0 con 0x7fe544005210 2023-10-16T20:07:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 -- 172.21.15.152:0/3144048523 reap_dead start 2023-10-16T20:07:01.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe5577fe700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe544005210 0x7fe54400ba10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe5500017c0 tx=0x7fe544005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b397884474a07f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500052d0 con 0x7fe544005210 2023-10-16T20:07:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.219+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550005430 con 0x7fe544005210 2023-10-16T20:07:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe555ffb700 1 -- 172.21.15.152:0/3144048523 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500038c0 con 0x7fe544005210 2023-10-16T20:07:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 -- 172.21.15.152:0/3144048523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe544005210 msgr2=0x7fe54400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe544005210 0x7fe54400ba10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe5500017c0 tx=0x7fe544005880 comp rx=0 tx=0).stop 2023-10-16T20:07:01.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 -- 172.21.15.152:0/3144048523 shutdown_connections 2023-10-16T20:07:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 --2- 172.21.15.152:0/3144048523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe544005210 0x7fe54400ba10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 -- 172.21.15.152:0/3144048523 >> 172.21.15.152:0/3144048523 conn(0x7fe5580cdd00 msgr2=0x7fe5580ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 -- 172.21.15.152:0/3144048523 shutdown_connections 2023-10-16T20:07:01.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.220+0000 7fe55da3d700 1 -- 172.21.15.152:0/3144048523 wait complete. 2023-10-16T20:07:01.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.221+0000 7fe55da3d700 1 Processor -- start 2023-10-16T20:07:01.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 -- start start 2023-10-16T20:07:01.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544005210 0x7fe558143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 0x7fe5581f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe55815d970 0x7fe55815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815e360 con 0x7fe5581f3920 2023-10-16T20:07:01.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815fcf0 con 0x7fe544005210 2023-10-16T20:07:01.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe55da3d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815ffb0 con 0x7fe55815d970 2023-10-16T20:07:01.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe5567fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 0x7fe5581f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe5567fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 0x7fe5581f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59386/0 (socket says 172.21.15.152:59386) 2023-10-16T20:07:01.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe5567fc700 1 -- 172.21.15.152:0/4046188847 learned_addr learned my addr 172.21.15.152:0/4046188847 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:01.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe556ffd700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544005210 0x7fe558143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.222+0000 7fe5577fe700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe55815d970 0x7fe55815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe5567fc700 1 -- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe55815d970 msgr2=0x7fe55815de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe5567fc700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe55815d970 0x7fe55815de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe5567fc700 1 -- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544005210 msgr2=0x7fe558143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe5567fc700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544005210 0x7fe558143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe5567fc700 1 -- 172.21.15.152:0/4046188847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558160290 con 0x7fe5581f3920 2023-10-16T20:07:01.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe5567fc700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 0x7fe5581f02a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe5400116a0 tx=0x7fe5400119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:01.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000c070 con 0x7fe5581f3920 2023-10-16T20:07:01.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540015870 con 0x7fe5581f3920 2023-10-16T20:07:01.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540015c20 con 0x7fe5581f3920 2023-10-16T20:07:01.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558160570 con 0x7fe5581f3920 2023-10-16T20:07:01.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.223+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5581f3da0 con 0x7fe5581f3920 2023-10-16T20:07:01.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.224+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe558160a90 con 0x7fe5581f3920 2023-10-16T20:07:01.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.225+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5400143e0 con 0x7fe5581f3920 2023-10-16T20:07:01.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.225+0000 7fe54ffff700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe53806af30 0x7fe53806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:01.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.225+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe540089940 con 0x7fe5581f3920 2023-10-16T20:07:01.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.225+0000 7fe556ffd700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe53806af30 0x7fe53806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:01.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.225+0000 7fe556ffd700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe53806af30 0x7fe53806d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe548002010 tx=0x7fe548006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:01.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.229+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe558160a90 con 0x7fe5581f3920 2023-10-16T20:07:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.461+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe558160a90 con 0x7fe5581f3920 2023-10-16T20:07:01.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.461+0000 7fe54ffff700 1 -- 172.21.15.152:0/4046188847 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fe558160a90 con 0x7fe5581f3920 2023-10-16T20:07:01.463 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:01.464 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:07:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe53806af30 msgr2=0x7fe53806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe53806af30 0x7fe53806d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe548002010 tx=0x7fe548006040 comp rx=0 tx=0).stop 2023-10-16T20:07:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 msgr2=0x7fe5581f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 0x7fe5581f02a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe5400116a0 tx=0x7fe5400119b0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 shutdown_connections 2023-10-16T20:07:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe53806af30 0x7fe53806d3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe55815d970 0x7fe55815de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe544005210 0x7fe558143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 --2- 172.21.15.152:0/4046188847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5581f3920 0x7fe5581f02a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.463+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 >> 172.21.15.152:0/4046188847 conn(0x7fe5580cdd00 msgr2=0x7fe5580ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:01.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.464+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 shutdown_connections 2023-10-16T20:07:01.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:01.464+0000 7fe55da3d700 1 -- 172.21.15.152:0/4046188847 wait complete. 2023-10-16T20:07:01.468 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:07:01.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T20:06:32.144481+0000', 'modified': '2023-10-16T20:06:49.295679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6837/1439878702', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6835', 'nonce': 1439878702}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 1439878702}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T20:07:01.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T20:07:01.882 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T20:07:02.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.005+0000 7fdb528fa700 1 Processor -- start 2023-10-16T20:07:02.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb528fa700 1 -- start start 2023-10-16T20:07:02.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb528fa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 0x7fdb4c072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb528fa700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb4c0b1bd0 0x7fdb4c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb528fa700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c15e560 con 0x7fdb4c15a240 2023-10-16T20:07:02.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb528fa700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c15edf0 con 0x7fdb4c0b1bd0 2023-10-16T20:07:02.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb528fa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b25a0 con 0x7fdb4c0724a0 2023-10-16T20:07:02.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb4bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdb4c15a240 0x7fdb4c15de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39590/0 (socket says 172.21.15.152:39590) 2023-10-16T20:07:02.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.006+0000 7fdb4bfff700 1 -- 172.21.15.152:0/3014947168 learned_addr learned my addr 172.21.15.152:0/3014947168 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:02.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 0x7fdb4c072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb50e97700 1 --2- 172.21.15.152:0/3014947168 >> v2:172.21.15.163:3300/0 conn(0x7fdb4c0b1bd0 0x7fdb4c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884790949 0 0) 0x7fdb4c15e560 con 0x7fdb4c15a240 2023-10-16T20:07:02.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb380035b0 con 0x7fdb4c15a240 2023-10-16T20:07:02.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1905628265 0 0) 0x7fdb380035b0 con 0x7fdb4c15a240 2023-10-16T20:07:02.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 msgr2=0x7fdb4c072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 0x7fdb4c072920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 >> v2:172.21.15.163:3300/0 conn(0x7fdb4c0b1bd0 msgr2=0x7fdb4c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 --2- 172.21.15.152:0/3014947168 >> v2:172.21.15.163:3300/0 conn(0x7fdb4c0b1bd0 0x7fdb4c0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c15e830 con 0x7fdb4c15a240 2023-10-16T20:07:02.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fdb3c001670 con 0x7fdb4c15a240 2023-10-16T20:07:02.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 >> v1:172.21.15.152:6789/0 conn(0x7fdb4c15a240 legacy=0x7fdb4c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 0x7fdb38003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38003f80 0x7fdb38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb38004d90 0x7fdb38005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c15edf0 con 0x7fdb38003f80 2023-10-16T20:07:02.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b25a0 con 0x7fdb38004d90 2023-10-16T20:07:02.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3800ba10 con 0x7fdb4c0724a0 2023-10-16T20:07:02.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38003f80 0x7fdb38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 0x7fdb38003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb50e97700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb38004d90 0x7fdb38005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 msgr2=0x7fdb38003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb4c0724a0 0x7fdb38003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb38004d90 msgr2=0x7fdb38005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb38004d90 0x7fdb38005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/3014947168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380035b0 con 0x7fdb38003f80 2023-10-16T20:07:02.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.007+0000 7fdb50e97700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb38004d90 0x7fdb38005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:02.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38003f80 0x7fdb38004850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009b60 tx=0x7fdb38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c17b5e240edd971 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400e660 con 0x7fdb38003f80 2023-10-16T20:07:02.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3400e7c0 con 0x7fdb38003f80 2023-10-16T20:07:02.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb4affd700 1 -- 172.21.15.152:0/3014947168 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400eb30 con 0x7fdb38003f80 2023-10-16T20:07:02.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb528fa700 1 -- 172.21.15.152:0/3014947168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38003f80 msgr2=0x7fdb38004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb528fa700 1 --2- 172.21.15.152:0/3014947168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38003f80 0x7fdb38004850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009b60 tx=0x7fdb38005880 comp rx=0 tx=0).stop 2023-10-16T20:07:02.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb50e97700 1 -- 172.21.15.152:0/3014947168 reap_dead start 2023-10-16T20:07:02.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb528fa700 1 -- 172.21.15.152:0/3014947168 shutdown_connections 2023-10-16T20:07:02.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb528fa700 1 -- 172.21.15.152:0/3014947168 >> 172.21.15.152:0/3014947168 conn(0x7fdb4c06bd50 msgr2=0x7fdb4c06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb528fa700 1 -- 172.21.15.152:0/3014947168 shutdown_connections 2023-10-16T20:07:02.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.008+0000 7fdb528fa700 1 -- 172.21.15.152:0/3014947168 wait complete. 2023-10-16T20:07:02.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.009+0000 7fdb528fa700 1 Processor -- start 2023-10-16T20:07:02.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 -- start start 2023-10-16T20:07:02.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb38003f80 0x7fdb4c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb4c15cb70 0x7fdb4c1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 0x7fdb4c0b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c15cff0 con 0x7fdb4c1f6790 2023-10-16T20:07:02.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b3c90 con 0x7fdb4c15cb70 2023-10-16T20:07:02.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.010+0000 7fdb528fa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b3f70 con 0x7fdb38003f80 2023-10-16T20:07:02.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 0x7fdb4c0b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 0x7fdb4c0b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59408/0 (socket says 172.21.15.152:59408) 2023-10-16T20:07:02.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 -- 172.21.15.152:0/1597751553 learned_addr learned my addr 172.21.15.152:0/1597751553 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:02.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 -- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb38003f80 msgr2=0x7fdb4c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb4c15cb70 0x7fdb4c1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb38003f80 0x7fdb4c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb38003f80 0x7fdb4c15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 -- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb4c15cb70 msgr2=0x7fdb4c1f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb4c15cb70 0x7fdb4c1f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 -- 172.21.15.152:0/1597751553 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0b4250 con 0x7fdb4c1f6790 2023-10-16T20:07:02.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb50e97700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 0x7fdb4c0b4a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c06e5e0 tx=0x7fdb440104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb48ff9700 1 -- 172.21.15.152:0/1597751553 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4401b070 con 0x7fdb4c1f6790 2023-10-16T20:07:02.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb48ff9700 1 -- 172.21.15.152:0/1597751553 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400f040 con 0x7fdb4c1f6790 2023-10-16T20:07:02.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c0b4530 con 0x7fdb4c1f6790 2023-10-16T20:07:02.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb48ff9700 1 -- 172.21.15.152:0/1597751553 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400e050 con 0x7fdb4c1f6790 2023-10-16T20:07:02.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.011+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c1f6c10 con 0x7fdb4c1f6790 2023-10-16T20:07:02.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.013+0000 7fdb48ff9700 1 -- 172.21.15.152:0/1597751553 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb44015440 con 0x7fdb4c1f6790 2023-10-16T20:07:02.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.013+0000 7fdb48ff9700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdb2c06af30 0x7fdb2c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.013+0000 7fdb48ff9700 1 -- 172.21.15.152:0/1597751553 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb440899a0 con 0x7fdb4c1f6790 2023-10-16T20:07:02.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.013+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdb2c06af30 0x7fdb2c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.014+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdb2c06af30 0x7fdb2c06d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000c00 tx=0x7fdb3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.015+0000 7fdb5eae4b80 1 Processor -- start 2023-10-16T20:07:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.015+0000 7fdb5eae4b80 1 -- start start 2023-10-16T20:07:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e995440a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995440fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995414010 0x55e9954146c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99538ac20 con 0x55e995439220 2023-10-16T20:07:02.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99536fc10 con 0x55e995414010 2023-10-16T20:07:02.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e99536d530 con 0x55e99543e630 2023-10-16T20:07:02.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e995440a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e995440a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59412/0 (socket says 172.21.15.152:59412) 2023-10-16T20:07:02.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 -- 172.21.15.152:0/3361476472 learned_addr learned my addr 172.21.15.152:0/3361476472 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb50e97700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995414010 0x55e9954146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995440fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 -- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 msgr2=0x55e995440fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995440fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 -- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995414010 msgr2=0x55e9954146c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995414010 0x55e9954146c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 -- 172.21.15.152:0/3361476472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9953263a0 con 0x55e995439220 2023-10-16T20:07:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb50e97700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995414010 0x55e9954146c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995440fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:02.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.016+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e995440a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0071b0 tx=0x7fdb3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d29558f14f1222 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb41ffb700 1 -- 172.21.15.152:0/3361476472 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c014680 con 0x55e995439220 2023-10-16T20:07:02.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb41ffb700 1 -- 172.21.15.152:0/3361476472 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0147e0 con 0x55e995439220 2023-10-16T20:07:02.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb41ffb700 1 -- 172.21.15.152:0/3361476472 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c014b50 con 0x55e995439220 2023-10-16T20:07:02.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/3361476472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 msgr2=0x55e995440a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e995440a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0071b0 tx=0x7fdb3c013000 comp rx=0 tx=0).stop 2023-10-16T20:07:02.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/3361476472 shutdown_connections 2023-10-16T20:07:02.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995414010 0x55e9954146c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e995440a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/3361476472 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995440fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/3361476472 >> 172.21.15.152:0/3361476472 conn(0x55e995343d80 msgr2=0x55e99545eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/3361476472 shutdown_connections 2023-10-16T20:07:02.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.017+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/3361476472 wait complete. 2023-10-16T20:07:02.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.018+0000 7fdb5eae4b80 1 -- start start 2023-10-16T20:07:02.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.018+0000 7fdb5eae4b80 1 Processor -- start 2023-10-16T20:07:02.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e9954383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995444240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995414450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e995368e20 con 0x55e995414010 2023-10-16T20:07:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9953056c0 con 0x55e995439220 2023-10-16T20:07:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e995305360 con 0x55e99543e630 2023-10-16T20:07:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb5eae4b80 10 client.0 _ll_register_callbacks cb 0x55e9951627b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T20:07:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e9954383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e9954383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59418/0 (socket says 172.21.15.152:59418) 2023-10-16T20:07:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.019+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2406320649 learned_addr learned my addr 172.21.15.152:0/2406320649 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995444240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb50e97700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995414450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 msgr2=0x55e995414450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995414450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 msgr2=0x55e995444240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995444240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2406320649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c00f040 con 0x55e995414010 2023-10-16T20:07:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e9954383e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000fb0 tx=0x7fdb3c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a591f7cb8e017a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb2affd700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T20:07:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb2affd700 1 -- 172.21.15.152:0/2406320649 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c014e30 con 0x55e995414010 2023-10-16T20:07:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb2affd700 1 -- 172.21.15.152:0/2406320649 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb3c01c050 con 0x55e995414010 2023-10-16T20:07:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9954095b0 con 0x55e995414010 2023-10-16T20:07:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb2affd700 1 -- 172.21.15.152:0/2406320649 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb3c02d680 con 0x55e995414010 2023-10-16T20:07:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb5eae4b80 10 client.4827 fetch_fsmap learned FSMap version 9 2023-10-16T20:07:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e995193d90 con 0x55e995414010 2023-10-16T20:07:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb2affd700 1 -- 172.21.15.152:0/2406320649 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9954095b0 con 0x55e995414010 2023-10-16T20:07:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb2affd700 1 -- 172.21.15.152:0/2406320649 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fdb3c02d7e0 con 0x55e995414010 2023-10-16T20:07:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb5eae4b80 10 client.4827 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T20:07:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb5eae4b80 10 client.4827 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T20:07:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.020+0000 7fdb5eae4b80 20 client.4827 populate_metadata read hostname 'smithi152' 2023-10-16T20:07:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e995439c40 0x55e99543a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb5eae4b80 4 client.4827 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T20:07:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 --> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e995361e00 con 0x55e995439c40 2023-10-16T20:07:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e995439c40 0x55e99543a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb2affd700 10 client.4827 ms_handle_connect on v2:172.21.15.152:6835/1439878702 2023-10-16T20:07:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e995439c40 0x55e99543a020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80e2183e73c50baa server_cookie=31b01e537c70008 in_seq=0 out_seq=0 2023-10-16T20:07:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb2affd700 1 -- 172.21.15.152:0/2406320649 <== mds.0 v2:172.21.15.152:6835/1439878702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e995361e00 con 0x55e995439c40 2023-10-16T20:07:02.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb2affd700 10 client.4827 handle_command_reply: tid=0 2023-10-16T20:07:02.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.021+0000 7fdb5eae4b80 1 client.4827 shutdown 2023-10-16T20:07:02.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 msgr2=0x55e9954383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e9954383e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000fb0 tx=0x7fdb3c000fe0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 shutdown_connections 2023-10-16T20:07:02.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e995439c40 0x55e99543a020 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e995414450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb2affd700 0 client.4827 ms_handle_reset on v2:172.21.15.152:6835/1439878702 2023-10-16T20:07:02.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e9954383e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2406320649 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995444240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 >> 172.21.15.152:0/2406320649 conn(0x55e995343d80 msgr2=0x55e99545c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 shutdown_connections 2023-10-16T20:07:02.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2406320649 wait complete. 2023-10-16T20:07:02.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.022+0000 7fdb5eae4b80 20 client.4827 trim_cache size 0 max 16384 2023-10-16T20:07:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.039+0000 7fdb5eae4b80 1 Processor -- start 2023-10-16T20:07:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.039+0000 7fdb5eae4b80 1 -- start start 2023-10-16T20:07:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e995438af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995410d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e99546a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9951e98d0 con 0x55e995414010 2023-10-16T20:07:02.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99540aaf0 con 0x55e995439220 2023-10-16T20:07:02.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e99545faa0 con 0x55e99543e630 2023-10-16T20:07:02.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e995438af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e995438af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59426/0 (socket says 172.21.15.152:59426) 2023-10-16T20:07:02.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2105710616 learned_addr learned my addr 172.21.15.152:0/2105710616 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:02.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb50e97700 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e99546a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 msgr2=0x55e99546a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e99546a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995410d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 msgr2=0x55e995410d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995410d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.040+0000 7fdb4bfff700 1 -- 172.21.15.152:0/2105710616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e99517cc10 con 0x55e995414010 2023-10-16T20:07:02.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e995438af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007f50 tx=0x7fdb3c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2e19261c330bb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb427fc700 1 -- 172.21.15.152:0/2105710616 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c02d680 con 0x55e995414010 2023-10-16T20:07:02.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb427fc700 1 -- 172.21.15.152:0/2105710616 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c02d7e0 con 0x55e995414010 2023-10-16T20:07:02.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb427fc700 1 -- 172.21.15.152:0/2105710616 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c022640 con 0x55e995414010 2023-10-16T20:07:02.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2105710616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 msgr2=0x55e995438af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e995438af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007f50 tx=0x7fdb3c02c000 comp rx=0 tx=0).stop 2023-10-16T20:07:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2105710616 shutdown_connections 2023-10-16T20:07:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e99543e630 0x55e99546a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995414010 0x55e995438af0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2105710616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e995439220 0x55e995410d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2105710616 >> 172.21.15.152:0/2105710616 conn(0x55e995343d80 msgr2=0x55e99543b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2105710616 shutdown_connections 2023-10-16T20:07:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.041+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2105710616 wait complete. 2023-10-16T20:07:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.042+0000 7fdb5eae4b80 1 -- start start 2023-10-16T20:07:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.042+0000 7fdb5eae4b80 1 Processor -- start 2023-10-16T20:07:02.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e995414010 0x55e9954367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e9954371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e99543e630 0x55e995437710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9954c3790 con 0x55e995439220 2023-10-16T20:07:02.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9954c2570 con 0x55e99543e630 2023-10-16T20:07:02.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9954c33f0 con 0x55e995414010 2023-10-16T20:07:02.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb5eae4b80 10 client.0 _ll_register_callbacks cb 0x55e9951627b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T20:07:02.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e9954371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e9954371d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59434/0 (socket says 172.21.15.152:59434) 2023-10-16T20:07:02.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/2020720371 learned_addr learned my addr 172.21.15.152:0/2020720371 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:02.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e995414010 0x55e9954367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb50e97700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e99543e630 0x55e995437710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e995414010 msgr2=0x55e9954367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e995414010 0x55e9954367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e99543e630 msgr2=0x55e995437710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e99543e630 0x55e995437710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 -- 172.21.15.152:0/2020720371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e995193d90 con 0x55e995439220 2023-10-16T20:07:02.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb4b7fe700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e9954371d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb340090b0 tx=0x7fdb34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814faa40a5288854 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.043+0000 7fdb2affd700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T20:07:02.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb2affd700 1 -- 172.21.15.152:0/2020720371 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34006c60 con 0x55e995439220 2023-10-16T20:07:02.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb2affd700 1 -- 172.21.15.152:0/2020720371 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb3402c0b0 con 0x55e995439220 2023-10-16T20:07:02.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb3c0147e0 con 0x55e995439220 2023-10-16T20:07:02.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb2affd700 1 -- 172.21.15.152:0/2020720371 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb3402c270 con 0x55e995439220 2023-10-16T20:07:02.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 10 client.4833 fetch_fsmap learned FSMap version 9 2023-10-16T20:07:02.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e9951ba200 con 0x55e995439220 2023-10-16T20:07:02.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb2affd700 1 -- 172.21.15.152:0/2020720371 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0147e0 con 0x55e995439220 2023-10-16T20:07:02.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb2affd700 1 -- 172.21.15.152:0/2020720371 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fdb34011070 con 0x55e995439220 2023-10-16T20:07:02.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T20:07:02.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 10 client.4833 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T20:07:02.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 20 client.4833 populate_metadata read hostname 'smithi152' 2023-10-16T20:07:02.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e99546d7b0 0x55e995415600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 4 client.4833 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T20:07:02.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 --> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e995361b20 con 0x55e99546d7b0 2023-10-16T20:07:02.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.044+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e99546d7b0 0x55e995415600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb2affd700 10 client.4833 ms_handle_connect on v2:172.21.15.152:6835/1439878702 2023-10-16T20:07:02.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb4bfff700 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e99546d7b0 0x55e995415600 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=191ea701f252a7ff server_cookie=b6a712d1caefaf40 in_seq=0 out_seq=0 2023-10-16T20:07:02.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb2affd700 1 -- 172.21.15.152:0/2020720371 <== mds.0 v2:172.21.15.152:6835/1439878702 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e995361b20 con 0x55e99546d7b0 2023-10-16T20:07:02.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb2affd700 10 client.4833 handle_command_reply: tid=0 2023-10-16T20:07:02.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 client.4833 shutdown 2023-10-16T20:07:02.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 msgr2=0x55e9954371d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e9954371d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb340090b0 tx=0x7fdb34004750 comp rx=0 tx=0).stop 2023-10-16T20:07:02.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 shutdown_connections 2023-10-16T20:07:02.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:6835/1439878702,v1:172.21.15.152:6837/1439878702] conn(0x55e99546d7b0 0x55e995415600 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55e995414010 0x55e9954367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb2affd700 0 client.4833 ms_handle_reset on v2:172.21.15.152:6835/1439878702 2023-10-16T20:07:02.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e99543e630 0x55e995437710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 --2- 172.21.15.152:0/2020720371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e995439220 0x55e9954371d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 >> 172.21.15.152:0/2020720371 conn(0x55e995343d80 msgr2=0x55e995412850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 shutdown_connections 2023-10-16T20:07:02.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 1 -- 172.21.15.152:0/2020720371 wait complete. 2023-10-16T20:07:02.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.045+0000 7fdb5eae4b80 20 client.4833 trim_cache size 0 max 16384 2023-10-16T20:07:02.077 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:07:02.077 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "e602e5ee-bf17-44e1-9fbf-0f448134fb28", 2023-10-16T20:07:02.077 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2023-10-16T20:07:02.078 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4281, 2023-10-16T20:07:02.078 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2023-10-16T20:07:02.078 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2023-10-16T20:07:02.078 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2023-10-16T20:07:02.078 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 29.194966914999998, 2023-10-16T20:07:02.079 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 9, 2023-10-16T20:07:02.079 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 26, 2023-10-16T20:07:02.079 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 26, 2023-10-16T20:07:02.079 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 36.744998770000002 2023-10-16T20:07:02.079 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:07:02.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdb2c06af30 msgr2=0x7fdb2c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdb2c06af30 0x7fdb2c06d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c000c00 tx=0x7fdb3c009040 comp rx=0 tx=0).stop 2023-10-16T20:07:02.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 msgr2=0x7fdb4c0b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 0x7fdb4c0b4a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c06e5e0 tx=0x7fdb440104a0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 shutdown_connections 2023-10-16T20:07:02.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdb2c06af30 0x7fdb2c06d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdb38003f80 0x7fdb4c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4c1f6790 0x7fdb4c0b4a50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 --2- 172.21.15.152:0/1597751553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb4c15cb70 0x7fdb4c1f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 >> 172.21.15.152:0/1597751553 conn(0x7fdb4c06bd50 msgr2=0x7fdb4c0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 shutdown_connections 2023-10-16T20:07:02.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.046+0000 7fdb528fa700 1 -- 172.21.15.152:0/1597751553 wait complete. 2023-10-16T20:07:02.084 INFO:teuthology.run_tasks:Running task kclient... 2023-10-16T20:07:02.097 INFO:tasks.kclient:Mounting kernel clients... 2023-10-16T20:07:02.097 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-16T20:07:02.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.098 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:07:02.115 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-16T20:07:02.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T20:07:02.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-10-16T20:07:02.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.315 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:07:02.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.332 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-10-16T20:07:02.402 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-10-16T20:07:02.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:07:02.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.404 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-10-16T20:07:02.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-10-16T20:07:02.500 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2023-10-16T20:07:02.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:07:02.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.502 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-10-16T20:07:02.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:02.562 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-10-16T20:07:02.632 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2023-10-16T20:07:02.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:07:02.634 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-16T20:07:02.635 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T20:07:02.635 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T20:07:02.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T20:07:02.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.758+0000 7f7ba333b700 1 Processor -- start 2023-10-16T20:07:02.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.758+0000 7f7ba333b700 1 -- start start 2023-10-16T20:07:02.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba333b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba333b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7b9c15b600 0x7f7b9c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba333b700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0c9d40 con 0x7f7b9c0b1860 2023-10-16T20:07:02.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba333b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0b1550 con 0x7f7b9c15b600 2023-10-16T20:07:02.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba333b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0cd6d0 con 0x7f7b9c0b0c30 2023-10-16T20:07:02.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba18d8700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7b9c15b600 0x7f7b9c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba10d7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba08d6700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f7b9c0b1860 0x7f7b9c0ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:54822/0 (socket says 172.21.15.152:54822) 2023-10-16T20:07:02.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba08d6700 1 -- 172.21.15.152:0/2710005863 learned_addr learned my addr 172.21.15.152:0/2710005863 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:02.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba10d7700 1 -- 172.21.15.152:0/2710005863 >> v2:172.21.15.163:3300/0 conn(0x7f7b9c15b600 msgr2=0x7f7b9c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:02.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba10d7700 1 --2- 172.21.15.152:0/2710005863 >> v2:172.21.15.163:3300/0 conn(0x7f7b9c15b600 0x7f7b9c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba10d7700 1 -- 172.21.15.152:0/2710005863 >> v1:172.21.15.163:6789/0 conn(0x7f7b9c0b1860 legacy=0x7f7b9c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7b93fff700 1 -- 172.21.15.152:0/2710005863 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988223669 0 0) 0x7f7b9c0c9d40 con 0x7f7b9c0b1860 2023-10-16T20:07:02.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba10d7700 1 -- 172.21.15.152:0/2710005863 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0cd9a0 con 0x7f7b9c0b0c30 2023-10-16T20:07:02.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.759+0000 7f7ba18d8700 1 --2- 172.21.15.152:0/2710005863 >> v2:172.21.15.163:3300/0 conn(0x7f7b9c15b600 0x7f7b9c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:02.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba10d7700 1 --2- 172.21.15.152:0/2710005863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c0b1010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00bae0 tx=0x7f7b8c00bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ef5e643e812d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7b93fff700 1 -- 172.21.15.152:0/2710005863 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00dc70 con 0x7f7b9c0b0c30 2023-10-16T20:07:02.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7b93fff700 1 -- 172.21.15.152:0/2710005863 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00ddd0 con 0x7f7b9c0b0c30 2023-10-16T20:07:02.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7b93fff700 1 -- 172.21.15.152:0/2710005863 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c010690 con 0x7f7b9c0b0c30 2023-10-16T20:07:02.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 -- 172.21.15.152:0/2710005863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 msgr2=0x7f7b9c0b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 --2- 172.21.15.152:0/2710005863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c0b1010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00bae0 tx=0x7f7b8c00bdf0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 -- 172.21.15.152:0/2710005863 shutdown_connections 2023-10-16T20:07:02.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 --2- 172.21.15.152:0/2710005863 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c0b1010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 --2- 172.21.15.152:0/2710005863 >> v2:172.21.15.163:3300/0 conn(0x7f7b9c15b600 0x7f7b9c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 -- 172.21.15.152:0/2710005863 >> 172.21.15.152:0/2710005863 conn(0x7f7b9c06c850 msgr2=0x7f7b9c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:02.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 -- 172.21.15.152:0/2710005863 shutdown_connections 2023-10-16T20:07:02.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.760+0000 7f7ba333b700 1 -- 172.21.15.152:0/2710005863 wait complete. 2023-10-16T20:07:02.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 Processor -- start 2023-10-16T20:07:02.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 -- start start 2023-10-16T20:07:02.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 0x7f7b9c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b9c15b600 0x7f7b9c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c1f4430 con 0x7f7b9c0b1860 2023-10-16T20:07:02.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c14efe0 con 0x7f7b9c15b600 2023-10-16T20:07:02.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba333b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c1f38b0 con 0x7f7b9c0b0c30 2023-10-16T20:07:02.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba08d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 0x7f7b9c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba08d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 0x7f7b9c152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59448/0 (socket says 172.21.15.152:59448) 2023-10-16T20:07:02.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.762+0000 7f7ba08d6700 1 -- 172.21.15.152:0/3712810558 learned_addr learned my addr 172.21.15.152:0/3712810558 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:02.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba18d8700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b9c15b600 0x7f7b9c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba10d7700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba08d6700 1 -- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 msgr2=0x7f7b9c14eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba08d6700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c14eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba08d6700 1 -- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b9c15b600 msgr2=0x7f7b9c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:02.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba08d6700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b9c15b600 0x7f7b9c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:02.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba08d6700 1 -- 172.21.15.152:0/3712810558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009a70 con 0x7f7b9c0b1860 2023-10-16T20:07:02.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba18d8700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b9c15b600 0x7f7b9c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:02.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba08d6700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 0x7f7b9c152540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800c540 tx=0x7f7b9800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98004c80 con 0x7f7b9c0b1860 2023-10-16T20:07:02.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b98004de0 con 0x7f7b9c0b1860 2023-10-16T20:07:02.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c00b740 con 0x7f7b9c0b1860 2023-10-16T20:07:02.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98007310 con 0x7f7b9c0b1860 2023-10-16T20:07:02.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.763+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c1f3e70 con 0x7f7b9c0b1860 2023-10-16T20:07:02.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.764+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c04f400 con 0x7f7b9c0b1860 2023-10-16T20:07:02.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.764+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b98007470 con 0x7f7b9c0b1860 2023-10-16T20:07:02.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.765+0000 7f7b91ffb700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b8006af00 0x7f7b8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:02.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.765+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b980895c0 con 0x7f7b9c0b1860 2023-10-16T20:07:02.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.765+0000 7f7ba10d7700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b8006af00 0x7f7b8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:02.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.765+0000 7f7ba10d7700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b8006af00 0x7f7b8006d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00be30 tx=0x7f7b8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:02.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:02.769+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b98054410 con 0x7f7b9c0b1860 2023-10-16T20:07:03.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.004+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b9c04ebb0 con 0x7f7b9c0b1860 2023-10-16T20:07:03.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.005+0000 7f7b91ffb700 1 -- 172.21.15.152:0/3712810558 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7b98057a30 con 0x7f7b9c0b1860 2023-10-16T20:07:03.007 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T20:07:03.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b8006af00 msgr2=0x7f7b8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:03.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b8006af00 0x7f7b8006d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00be30 tx=0x7f7b8c008040 comp rx=0 tx=0).stop 2023-10-16T20:07:03.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 msgr2=0x7f7b9c152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:03.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 0x7f7b9c152540 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800c540 tx=0x7f7b9800c900 comp rx=0 tx=0).stop 2023-10-16T20:07:03.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 shutdown_connections 2023-10-16T20:07:03.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7b8006af00 0x7f7b8006d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:03.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7b9c0b0c30 0x7f7b9c14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:03.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7b9c15b600 0x7f7b9c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:03.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 --2- 172.21.15.152:0/3712810558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b9c0b1860 0x7f7b9c152540 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:03.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 >> 172.21.15.152:0/3712810558 conn(0x7f7b9c06c850 msgr2=0x7f7b9c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:03.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 shutdown_connections 2023-10-16T20:07:03.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:03.007+0000 7f7ba333b700 1 -- 172.21.15.152:0/3712810558 wait complete. 2023-10-16T20:07:03.021 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T20:07:03.022 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T20:07:03.022 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-10-16T20:07:03.023 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T20:07:03.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T20:07:03.023 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T20:07:03.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T20:07:03.024 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T20:07:03.025 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T20:07:03.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.026 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-10-16T20:07:03.043 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:03.044 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:03.044 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:03.044 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:03.045 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:03.045 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:03.045 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:03.046 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:03.046 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:03.046 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:03.046 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:03.046 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:03.047 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T20:07:03.047 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:03.047 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T20:07:03.047 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42352sec preferred_lft 42352sec 2023-10-16T20:07:03.047 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d48f:a759:35f6:99dd/64 scope link noprefixroute 2023-10-16T20:07:03.048 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:03.048 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T20:07:03.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.049 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:03.049 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:03.049 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2023-10-16T20:07:03.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2023-10-16T20:07:03.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2023-10-16T20:07:03.051 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T20:07:03.051 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:03.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.161 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T20:07:03.187 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-10-16T20:07:03.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.189 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-10-16T20:07:03.247 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-10-16T20:07:03.248 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T20:07:03.248 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T20:07:03.248 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T20:07:03.248 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T20:07:03.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.249 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:03.249 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:03.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T20:07:03.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T20:07:03.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T20:07:03.251 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:03.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.353 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:07:03.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.370 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-10-16T20:07:03.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.426 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:03.427 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:03.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T20:07:03.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T20:07:03.428 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:03.519 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T20:07:03.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.521 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:03.521 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:03.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T20:07:03.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T20:07:03.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T20:07:03.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T20:07:03.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T20:07:03.524 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:03.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.734 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:03.734 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:03.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2023-10-16T20:07:03.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T20:07:03.735 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:03.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:03.845 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T20:07:03.866 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T20:07:03.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:03.866 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T20:07:03.922 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-16T20:07:03.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:03.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:07:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:07:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-16T20:07:04.010 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:07:04.107 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:07:04.108 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-16T20:07:04.108 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:07:04.108 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:04.108 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:04.182 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:07:04.182 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-16T20:07:04.183 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:07:04.183 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:04.183 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:04.184 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790" 2023-10-16T20:07:04.184 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790:/ 2023-10-16T20:07:04.184 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e602e5ee-bf17-44e1-9fbf-0f448134fb28" will pass to kernel 2023-10-16T20:07:04.185 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T20:07:04.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:04.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T20:07:04.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:04.214 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:04.285 INFO:teuthology.orchestra.run.smithi152.stdout:client4711 2023-10-16T20:07:04.286 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:04.286 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:04.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:04.343 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:04.414 INFO:teuthology.orchestra.run.smithi152.stdout:client4711 2023-10-16T20:07:04.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:04.415 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:04.487 INFO:teuthology.orchestra.run.smithi152.stdout:client4711 2023-10-16T20:07:04.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:04.488 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e602e5ee-bf17-44e1-9fbf-0f448134fb28.client4711/status') 2023-10-16T20:07:04.568 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4711 (3)172.21.15.152:0/3840072123 2023-10-16T20:07:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2023-10-16T20:07:04.570 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2023-10-16T20:07:04.570 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2023-10-16T20:07:04.570 INFO:teuthology.orchestra.run.smithi152.stderr:71 bytes copied, 3.6396e-05 s, 2.0 MB/s 2023-10-16T20:07:04.571 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-16T20:07:04.571 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T20:07:04.571 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T20:07:04.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T20:07:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.727+0000 7f60d8ad1700 1 Processor -- start 2023-10-16T20:07:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.727+0000 7f60d8ad1700 1 -- start start 2023-10-16T20:07:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d8ad1700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60d415daa0 0x7f60d40af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d8ad1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d40af560 0x7f60d4071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d8ad1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f60d4071d90 0x7f60d40ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d8ad1700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d4072200 con 0x7f60d415daa0 2023-10-16T20:07:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d8ad1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d415ed10 con 0x7f60d4071d90 2023-10-16T20:07:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d8ad1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d415de80 con 0x7f60d40af560 2023-10-16T20:07:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d259c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60d415daa0 0x7f60d40af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d259c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60d415daa0 0x7f60d40af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59458/0 (socket says 172.21.15.152:59458) 2023-10-16T20:07:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d259c700 1 -- 172.21.15.152:0/3762766683 learned_addr learned my addr 172.21.15.152:0/3762766683 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.728+0000 7f60d2d9d700 1 --2- 172.21.15.152:0/3762766683 >> v2:172.21.15.163:3300/0 conn(0x7f60d4071d90 0x7f60d40ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d1d9b700 1 --2- 172.21.15.152:0/3762766683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d40af560 0x7f60d4071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d259c700 1 -- 172.21.15.152:0/3762766683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d40af560 msgr2=0x7f60d4071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d259c700 1 --2- 172.21.15.152:0/3762766683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d40af560 0x7f60d4071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d259c700 1 -- 172.21.15.152:0/3762766683 >> v2:172.21.15.163:3300/0 conn(0x7f60d4071d90 msgr2=0x7f60d40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d259c700 1 --2- 172.21.15.152:0/3762766683 >> v2:172.21.15.163:3300/0 conn(0x7f60d4071d90 0x7f60d40ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d259c700 1 -- 172.21.15.152:0/3762766683 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d415e100 con 0x7f60d415daa0 2023-10-16T20:07:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d259c700 1 --2- 172.21.15.152:0/3762766683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d415daa0 0x7f60d40af020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f60d406f2e0 tx=0x7f60c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d42dd38ac9dc60 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:04.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d159a700 1 -- 172.21.15.152:0/3762766683 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800b870 con 0x7f60d415daa0 2023-10-16T20:07:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d159a700 1 -- 172.21.15.152:0/3762766683 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c800b9d0 con 0x7f60d415daa0 2023-10-16T20:07:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d159a700 1 -- 172.21.15.152:0/3762766683 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800bd60 con 0x7f60d415daa0 2023-10-16T20:07:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d8ad1700 1 -- 172.21.15.152:0/3762766683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d415daa0 msgr2=0x7f60d40af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.729+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/3762766683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d415daa0 0x7f60d40af020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f60d406f2e0 tx=0x7f60c8009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 -- 172.21.15.152:0/3762766683 shutdown_connections 2023-10-16T20:07:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/3762766683 >> v2:172.21.15.163:3300/0 conn(0x7f60d4071d90 0x7f60d40ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/3762766683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d415daa0 0x7f60d40af020 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/3762766683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d40af560 0x7f60d4071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 -- 172.21.15.152:0/3762766683 >> 172.21.15.152:0/3762766683 conn(0x7f60d40d0180 msgr2=0x7f60d40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:04.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 -- 172.21.15.152:0/3762766683 shutdown_connections 2023-10-16T20:07:04.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.730+0000 7f60d8ad1700 1 -- 172.21.15.152:0/3762766683 wait complete. 2023-10-16T20:07:04.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.731+0000 7f60d8ad1700 1 Processor -- start 2023-10-16T20:07:04.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.731+0000 7f60d8ad1700 1 -- start start 2023-10-16T20:07:04.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d4071d90 0x7f60d40c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 0x7f60d415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d415daa0 0x7f60d40c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d415d1f0 con 0x7f60d40af560 2023-10-16T20:07:04.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d415c5e0 con 0x7f60d4071d90 2023-10-16T20:07:04.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d415c8c0 con 0x7f60d415daa0 2023-10-16T20:07:04.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 0x7f60d415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 0x7f60d415bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59466/0 (socket says 172.21.15.152:59466) 2023-10-16T20:07:04.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 -- 172.21.15.152:0/2426999626 learned_addr learned my addr 172.21.15.152:0/2426999626 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:04.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d259c700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d4071d90 0x7f60d40c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d2d9d700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d415daa0 0x7f60d40c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 -- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d415daa0 msgr2=0x7f60d40c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:04.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d415daa0 0x7f60d40c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 -- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d4071d90 msgr2=0x7f60d40c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:04.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d4071d90 0x7f60d40c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 -- 172.21.15.152:0/2426999626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8009550 con 0x7f60d40af560 2023-10-16T20:07:04.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d1d9b700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 0x7f60d415bbf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c7f0 tx=0x7f60c400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:04.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c4004220 con 0x7f60d40af560 2023-10-16T20:07:04.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c4004380 con 0x7f60d40af560 2023-10-16T20:07:04.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d415cba0 con 0x7f60d40af560 2023-10-16T20:07:04.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40036a0 con 0x7f60d40af560 2023-10-16T20:07:04.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.732+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d40c3740 con 0x7f60d40af560 2023-10-16T20:07:04.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.733+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d404ebb0 con 0x7f60d40af560 2023-10-16T20:07:04.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.734+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f60c4003800 con 0x7f60d40af560 2023-10-16T20:07:04.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.734+0000 7f60c2ffd700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60b406af00 0x7f60b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:04.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.734+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60c4089320 con 0x7f60d40af560 2023-10-16T20:07:04.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.734+0000 7f60d259c700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60b406af00 0x7f60b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:04.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.735+0000 7f60d259c700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60b406af00 0x7f60b406d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000c00 tx=0x7f60c8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:04.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.739+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60c40540e0 con 0x7f60d40af560 2023-10-16T20:07:04.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.976+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f60d4072690 con 0x7f60d40af560 2023-10-16T20:07:04.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.976+0000 7f60c2ffd700 1 -- 172.21.15.152:0/2426999626 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f60c4057700 con 0x7f60d40af560 2023-10-16T20:07:04.980 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T20:07:04.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60b406af00 msgr2=0x7f60b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:04.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60b406af00 0x7f60b406d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000c00 tx=0x7f60c8008030 comp rx=0 tx=0).stop 2023-10-16T20:07:04.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 msgr2=0x7f60d415bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:04.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 0x7f60d415bbf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f60c400c7f0 tx=0x7f60c400cb00 comp rx=0 tx=0).stop 2023-10-16T20:07:04.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 shutdown_connections 2023-10-16T20:07:04.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60b406af00 0x7f60b406d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d415daa0 0x7f60d40c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d4071d90 0x7f60d40c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 --2- 172.21.15.152:0/2426999626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d40af560 0x7f60d415bbf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:04.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.978+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 >> 172.21.15.152:0/2426999626 conn(0x7f60d40d0180 msgr2=0x7f60d40cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:04.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.979+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 shutdown_connections 2023-10-16T20:07:04.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:04.979+0000 7f60d8ad1700 1 -- 172.21.15.152:0/2426999626 wait complete. 2023-10-16T20:07:04.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T20:07:04.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T20:07:04.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-10-16T20:07:04.994 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T20:07:04.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T20:07:04.994 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T20:07:04.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T20:07:04.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T20:07:04.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T20:07:04.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:04.996 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-10-16T20:07:05.012 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:05.013 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:05.013 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:05.013 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.013 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:05.013 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.014 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:05.014 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:05.014 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:05.014 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:05.014 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:05.015 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:05.015 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T20:07:05.015 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:05.015 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T20:07:05.015 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-10-16T20:07:05.016 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d48f:a759:35f6:99dd/64 scope link noprefixroute 2023-10-16T20:07:05.016 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.016 INFO:teuthology.orchestra.run.smithi152.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:07:05.016 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0e:34:21:58:f2:2b brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:05.017 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T20:07:05.017 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.017 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::54a3:24ff:fe6e:d2b0/64 scope link 2023-10-16T20:07:05.017 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.017 INFO:teuthology.orchestra.run.smithi152.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T20:07:05.017 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0e:34:21:58:f2:2b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T20:07:05.018 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::c34:21ff:fe58:f22b/64 scope link tentative 2023-10-16T20:07:05.018 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.018 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T20:07:05.077 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-10-16T20:07:05.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.079 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-10-16T20:07:05.138 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-10-16T20:07:05.139 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T20:07:05.139 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T20:07:05.139 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T20:07:05.139 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T20:07:05.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.140 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:05.140 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:05.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T20:07:05.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T20:07:05.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T20:07:05.141 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:05.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.244 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:07:05.260 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T20:07:05.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.261 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-10-16T20:07:05.317 INFO:teuthology.orchestra.run.smithi152.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-16T20:07:05.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.319 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:05.319 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:05.319 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T20:07:05.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-16T20:07:05.320 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:05.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T20:07:05.457 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:05.458 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:05.458 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:05.458 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.458 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:05.459 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.459 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:07:05.459 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether da:9b:4b:6a:ba:21 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T20:07:05.459 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T20:07:05.459 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.460 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d89b:4bff:fe6a:ba21/64 scope link tentative 2023-10-16T20:07:05.460 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T20:07:05.513 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:05.513 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:05.514 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:05.514 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.514 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:05.515 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.515 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:07:05.515 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether da:9b:4b:6a:ba:21 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T20:07:05.515 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T20:07:05.515 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.515 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d89b:4bff:fe6a:ba21/64 scope link tentative 2023-10-16T20:07:05.516 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:05.525 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-16T20:07:05.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.526 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:05.526 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:05.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-16T20:07:05.527 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T20:07:05.527 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T20:07:05.527 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T20:07:05.528 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T20:07:05.528 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:05.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.787 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:07:05.787 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:07:05.787 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.1 up 2023-10-16T20:07:05.787 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T20:07:05.788 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:07:05.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:05.912 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T20:07:05.934 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T20:07:05.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:05.935 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T20:07:05.991 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-16T20:07:05.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:05.991 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-16T20:07:06.078 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-16T20:07:06.078 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-16T20:07:06.079 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:07:06.086 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-16T20:07:06.087 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-16T20:07:06.087 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:07:06.087 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:06.087 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:06.161 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-16T20:07:06.161 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-16T20:07:06.162 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:07:06.162 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:06.162 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:06.162 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790" 2023-10-16T20:07:06.163 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790:/ 2023-10-16T20:07:06.163 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=e602e5ee-bf17-44e1-9fbf-0f448134fb28" will pass to kernel 2023-10-16T20:07:06.164 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T20:07:06.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T20:07:06.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.190 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:06.262 INFO:teuthology.orchestra.run.smithi152.stdout:client4720 2023-10-16T20:07:06.263 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:06.263 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:06.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.320 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:06.392 INFO:teuthology.orchestra.run.smithi152.stdout:client4720 2023-10-16T20:07:06.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.393 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:06.465 INFO:teuthology.orchestra.run.smithi152.stdout:client4720 2023-10-16T20:07:06.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.466 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e602e5ee-bf17-44e1-9fbf-0f448134fb28.client4720/status') 2023-10-16T20:07:06.546 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4720 (3)172.21.15.152:0/3596788158 2023-10-16T20:07:06.546 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2023-10-16T20:07:06.547 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2023-10-16T20:07:06.547 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2023-10-16T20:07:06.547 INFO:teuthology.orchestra.run.smithi152.stderr:71 bytes copied, 2.1919e-05 s, 3.2 MB/s 2023-10-16T20:07:06.548 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-16T20:07:06.548 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T20:07:06.548 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T20:07:06.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T20:07:06.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.704+0000 7f7c603fe700 1 Processor -- start 2023-10-16T20:07:06.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.704+0000 7f7c603fe700 1 -- start start 2023-10-16T20:07:06.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c603fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c58152470 0x7f7c580cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c603fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7c580cb8d0 0x7f7c580b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c603fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580b3240 0x7f7c580b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c603fe700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580b36d0 con 0x7f7c58152470 2023-10-16T20:07:06.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c603fe700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c58071200 con 0x7f7c580cb8d0 2023-10-16T20:07:06.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c603fe700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58070d70 con 0x7f7c580b3240 2023-10-16T20:07:06.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c58152470 0x7f7c580cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c58152470 0x7f7c580cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59476/0 (socket says 172.21.15.152:59476) 2023-10-16T20:07:06.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 -- 172.21.15.152:0/1523296542 learned_addr learned my addr 172.21.15.152:0/1523296542 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:06.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5d999700 1 --2- 172.21.15.152:0/1523296542 >> v2:172.21.15.163:3300/0 conn(0x7f7c580cb8d0 0x7f7c580b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e99b700 1 --2- 172.21.15.152:0/1523296542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580b3240 0x7f7c580b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 -- 172.21.15.152:0/1523296542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580b3240 msgr2=0x7f7c580b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:06.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 --2- 172.21.15.152:0/1523296542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580b3240 0x7f7c580b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 -- 172.21.15.152:0/1523296542 >> v2:172.21.15.163:3300/0 conn(0x7f7c580cb8d0 msgr2=0x7f7c580b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:06.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 --2- 172.21.15.152:0/1523296542 >> v2:172.21.15.163:3300/0 conn(0x7f7c580cb8d0 0x7f7c580b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 -- 172.21.15.152:0/1523296542 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580cbd80 con 0x7f7c58152470 2023-10-16T20:07:06.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5e19a700 1 --2- 172.21.15.152:0/1523296542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c580cd570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7c580cd2e0 tx=0x7f7c48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2e665a0dcd8a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:06.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5d198700 1 -- 172.21.15.152:0/1523296542 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800b870 con 0x7f7c58152470 2023-10-16T20:07:06.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5d198700 1 -- 172.21.15.152:0/1523296542 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800b9d0 con 0x7f7c58152470 2023-10-16T20:07:06.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.706+0000 7f7c5d198700 1 -- 172.21.15.152:0/1523296542 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800bd60 con 0x7f7c58152470 2023-10-16T20:07:06.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 -- 172.21.15.152:0/1523296542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 msgr2=0x7f7c580cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:06.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 --2- 172.21.15.152:0/1523296542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c580cd570 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7c580cd2e0 tx=0x7f7c48009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 -- 172.21.15.152:0/1523296542 shutdown_connections 2023-10-16T20:07:06.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 --2- 172.21.15.152:0/1523296542 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580b3240 0x7f7c580b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 --2- 172.21.15.152:0/1523296542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c580cd570 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 --2- 172.21.15.152:0/1523296542 >> v2:172.21.15.163:3300/0 conn(0x7f7c580cb8d0 0x7f7c580b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 -- 172.21.15.152:0/1523296542 >> 172.21.15.152:0/1523296542 conn(0x7f7c580cdd00 msgr2=0x7f7c580ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:06.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 -- 172.21.15.152:0/1523296542 shutdown_connections 2023-10-16T20:07:06.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.707+0000 7f7c603fe700 1 -- 172.21.15.152:0/1523296542 wait complete. 2023-10-16T20:07:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.709+0000 7f7c603fe700 1 Processor -- start 2023-10-16T20:07:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.709+0000 7f7c603fe700 1 -- start start 2023-10-16T20:07:06.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.709+0000 7f7c603fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c580b3240 0x7f7c58149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580cb8d0 0x7f7c581f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c5815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c83f0 con 0x7f7c58152470 2023-10-16T20:07:06.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58149f90 con 0x7f7c580b3240 2023-10-16T20:07:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c8690 con 0x7f7c580cb8d0 2023-10-16T20:07:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c5815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c5815d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59486/0 (socket says 172.21.15.152:59486) 2023-10-16T20:07:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 -- 172.21.15.152:0/3566722616 learned_addr learned my addr 172.21.15.152:0/3566722616 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e19a700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c580b3240 0x7f7c58149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5d999700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580cb8d0 0x7f7c581f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 -- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580cb8d0 msgr2=0x7f7c581f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580cb8d0 0x7f7c581f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 -- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c580b3240 msgr2=0x7f7c58149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c580b3240 0x7f7c58149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 -- 172.21.15.152:0/3566722616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48009550 con 0x7f7c58152470 2023-10-16T20:07:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c5e99b700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c5815d890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c50007d20 tx=0x7f7c5000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000ed30 con 0x7f7c58152470 2023-10-16T20:07:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50007e70 con 0x7f7c58152470 2023-10-16T20:07:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580c8970 con 0x7f7c58152470 2023-10-16T20:07:06.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50014640 con 0x7f7c58152470 2023-10-16T20:07:06.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.710+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c580c8f30 con 0x7f7c58152470 2023-10-16T20:07:06.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.711+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5804ebb0 con 0x7f7c58152470 2023-10-16T20:07:06.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.712+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c500147a0 con 0x7f7c58152470 2023-10-16T20:07:06.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.712+0000 7f7c4effd700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3c06af00 0x7f7c3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:06.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.712+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c50089e50 con 0x7f7c58152470 2023-10-16T20:07:06.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.712+0000 7f7c5e19a700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3c06af00 0x7f7c3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:06.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.713+0000 7f7c5e19a700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3c06af00 0x7f7c3c06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c48000c00 tx=0x7f7c48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:06.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.716+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c50054c10 con 0x7f7c58152470 2023-10-16T20:07:06.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.952+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c5806f630 con 0x7f7c58152470 2023-10-16T20:07:06.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.953+0000 7f7c4effd700 1 -- 172.21.15.152:0/3566722616 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7c50058230 con 0x7f7c58152470 2023-10-16T20:07:06.956 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T20:07:06.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3c06af00 msgr2=0x7f7c3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:06.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3c06af00 0x7f7c3c06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c48000c00 tx=0x7f7c48008030 comp rx=0 tx=0).stop 2023-10-16T20:07:06.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 msgr2=0x7f7c5815d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:06.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c5815d890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c50007d20 tx=0x7f7c5000e3c0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 shutdown_connections 2023-10-16T20:07:06.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3c06af00 0x7f7c3c06d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c58152470 0x7f7c5815d890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c580b3240 0x7f7c58149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 --2- 172.21.15.152:0/3566722616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c580cb8d0 0x7f7c581f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:06.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 >> 172.21.15.152:0/3566722616 conn(0x7f7c580cdd00 msgr2=0x7f7c580b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:06.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 shutdown_connections 2023-10-16T20:07:06.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:06.955+0000 7f7c603fe700 1 -- 172.21.15.152:0/3566722616 wait complete. 2023-10-16T20:07:06.970 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T20:07:06.970 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T20:07:06.971 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2023-10-16T20:07:06.971 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T20:07:06.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T20:07:06.971 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T20:07:06.972 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T20:07:06.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T20:07:06.972 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T20:07:06.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.973 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2023-10-16T20:07:06.994 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:06.994 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:06.994 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:06.995 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:06.995 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:06.995 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:06.995 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:06.995 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:06.996 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:06.996 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:06.996 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:06.996 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:06.996 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T20:07:06.997 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:06.997 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T20:07:06.997 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42372sec preferred_lft 42372sec 2023-10-16T20:07:06.997 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::7446:84b0:f9:3a0f/64 scope link noprefixroute 2023-10-16T20:07:06.998 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:06.998 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T20:07:06.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:06.999 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:06.999 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:06.999 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2023-10-16T20:07:06.999 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2023-10-16T20:07:07.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2023-10-16T20:07:07.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T20:07:07.000 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:07.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.293 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T20:07:07.322 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-10-16T20:07:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.323 DEBUG:teuthology.orchestra.run.smithi163:> route 2023-10-16T20:07:07.397 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2023-10-16T20:07:07.397 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T20:07:07.397 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T20:07:07.398 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T20:07:07.398 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T20:07:07.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.399 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:07.399 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:07.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T20:07:07.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T20:07:07.400 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T20:07:07.400 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:07.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.653 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-10-16T20:07:07.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.671 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2023-10-16T20:07:07.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.728 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:07.728 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:07.729 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T20:07:07.729 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T20:07:07.730 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:07.820 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T20:07:07.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:07.821 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:07.822 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:07.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T20:07:07.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T20:07:07.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T20:07:07.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T20:07:07.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T20:07:07.823 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:08.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.031 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:08.032 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:08.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2023-10-16T20:07:08.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T20:07:08.032 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:08.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:08.138 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T20:07:08.157 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T20:07:08.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:08.157 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T20:07:08.213 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-16T20:07:08.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-16T20:07:08.315 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-16T20:07:08.316 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-16T20:07:08.316 INFO:teuthology.orchestra.run.smithi163.stdout:invalid new device string format 2023-10-16T20:07:08.424 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-16T20:07:08.425 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-16T20:07:08.425 INFO:teuthology.orchestra.run.smithi163.stdout:invalid new device string format 2023-10-16T20:07:08.425 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:08.425 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:08.455 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-16T20:07:08.455 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-16T20:07:08.456 INFO:teuthology.orchestra.run.smithi163.stdout:invalid new device string format 2023-10-16T20:07:08.456 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:08.456 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:08.457 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790" 2023-10-16T20:07:08.457 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790:/ 2023-10-16T20:07:08.458 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e602e5ee-bf17-44e1-9fbf-0f448134fb28" will pass to kernel 2023-10-16T20:07:08.460 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T20:07:08.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.461 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T20:07:08.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.496 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:08.568 INFO:teuthology.orchestra.run.smithi163.stdout:client4592 2023-10-16T20:07:08.568 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:08.568 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:08.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.626 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:08.697 INFO:teuthology.orchestra.run.smithi163.stdout:client4592 2023-10-16T20:07:08.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.698 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:08.770 INFO:teuthology.orchestra.run.smithi163.stdout:client4592 2023-10-16T20:07:08.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:08.772 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e602e5ee-bf17-44e1-9fbf-0f448134fb28.client4592/status') 2023-10-16T20:07:08.852 INFO:teuthology.orchestra.run.smithi163.stdout:instance: client.4592 (3)192.168.0.1:0/2696832576 2023-10-16T20:07:08.853 INFO:teuthology.orchestra.run.smithi163.stdout:blocklisted: false 2023-10-16T20:07:08.854 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records in 2023-10-16T20:07:08.854 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records out 2023-10-16T20:07:08.854 INFO:teuthology.orchestra.run.smithi163.stderr:69 bytes copied, 2.1373e-05 s, 3.2 MB/s 2023-10-16T20:07:08.855 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-16T20:07:08.855 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T20:07:08.855 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T20:07:08.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T20:07:08.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.988+0000 7f7ae11cb700 1 Processor -- start 2023-10-16T20:07:08.992 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.988+0000 7f7ae11cb700 1 -- start start 2023-10-16T20:07:08.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7ae11cb700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc165500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:08.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7ae11cb700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc06f270 con 0x7f7adc06dfc0 2023-10-16T20:07:08.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7ae11cb700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc15aa30 con 0x7f7adc15a650 2023-10-16T20:07:08.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7ae11cb700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc06e470 con 0x7f7adc071ef0 2023-10-16T20:07:08.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7ada59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7adc06dfc0 0x7f7adc0717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39690/0 (socket says 172.21.15.152:39690) 2023-10-16T20:07:08.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7ada59c700 1 -- 172.21.15.152:0/1658791730 learned_addr learned my addr 172.21.15.152:0/1658791730 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:08.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.989+0000 7f7adb59e700 1 --2- 172.21.15.152:0/1658791730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:08.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418898160 0 0) 0x7f7adc06f270 con 0x7f7adc06dfc0 2023-10-16T20:07:08.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac40035b0 con 0x7f7adc06dfc0 2023-10-16T20:07:08.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723286876 0 0) 0x7f7adc15aa30 con 0x7f7adc15a650 2023-10-16T20:07:08.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7adc06f270 con 0x7f7adc15a650 2023-10-16T20:07:08.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7adb59e700 1 -- 172.21.15.152:0/1658791730 >> v1:172.21.15.163:6789/0 conn(0x7f7adc15a650 legacy=0x7f7adc15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:08.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7adb59e700 1 -- 172.21.15.152:0/1658791730 >> v1:172.21.15.152:6789/0 conn(0x7f7adc06dfc0 legacy=0x7f7adc0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:08.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7adb59e700 1 -- 172.21.15.152:0/1658791730 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc06e660 con 0x7f7adc071ef0 2023-10-16T20:07:08.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7adb59e700 1 --2- 172.21.15.152:0/1658791730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc165500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009dc0 tx=0x7f7ad400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc1dc3223b7eda9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:08.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400e070 con 0x7f7adc071ef0 2023-10-16T20:07:08.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad400bb20 con 0x7f7adc071ef0 2023-10-16T20:07:08.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.990+0000 7f7ad9d9b700 1 -- 172.21.15.152:0/1658791730 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4012430 con 0x7f7adc071ef0 2023-10-16T20:07:08.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1658791730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 msgr2=0x7f7adc165500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:08.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1658791730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc165500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009dc0 tx=0x7f7ad400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:08.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1658791730 shutdown_connections 2023-10-16T20:07:08.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1658791730 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc165500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:08.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1658791730 >> 172.21.15.152:0/1658791730 conn(0x7f7adc0d0180 msgr2=0x7f7adc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:08.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1658791730 shutdown_connections 2023-10-16T20:07:09.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.991+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1658791730 wait complete. 2023-10-16T20:07:09.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.992+0000 7f7ae11cb700 1 Processor -- start 2023-10-16T20:07:09.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.992+0000 7f7ae11cb700 1 -- start start 2023-10-16T20:07:09.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ae11cb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 0x7f7adc09a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:09.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ae11cb700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc09c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ae11cb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 0x7f7adc09c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ae11cb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b3000 con 0x7f7adc06dfc0 2023-10-16T20:07:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ae11cb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b3250 con 0x7f7adc15a650 2023-10-16T20:07:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ae11cb700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b3530 con 0x7f7adc071ef0 2023-10-16T20:07:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 0x7f7adc09a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 0x7f7adc09c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:09.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7ada59c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc09c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:09.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 0x7f7adc09c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60500/0 (socket says 172.21.15.152:60500) 2023-10-16T20:07:09.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 -- 172.21.15.152:0/1372988882 learned_addr learned my addr 172.21.15.152:0/1372988882 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:09.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 0x7f7adc09a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59496/0 (socket says 172.21.15.152:59496) 2023-10-16T20:07:09.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 -- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 msgr2=0x7f7adc09c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:09.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc09c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 -- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 msgr2=0x7f7adc09a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:09.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 0x7f7adc09a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adb59e700 1 -- 172.21.15.152:0/1372988882 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4009a70 con 0x7f7adc15a650 2023-10-16T20:07:09.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.993+0000 7f7adad9d700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 0x7f7adc09a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:09.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.994+0000 7f7adb59e700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 0x7f7adc09c5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b370 tx=0x7f7ad4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:09.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.994+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad401b810 con 0x7f7adc15a650 2023-10-16T20:07:09.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.994+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4020070 con 0x7f7adc15a650 2023-10-16T20:07:09.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.994+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc0b3810 con 0x7f7adc15a650 2023-10-16T20:07:09.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.994+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad401bbb0 con 0x7f7adc15a650 2023-10-16T20:07:09.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.994+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc09ae60 con 0x7f7adc15a650 2023-10-16T20:07:09.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.995+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc04ebb0 con 0x7f7adc15a650 2023-10-16T20:07:09.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.995+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ad401bd10 con 0x7f7adc15a650 2023-10-16T20:07:09.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.995+0000 7f7ac37fe700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7ac806af00 0x7f7ac806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:09.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.996+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ad4022070 con 0x7f7adc15a650 2023-10-16T20:07:09.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.996+0000 7f7adad9d700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7ac806af00 0x7f7ac806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:09.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:08.996+0000 7f7adad9d700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7ac806af00 0x7f7ac806d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00011e0 tx=0x7f7ad0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:09.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.000+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ad4056570 con 0x7f7adc15a650 2023-10-16T20:07:09.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.238+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7adc09aff0 con 0x7f7adc15a650 2023-10-16T20:07:09.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.239+0000 7f7ac37fe700 1 -- 172.21.15.152:0/1372988882 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7ad4059b90 con 0x7f7adc15a650 2023-10-16T20:07:09.242 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T20:07:09.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7ac806af00 msgr2=0x7f7ac806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:09.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7ac806af00 0x7f7ac806d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00011e0 tx=0x7f7ad0009040 comp rx=0 tx=0).stop 2023-10-16T20:07:09.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 msgr2=0x7f7adc09c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:09.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 0x7f7adc09c5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b370 tx=0x7f7ad4004ad0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 shutdown_connections 2023-10-16T20:07:09.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7ac806af00 0x7f7ac806d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7adc15a650 0x7f7adc09c5f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7adc06dfc0 0x7f7adc09a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 --2- 172.21.15.152:0/1372988882 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7adc071ef0 0x7f7adc09c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:09.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 >> 172.21.15.152:0/1372988882 conn(0x7f7adc0d0180 msgr2=0x7f7adc15abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:09.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 shutdown_connections 2023-10-16T20:07:09.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:09.241+0000 7f7ae11cb700 1 -- 172.21.15.152:0/1372988882 wait complete. 2023-10-16T20:07:09.256 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T20:07:09.256 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T20:07:09.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2023-10-16T20:07:09.257 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-16T20:07:09.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T20:07:09.258 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T20:07:09.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T20:07:09.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T20:07:09.258 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-16T20:07:09.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.259 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2023-10-16T20:07:09.277 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:09.277 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:09.277 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:09.278 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.278 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:09.278 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.278 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:09.279 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:09.279 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:09.279 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:09.279 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:07:09.280 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:09.280 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T20:07:09.280 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:09.280 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T20:07:09.280 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-10-16T20:07:09.280 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::7446:84b0:f9:3a0f/64 scope link noprefixroute 2023-10-16T20:07:09.281 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.281 INFO:teuthology.orchestra.run.smithi163.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:07:09.281 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether d2:a9:79:62:25:1c brd ff:ff:ff:ff:ff:ff 2023-10-16T20:07:09.281 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T20:07:09.281 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.282 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::b891:6cff:fe3c:76b7/64 scope link 2023-10-16T20:07:09.282 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.282 INFO:teuthology.orchestra.run.smithi163.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T20:07:09.282 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether d2:a9:79:62:25:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T20:07:09.282 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::d0a9:79ff:fe62:251c/64 scope link tentative 2023-10-16T20:07:09.283 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.283 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T20:07:09.343 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-10-16T20:07:09.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.344 DEBUG:teuthology.orchestra.run.smithi163:> route 2023-10-16T20:07:09.402 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2023-10-16T20:07:09.403 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T20:07:09.403 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T20:07:09.403 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T20:07:09.403 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T20:07:09.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.404 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:09.405 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:09.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T20:07:09.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T20:07:09.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T20:07:09.406 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:09.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.508 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-10-16T20:07:09.525 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T20:07:09.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.526 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2023-10-16T20:07:09.581 INFO:teuthology.orchestra.run.smithi163.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-16T20:07:09.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.582 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:09.582 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:09.583 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T20:07:09.583 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-16T20:07:09.583 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:09.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T20:07:09.719 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:09.720 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:09.720 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:09.720 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.720 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:09.721 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.721 INFO:teuthology.orchestra.run.smithi163.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:07:09.721 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 7a:01:4a:a5:fc:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T20:07:09.721 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T20:07:09.722 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.722 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::7801:4aff:fea5:fc05/64 scope link tentative 2023-10-16T20:07:09.722 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.731 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T20:07:09.805 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:07:09.806 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:07:09.806 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:07:09.807 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.807 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-10-16T20:07:09.807 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.808 INFO:teuthology.orchestra.run.smithi163.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:07:09.808 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 7a:01:4a:a5:fc:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T20:07:09.808 INFO:teuthology.orchestra.run.smithi163.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T20:07:09.809 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.809 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::7801:4aff:fea5:fc05/64 scope link tentative 2023-10-16T20:07:09.809 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:07:09.819 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-16T20:07:09.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:09.820 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:09.820 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:09.821 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-16T20:07:09.821 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T20:07:09.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-16T20:07:09.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-16T20:07:09.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-16T20:07:09.823 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:10.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.065 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-10-16T20:07:10.065 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-10-16T20:07:10.065 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.1 up 2023-10-16T20:07:10.066 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T20:07:10.066 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-10-16T20:07:10.182 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:10.182 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-16T20:07:10.205 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-16T20:07:10.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:07:10.206 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-16T20:07:10.261 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-16T20:07:10.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.262 DEBUG:teuthology.orchestra.run.smithi163:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-16T20:07:10.347 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-16T20:07:10.347 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-16T20:07:10.348 INFO:teuthology.orchestra.run.smithi163.stdout:invalid new device string format 2023-10-16T20:07:10.356 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-16T20:07:10.356 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-16T20:07:10.356 INFO:teuthology.orchestra.run.smithi163.stdout:invalid new device string format 2023-10-16T20:07:10.356 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:10.357 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:10.431 INFO:teuthology.orchestra.run.smithi163.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-16T20:07:10.431 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-16T20:07:10.431 INFO:teuthology.orchestra.run.smithi163.stdout:invalid new device string format 2023-10-16T20:07:10.431 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:07:10.432 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:07:10.432 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790" 2023-10-16T20:07:10.432 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790:/ 2023-10-16T20:07:10.432 INFO:teuthology.orchestra.run.smithi163.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=e602e5ee-bf17-44e1-9fbf-0f448134fb28" will pass to kernel 2023-10-16T20:07:10.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-16T20:07:10.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.434 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-16T20:07:10.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.461 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:10.533 INFO:teuthology.orchestra.run.smithi163.stdout:client4857 2023-10-16T20:07:10.533 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:10.534 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:10.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.591 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:10.662 INFO:teuthology.orchestra.run.smithi163.stdout:client4857 2023-10-16T20:07:10.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.663 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-16T20:07:10.735 INFO:teuthology.orchestra.run.smithi163.stdout:client4857 2023-10-16T20:07:10.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:10.736 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e602e5ee-bf17-44e1-9fbf-0f448134fb28.client4857/status') 2023-10-16T20:07:10.815 INFO:teuthology.orchestra.run.smithi163.stdout:instance: client.4857 (3)172.21.15.163:0/795073717 2023-10-16T20:07:10.815 INFO:teuthology.orchestra.run.smithi163.stdout:blocklisted: false 2023-10-16T20:07:10.816 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records in 2023-10-16T20:07:10.816 INFO:teuthology.orchestra.run.smithi163.stderr:0+1 records out 2023-10-16T20:07:10.817 INFO:teuthology.orchestra.run.smithi163.stderr:70 bytes copied, 2.1612e-05 s, 3.2 MB/s 2023-10-16T20:07:10.817 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T20:07:10.832 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:10.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.964+0000 7f71c497e700 1 Processor -- start 2023-10-16T20:07:10.967 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.964+0000 7f71c497e700 1 -- start start 2023-10-16T20:07:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71c497e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71c00cf130 0x7f71c00c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71c497e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00711b0 0x7f71c0071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71c497e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c0071b50 con 0x7f71c00cd4b0 2023-10-16T20:07:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71c497e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c015c6f0 con 0x7f71c00cf130 2023-10-16T20:07:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71c497e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c015bb00 con 0x7f71c00711b0 2023-10-16T20:07:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71c00cf130 0x7f71c00c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71c00cf130 0x7f71c00c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59504/0 (socket says 172.21.15.152:59504) 2023-10-16T20:07:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 -- 172.21.15.152:0/3484038590 learned_addr learned my addr 172.21.15.152:0/3484038590 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71bdd9b700 1 --2- 172.21.15.152:0/3484038590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00711b0 0x7f71c0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:10.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 -- 172.21.15.152:0/3484038590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00711b0 msgr2=0x7f71c0071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 --2- 172.21.15.152:0/3484038590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00711b0 0x7f71c0071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 -- 172.21.15.152:0/3484038590 >> v1:172.21.15.163:6789/0 conn(0x7f71c00cd4b0 legacy=0x7f71c00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.965+0000 7f71be59c700 1 -- 172.21.15.152:0/3484038590 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c015bdc0 con 0x7f71c00cf130 2023-10-16T20:07:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71be59c700 1 --2- 172.21.15.152:0/3484038590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cf130 0x7f71c00c9f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71b00098f0 tx=0x7f71b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da94e7f961c32b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71bd59a700 1 -- 172.21.15.152:0/3484038590 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0011830 con 0x7f71c00cf130 2023-10-16T20:07:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71bd59a700 1 -- 172.21.15.152:0/3484038590 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b0011990 con 0x7f71c00cf130 2023-10-16T20:07:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71bd59a700 1 -- 172.21.15.152:0/3484038590 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0011d20 con 0x7f71c00cf130 2023-10-16T20:07:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 -- 172.21.15.152:0/3484038590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cf130 msgr2=0x7f71c00c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 --2- 172.21.15.152:0/3484038590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cf130 0x7f71c00c9f30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f71b00098f0 tx=0x7f71b0009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 -- 172.21.15.152:0/3484038590 shutdown_connections 2023-10-16T20:07:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 --2- 172.21.15.152:0/3484038590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cf130 0x7f71c00c9f30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 --2- 172.21.15.152:0/3484038590 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00711b0 0x7f71c0071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 -- 172.21.15.152:0/3484038590 >> 172.21.15.152:0/3484038590 conn(0x7f71c00cfcd0 msgr2=0x7f71c00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 -- 172.21.15.152:0/3484038590 shutdown_connections 2023-10-16T20:07:10.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.966+0000 7f71c497e700 1 -- 172.21.15.152:0/3484038590 wait complete. 2023-10-16T20:07:10.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.968+0000 7f71c497e700 1 Processor -- start 2023-10-16T20:07:10.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.968+0000 7f71c497e700 1 -- start start 2023-10-16T20:07:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71c497e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71c00711b0 0x7f71c00c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71c497e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 0x7f71c0158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71c497e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00cf130 0x7f71c00b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71c497e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c01590b0 con 0x7f71c00cd4b0 2023-10-16T20:07:10.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71c497e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c01f6f60 con 0x7f71c00711b0 2023-10-16T20:07:10.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71c497e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c01f7240 con 0x7f71c00cf130 2023-10-16T20:07:10.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 0x7f71c0158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:10.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 0x7f71c0158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59508/0 (socket says 172.21.15.152:59508) 2023-10-16T20:07:10.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 -- 172.21.15.152:0/2201644759 learned_addr learned my addr 172.21.15.152:0/2201644759 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:10.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71be59c700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71c00711b0 0x7f71c00c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:10.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bed9d700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00cf130 0x7f71c00b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:10.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 -- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00cf130 msgr2=0x7f71c00b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:10.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00cf130 0x7f71c00b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:10.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 -- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71c00711b0 msgr2=0x7f71c00c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:10.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71c00711b0 0x7f71c00c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:10.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bdd9b700 1 -- 172.21.15.152:0/2201644759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009550 con 0x7f71c00cd4b0 2023-10-16T20:07:10.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.969+0000 7f71bed9d700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00cf130 0x7f71c00b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:10.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.970+0000 7f71bdd9b700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 0x7f71c0158b70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e870 tx=0x7f71b400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:10.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.970+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4009590 con 0x7f71c00cd4b0 2023-10-16T20:07:10.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.970+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4013680 con 0x7f71c00cd4b0 2023-10-16T20:07:10.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.970+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c01f7520 con 0x7f71c00cd4b0 2023-10-16T20:07:10.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.970+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40139f0 con 0x7f71c00cd4b0 2023-10-16T20:07:10.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.970+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c0159510 con 0x7f71c00cd4b0 2023-10-16T20:07:10.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.971+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c004ebb0 con 0x7f71c00cd4b0 2023-10-16T20:07:10.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.971+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71b4013b50 con 0x7f71c00cd4b0 2023-10-16T20:07:10.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.972+0000 7f71aeffd700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71a006af00 0x7f71a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:10.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.972+0000 7f71be59c700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71a006af00 0x7f71a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:10.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.972+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71b4089820 con 0x7f71c00cd4b0 2023-10-16T20:07:10.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.972+0000 7f71be59c700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71a006af00 0x7f71a006d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009c40 tx=0x7f71b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:10.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:10.976+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f71b4054540 con 0x7f71c00cd4b0 2023-10-16T20:07:11.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.169+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71c006bcc0 con 0x7f71c00cd4b0 2023-10-16T20:07:11.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.171+0000 7f71aeffd700 1 -- 172.21.15.152:0/2201644759 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18382 (secure 0 0 0) 0x7f71b4057b60 con 0x7f71c00cd4b0 2023-10-16T20:07:11.174 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:11.174 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":26,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:06:37.280540+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:11.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71a006af00 msgr2=0x7f71a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71a006af00 0x7f71a006d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009c40 tx=0x7f71b0008030 comp rx=0 tx=0).stop 2023-10-16T20:07:11.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 msgr2=0x7f71c0158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 0x7f71c0158b70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e870 tx=0x7f71b400eb80 comp rx=0 tx=0).stop 2023-10-16T20:07:11.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 shutdown_connections 2023-10-16T20:07:11.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71a006af00 0x7f71a006d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f71c00cf130 0x7f71c00b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f71c00711b0 0x7f71c00c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 --2- 172.21.15.152:0/2201644759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71c00cd4b0 0x7f71c0158b70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 >> 172.21.15.152:0/2201644759 conn(0x7f71c00cfcd0 msgr2=0x7f71c00b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:11.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 shutdown_connections 2023-10-16T20:07:11.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.173+0000 7f71c497e700 1 -- 172.21.15.152:0/2201644759 wait complete. 2023-10-16T20:07:11.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:11.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:11.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.310+0000 7f9be9906700 1 Processor -- start 2023-10-16T20:07:11.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.310+0000 7f9be9906700 1 -- start start 2023-10-16T20:07:11.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.310+0000 7f9be9906700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9be40b27b0 0x7f9be40c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.310+0000 7f9be9906700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be40ca880 con 0x7f9be40ca450 2023-10-16T20:07:11.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.310+0000 7f9be9906700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be4161880 con 0x7f9be415dd10 2023-10-16T20:07:11.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.310+0000 7f9be9906700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be4162500 con 0x7f9be40b27b0 2023-10-16T20:07:11.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be37fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9be40ca450 0x7f9be406a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39716/0 (socket says 172.21.15.152:39716) 2023-10-16T20:07:11.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be37fe700 1 -- 172.21.15.152:0/3367847334 learned_addr learned my addr 172.21.15.152:0/3367847334 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:11.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be27fc700 1 --2- 172.21.15.152:0/3367847334 >> v2:172.21.15.163:3300/0 conn(0x7f9be40b27b0 0x7f9be40c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be1ffb700 1 -- 172.21.15.152:0/3367847334 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281553247 0 0) 0x7f9be40ca880 con 0x7f9be40ca450 2023-10-16T20:07:11.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be1ffb700 1 -- 172.21.15.152:0/3367847334 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bcc0035b0 con 0x7f9be40ca450 2023-10-16T20:07:11.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be27fc700 1 -- 172.21.15.152:0/3367847334 >> v1:172.21.15.163:6789/0 conn(0x7f9be415dd10 legacy=0x7f9be406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be1ffb700 1 -- 172.21.15.152:0/3367847334 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963836483 0 0) 0x7f9be4161880 con 0x7f9be415dd10 2023-10-16T20:07:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be27fc700 1 -- 172.21.15.152:0/3367847334 >> v1:172.21.15.152:6789/0 conn(0x7f9be40ca450 legacy=0x7f9be406a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be27fc700 1 -- 172.21.15.152:0/3367847334 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4161b60 con 0x7f9be40b27b0 2023-10-16T20:07:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be27fc700 1 --2- 172.21.15.152:0/3367847334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be40c9f10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009840 tx=0x7f9bd4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5141a65c151d8b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be1ffb700 1 -- 172.21.15.152:0/3367847334 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4011830 con 0x7f9be40b27b0 2023-10-16T20:07:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be1ffb700 1 -- 172.21.15.152:0/3367847334 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd4011990 con 0x7f9be40b27b0 2023-10-16T20:07:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.311+0000 7f9be1ffb700 1 -- 172.21.15.152:0/3367847334 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4011d20 con 0x7f9be40b27b0 2023-10-16T20:07:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 -- 172.21.15.152:0/3367847334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 msgr2=0x7f9be40c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 --2- 172.21.15.152:0/3367847334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be40c9f10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009840 tx=0x7f9bd4009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 -- 172.21.15.152:0/3367847334 shutdown_connections 2023-10-16T20:07:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 --2- 172.21.15.152:0/3367847334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be40c9f10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 -- 172.21.15.152:0/3367847334 >> 172.21.15.152:0/3367847334 conn(0x7f9be40cfaa0 msgr2=0x7f9be40cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:11.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 -- 172.21.15.152:0/3367847334 shutdown_connections 2023-10-16T20:07:11.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.312+0000 7f9be9906700 1 -- 172.21.15.152:0/3367847334 wait complete. 2023-10-16T20:07:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.313+0000 7f9be9906700 1 Processor -- start 2023-10-16T20:07:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.313+0000 7f9be9906700 1 -- start start 2023-10-16T20:07:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be9906700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be9906700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 0x7f9be41f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be9906700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9be415dd10 0x7f9be40c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be9906700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be415e630 con 0x7f9be40ca450 2023-10-16T20:07:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be9906700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4146b00 con 0x7f9be40b27b0 2023-10-16T20:07:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be9906700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4160b00 con 0x7f9be415dd10 2023-10-16T20:07:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be27fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 0x7f9be41f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be27fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 0x7f9be41f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59522/0 (socket says 172.21.15.152:59522) 2023-10-16T20:07:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be27fc700 1 -- 172.21.15.152:0/2793188093 learned_addr learned my addr 172.21.15.152:0/2793188093 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be2ffd700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.314+0000 7f9be37fe700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9be415dd10 0x7f9be40c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be27fc700 1 -- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9be415dd10 msgr2=0x7f9be40c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be27fc700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9be415dd10 0x7f9be40c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be27fc700 1 -- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 msgr2=0x7f9be415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be27fc700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be27fc700 1 -- 172.21.15.152:0/2793188093 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd40094a0 con 0x7f9be40ca450 2023-10-16T20:07:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be27fc700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 0x7f9be41f2800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4014040 tx=0x7f9bd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd401a7e0 con 0x7f9be40ca450 2023-10-16T20:07:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd401a940 con 0x7f9be40ca450 2023-10-16T20:07:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be4160de0 con 0x7f9be40ca450 2023-10-16T20:07:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd401acd0 con 0x7f9be40ca450 2023-10-16T20:07:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.315+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be4158860 con 0x7f9be40ca450 2023-10-16T20:07:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.316+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be40667a0 con 0x7f9be40ca450 2023-10-16T20:07:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.316+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9bd4022070 con 0x7f9be40ca450 2023-10-16T20:07:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.317+0000 7f9bcbfff700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bd006af00 0x7f9bd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.317+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9bd408a5c0 con 0x7f9be40ca450 2023-10-16T20:07:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.317+0000 7f9be2ffd700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bd006af00 0x7f9bd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.317+0000 7f9be2ffd700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bd006af00 0x7f9bd006d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007fd0 tx=0x7f9bd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.321+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bd4055390 con 0x7f9be40ca450 2023-10-16T20:07:11.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.507+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9be404ebb0 con 0x7f9be40ca450 2023-10-16T20:07:11.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.508+0000 7f9bcbfff700 1 -- 172.21.15.152:0/2793188093 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bd40589b0 con 0x7f9be40ca450 2023-10-16T20:07:11.511 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:11.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bd006af00 msgr2=0x7f9bd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bd006af00 0x7f9bd006d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007fd0 tx=0x7f9bd8009040 comp rx=0 tx=0).stop 2023-10-16T20:07:11.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 msgr2=0x7f9be41f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 0x7f9be41f2800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4014040 tx=0x7f9bd4004750 comp rx=0 tx=0).stop 2023-10-16T20:07:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 shutdown_connections 2023-10-16T20:07:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bd006af00 0x7f9bd006d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9be415dd10 0x7f9be40c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9be40b27b0 0x7f9be415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 --2- 172.21.15.152:0/2793188093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40ca450 0x7f9be41f2800 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 >> 172.21.15.152:0/2793188093 conn(0x7f9be40cfaa0 msgr2=0x7f9be415ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 shutdown_connections 2023-10-16T20:07:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.510+0000 7f9be9906700 1 -- 172.21.15.152:0/2793188093 wait complete. 2023-10-16T20:07:11.525 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:11.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.644+0000 7f7a185e9700 1 Processor -- start 2023-10-16T20:07:11.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.645+0000 7f7a185e9700 1 -- start start 2023-10-16T20:07:11.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.645+0000 7f7a185e9700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a100cee30 0x7f7a100cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.645+0000 7f7a185e9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a1015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.645+0000 7f7a185e9700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100cf750 con 0x7f7a1015ef90 2023-10-16T20:07:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.645+0000 7f7a185e9700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a101612e0 con 0x7f7a100cee30 2023-10-16T20:07:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.645+0000 7f7a185e9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101615c0 con 0x7f7a100b33f0 2023-10-16T20:07:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a100cee30 0x7f7a100cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a100cee30 0x7f7a100cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59528/0 (socket says 172.21.15.152:59528) 2023-10-16T20:07:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 -- 172.21.15.152:0/3585973300 learned_addr learned my addr 172.21.15.152:0/3585973300 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16b86700 1 --2- 172.21.15.152:0/3585973300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a1015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 -- 172.21.15.152:0/3585973300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 msgr2=0x7f7a1015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 --2- 172.21.15.152:0/3585973300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a1015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 -- 172.21.15.152:0/3585973300 >> v1:172.21.15.163:6789/0 conn(0x7f7a1015ef90 legacy=0x7f7a100b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 -- 172.21.15.152:0/3585973300 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a101618a0 con 0x7f7a100cee30 2023-10-16T20:07:11.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a16385700 1 --2- 172.21.15.152:0/3585973300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100cee30 0x7f7a100cf210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098f0 tx=0x7f7a00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a1e758282f3a26 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a15383700 1 -- 172.21.15.152:0/3585973300 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00011830 con 0x7f7a100cee30 2023-10-16T20:07:11.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a15383700 1 -- 172.21.15.152:0/3585973300 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00011990 con 0x7f7a100cee30 2023-10-16T20:07:11.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.646+0000 7f7a15383700 1 -- 172.21.15.152:0/3585973300 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00011d20 con 0x7f7a100cee30 2023-10-16T20:07:11.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 -- 172.21.15.152:0/3585973300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100cee30 msgr2=0x7f7a100cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 --2- 172.21.15.152:0/3585973300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100cee30 0x7f7a100cf210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098f0 tx=0x7f7a00009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 -- 172.21.15.152:0/3585973300 shutdown_connections 2023-10-16T20:07:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 --2- 172.21.15.152:0/3585973300 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a1015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 --2- 172.21.15.152:0/3585973300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a100cee30 0x7f7a100cf210 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 -- 172.21.15.152:0/3585973300 >> 172.21.15.152:0/3585973300 conn(0x7f7a100cdce0 msgr2=0x7f7a100ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 -- 172.21.15.152:0/3585973300 shutdown_connections 2023-10-16T20:07:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.647+0000 7f7a185e9700 1 -- 172.21.15.152:0/3585973300 wait complete. 2023-10-16T20:07:11.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.648+0000 7f7a185e9700 1 Processor -- start 2023-10-16T20:07:11.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.648+0000 7f7a185e9700 1 -- start start 2023-10-16T20:07:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a185e9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a100c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a185e9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a100cee30 0x7f7a100c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a185e9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 0x7f7a100c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a185e9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b5c00 con 0x7f7a1015ef90 2023-10-16T20:07:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a185e9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b5ee0 con 0x7f7a100cee30 2023-10-16T20:07:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a185e9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b61c0 con 0x7f7a100b33f0 2023-10-16T20:07:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 0x7f7a100c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 0x7f7a100c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59538/0 (socket says 172.21.15.152:59538) 2023-10-16T20:07:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 -- 172.21.15.152:0/323866380 learned_addr learned my addr 172.21.15.152:0/323866380 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16385700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a100c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a15b84700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a100cee30 0x7f7a100c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 -- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 msgr2=0x7f7a100c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a100c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 -- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a100cee30 msgr2=0x7f7a100c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a100cee30 0x7f7a100c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 -- 172.21.15.152:0/323866380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00009550 con 0x7f7a1015ef90 2023-10-16T20:07:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.649+0000 7f7a16b86700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 0x7f7a100c52d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800efc0 tx=0x7f7a08009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.650+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08009b20 con 0x7f7a1015ef90 2023-10-16T20:07:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.650+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800f040 con 0x7f7a1015ef90 2023-10-16T20:07:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.650+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a100b64a0 con 0x7f7a1015ef90 2023-10-16T20:07:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.650+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800cc90 con 0x7f7a1015ef90 2023-10-16T20:07:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.650+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a100c3c30 con 0x7f7a1015ef90 2023-10-16T20:07:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.651+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10144430 con 0x7f7a1015ef90 2023-10-16T20:07:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.651+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a08014480 con 0x7f7a1015ef90 2023-10-16T20:07:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.651+0000 7f7a06ffd700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f79f406af00 0x7f79f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.652+0000 7f7a16385700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f79f406af00 0x7f79f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.652+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a0808a240 con 0x7f7a1015ef90 2023-10-16T20:07:11.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.652+0000 7f7a16385700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f79f406af00 0x7f79f406d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009c40 tx=0x7f7a00008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.656+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a10144430 con 0x7f7a1015ef90 2023-10-16T20:07:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.848+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a10144430 con 0x7f7a1015ef90 2023-10-16T20:07:11.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.848+0000 7f7a06ffd700 1 -- 172.21.15.152:0/323866380 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a10144430 con 0x7f7a1015ef90 2023-10-16T20:07:11.852 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:11.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f79f406af00 msgr2=0x7f79f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f79f406af00 0x7f79f406d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009c40 tx=0x7f7a00008030 comp rx=0 tx=0).stop 2023-10-16T20:07:11.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 msgr2=0x7f7a100c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 0x7f7a100c52d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800efc0 tx=0x7f7a08009f60 comp rx=0 tx=0).stop 2023-10-16T20:07:11.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 shutdown_connections 2023-10-16T20:07:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f79f406af00 0x7f79f406d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7a100b33f0 0x7f7a100c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a1015ef90 0x7f7a100c52d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 --2- 172.21.15.152:0/323866380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a100cee30 0x7f7a100c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 >> 172.21.15.152:0/323866380 conn(0x7f7a100cdce0 msgr2=0x7f7a100b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:11.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 shutdown_connections 2023-10-16T20:07:11.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.850+0000 7f7a185e9700 1 -- 172.21.15.152:0/323866380 wait complete. 2023-10-16T20:07:11.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:11.990 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.987+0000 7f0eedbe5700 1 Processor -- start 2023-10-16T20:07:11.990 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.987+0000 7f0eedbe5700 1 -- start start 2023-10-16T20:07:11.992 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0eedbe5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0ee806b370 0x7f0ee815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0eedbe5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806a820 0x7f0ee806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0eedbe5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0ee80cdd30 0x7f0ee80ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:11.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0eedbe5700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee80ce6f0 con 0x7f0ee806b370 2023-10-16T20:07:11.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0eedbe5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee8161360 con 0x7f0ee80cdd30 2023-10-16T20:07:11.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0eedbe5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee806b750 con 0x7f0ee806a820 2023-10-16T20:07:11.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0ee806b370 0x7f0ee815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0ee806b370 0x7f0ee815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59542/0 (socket says 172.21.15.152:59542) 2023-10-16T20:07:11.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 -- 172.21.15.152:0/1845153036 learned_addr learned my addr 172.21.15.152:0/1845153036 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:11.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee6ffd700 1 --2- 172.21.15.152:0/1845153036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806a820 0x7f0ee806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee7fff700 1 --2- 172.21.15.152:0/1845153036 >> v2:172.21.15.163:3300/0 conn(0x7f0ee80cdd30 0x7f0ee80ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:11.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 -- 172.21.15.152:0/1845153036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806a820 msgr2=0x7f0ee806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:11.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 --2- 172.21.15.152:0/1845153036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806a820 0x7f0ee806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 -- 172.21.15.152:0/1845153036 >> v2:172.21.15.163:3300/0 conn(0x7f0ee80cdd30 msgr2=0x7f0ee80ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:11.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 --2- 172.21.15.152:0/1845153036 >> v2:172.21.15.163:3300/0 conn(0x7f0ee80cdd30 0x7f0ee80ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.988+0000 7f0ee77fe700 1 -- 172.21.15.152:0/1845153036 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee815e300 con 0x7f0ee806b370 2023-10-16T20:07:11.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0ee77fe700 1 --2- 172.21.15.152:0/1845153036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee806b370 0x7f0ee815dcb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8074ae0 tx=0x7f0edc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e358ab4e174e29e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:11.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0ee67fc700 1 -- 172.21.15.152:0/1845153036 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00b870 con 0x7f0ee806b370 2023-10-16T20:07:11.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0ee67fc700 1 -- 172.21.15.152:0/1845153036 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00b9d0 con 0x7f0ee806b370 2023-10-16T20:07:11.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0ee67fc700 1 -- 172.21.15.152:0/1845153036 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00bd60 con 0x7f0ee806b370 2023-10-16T20:07:11.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 -- 172.21.15.152:0/1845153036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee806b370 msgr2=0x7f0ee815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:11.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/1845153036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee806b370 0x7f0ee815dcb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8074ae0 tx=0x7f0edc009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 -- 172.21.15.152:0/1845153036 shutdown_connections 2023-10-16T20:07:11.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/1845153036 >> v2:172.21.15.163:3300/0 conn(0x7f0ee80cdd30 0x7f0ee80ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/1845153036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee806b370 0x7f0ee815dcb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/1845153036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806a820 0x7f0ee806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:11.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 -- 172.21.15.152:0/1845153036 >> 172.21.15.152:0/1845153036 conn(0x7f0ee80ccbe0 msgr2=0x7f0ee80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:11.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 -- 172.21.15.152:0/1845153036 shutdown_connections 2023-10-16T20:07:11.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.989+0000 7f0eedbe5700 1 -- 172.21.15.152:0/1845153036 wait complete. 2023-10-16T20:07:12.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.990+0000 7f0eedbe5700 1 Processor -- start 2023-10-16T20:07:12.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 -- start start 2023-10-16T20:07:12.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee806a820 0x7f0ee8156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806b370 0x7f0ee81e7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 0x7f0ee81e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80b3600 con 0x7f0ee80cdd30 2023-10-16T20:07:12.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80b3b00 con 0x7f0ee806a820 2023-10-16T20:07:12.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.991+0000 7f0eedbe5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80b3d30 con 0x7f0ee806b370 2023-10-16T20:07:12.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 0x7f0ee81e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 0x7f0ee81e7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59550/0 (socket says 172.21.15.152:59550) 2023-10-16T20:07:12.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 -- 172.21.15.152:0/4293051274 learned_addr learned my addr 172.21.15.152:0/4293051274 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee77fe700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee806a820 0x7f0ee8156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee6ffd700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806b370 0x7f0ee81e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 -- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806b370 msgr2=0x7f0ee81e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806b370 0x7f0ee81e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 -- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee806a820 msgr2=0x7f0ee8156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee806a820 0x7f0ee8156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 -- 172.21.15.152:0/4293051274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009550 con 0x7f0ee80cdd30 2023-10-16T20:07:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ee7fff700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 0x7f0ee81e7a90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007e40 tx=0x7f0ee000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000eea0 con 0x7f0ee80cdd30 2023-10-16T20:07:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0014420 con 0x7f0ee80cdd30 2023-10-16T20:07:12.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee80b4010 con 0x7f0ee80cdd30 2023-10-16T20:07:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00147b0 con 0x7f0ee80cdd30 2023-10-16T20:07:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.992+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee80b45d0 con 0x7f0ee80cdd30 2023-10-16T20:07:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.993+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee8072d10 con 0x7f0ee80cdd30 2023-10-16T20:07:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.994+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0ee0014910 con 0x7f0ee80cdd30 2023-10-16T20:07:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.994+0000 7f0ecffff700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0ed406af00 0x7f0ed406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.994+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ee008a020 con 0x7f0ee80cdd30 2023-10-16T20:07:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.994+0000 7f0ee77fe700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0ed406af00 0x7f0ed406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.995+0000 7f0ee77fe700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0ed406af00 0x7f0ed406d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:11.999+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0ee0054e70 con 0x7f0ee80cdd30 2023-10-16T20:07:12.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.188+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ee804ebb0 con 0x7f0ee80cdd30 2023-10-16T20:07:12.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.188+0000 7f0ecffff700 1 -- 172.21.15.152:0/4293051274 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ee0058490 con 0x7f0ee80cdd30 2023-10-16T20:07:12.192 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:12.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.190+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0ed406af00 msgr2=0x7f0ed406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.190+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0ed406af00 0x7f0ed406d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc008030 comp rx=0 tx=0).stop 2023-10-16T20:07:12.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.190+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 msgr2=0x7f0ee81e7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.190+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 0x7f0ee81e7a90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0007e40 tx=0x7f0ee000e3c0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 shutdown_connections 2023-10-16T20:07:12.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0ed406af00 0x7f0ed406d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee80cdd30 0x7f0ee81e7a90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee806a820 0x7f0ee8156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 --2- 172.21.15.152:0/4293051274 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0ee806b370 0x7f0ee81e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 >> 172.21.15.152:0/4293051274 conn(0x7f0ee80ccbe0 msgr2=0x7f0ee815eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:12.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 shutdown_connections 2023-10-16T20:07:12.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.191+0000 7f0eedbe5700 1 -- 172.21.15.152:0/4293051274 wait complete. 2023-10-16T20:07:12.206 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:12.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.326+0000 7f06a06d7700 1 Processor -- start 2023-10-16T20:07:12.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.326+0000 7f06a06d7700 1 -- start start 2023-10-16T20:07:12.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f06a06d7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0698159cf0 0x7f069806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f06a06d7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06980ca530 0x7f0698071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f06a06d7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0698071d50 con 0x7f06980c9720 2023-10-16T20:07:12.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f06a06d7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0698072260 con 0x7f0698159cf0 2023-10-16T20:07:12.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f06a06d7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0698071f80 con 0x7f06980ca530 2023-10-16T20:07:12.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0698159cf0 0x7f069806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069ec74700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06980ca530 0x7f0698071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0698159cf0 0x7f069806ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60554/0 (socket says 172.21.15.152:60554) 2023-10-16T20:07:12.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 -- 172.21.15.152:0/2138042869 learned_addr learned my addr 172.21.15.152:0/2138042869 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:12.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 -- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06980ca530 msgr2=0x7f0698071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:12.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 --2- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06980ca530 0x7f0698071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 -- 172.21.15.152:0/2138042869 >> v1:172.21.15.163:6789/0 conn(0x7f06980c9720 legacy=0x7f06980c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069e473700 1 -- 172.21.15.152:0/2138042869 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980cd170 con 0x7f0698159cf0 2023-10-16T20:07:12.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.327+0000 7f069ec74700 1 --2- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06980ca530 0x7f0698071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:12.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f069e473700 1 --2- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0698159cf0 0x7f069806ca70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f068800aa90 tx=0x7f068800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2771d0daa4c6da6b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f069d471700 1 -- 172.21.15.152:0/2138042869 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800cb70 con 0x7f0698159cf0 2023-10-16T20:07:12.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f069d471700 1 -- 172.21.15.152:0/2138042869 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068800ccd0 con 0x7f0698159cf0 2023-10-16T20:07:12.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f069d471700 1 -- 172.21.15.152:0/2138042869 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688018620 con 0x7f0698159cf0 2023-10-16T20:07:12.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 -- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0698159cf0 msgr2=0x7f069806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 --2- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0698159cf0 0x7f069806ca70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f068800aa90 tx=0x7f068800ada0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 -- 172.21.15.152:0/2138042869 shutdown_connections 2023-10-16T20:07:12.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 --2- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f06980ca530 0x7f0698071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 --2- 172.21.15.152:0/2138042869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0698159cf0 0x7f069806ca70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 -- 172.21.15.152:0/2138042869 >> 172.21.15.152:0/2138042869 conn(0x7f06980cbb50 msgr2=0x7f06980cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:12.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 -- 172.21.15.152:0/2138042869 shutdown_connections 2023-10-16T20:07:12.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.328+0000 7f06a06d7700 1 -- 172.21.15.152:0/2138042869 wait complete. 2023-10-16T20:07:12.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 Processor -- start 2023-10-16T20:07:12.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 -- start start 2023-10-16T20:07:12.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 0x7f06980c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06980ca530 0x7f06980b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0698159cf0 0x7f06981e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c8f80 con 0x7f06980c9720 2023-10-16T20:07:12.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b4aa0 con 0x7f06980ca530 2023-10-16T20:07:12.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.330+0000 7f06a06d7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b4d80 con 0x7f0698159cf0 2023-10-16T20:07:12.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 0x7f06980c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 0x7f06980c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59558/0 (socket says 172.21.15.152:59558) 2023-10-16T20:07:12.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 -- 172.21.15.152:0/781482803 learned_addr learned my addr 172.21.15.152:0/781482803 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:12.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069dc72700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06980ca530 0x7f06980b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069ec74700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0698159cf0 0x7f06981e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 -- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0698159cf0 msgr2=0x7f06981e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0698159cf0 0x7f06981e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 -- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06980ca530 msgr2=0x7f06980b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06980ca530 0x7f06980b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 -- 172.21.15.152:0/781482803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009a70 con 0x7f06980c9720 2023-10-16T20:07:12.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f069e473700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 0x7f06980c8a40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f068800ade0 tx=0x7f06880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880038b0 con 0x7f06980c9720 2023-10-16T20:07:12.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688003a10 con 0x7f06980c9720 2023-10-16T20:07:12.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068800a6f0 con 0x7f06980c9720 2023-10-16T20:07:12.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688003dc0 con 0x7f06980c9720 2023-10-16T20:07:12.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.331+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069815a450 con 0x7f06980c9720 2023-10-16T20:07:12.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.332+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069804ebb0 con 0x7f06980c9720 2023-10-16T20:07:12.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.333+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0688018400 con 0x7f06980c9720 2023-10-16T20:07:12.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.333+0000 7f068effd700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f067c06af00 0x7f067c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.333+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f068808ac20 con 0x7f06980c9720 2023-10-16T20:07:12.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.333+0000 7f069dc72700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f067c06af00 0x7f067c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.334+0000 7f069dc72700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f067c06af00 0x7f067c06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f06981e6660 tx=0x7f0694009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.338+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f06880559f0 con 0x7f06980c9720 2023-10-16T20:07:12.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.528+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06980b5050 con 0x7f06980c9720 2023-10-16T20:07:12.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.528+0000 7f068effd700 1 -- 172.21.15.152:0/781482803 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0688059010 con 0x7f06980c9720 2023-10-16T20:07:12.532 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:12.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f067c06af00 msgr2=0x7f067c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f067c06af00 0x7f067c06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f06981e6660 tx=0x7f0694009040 comp rx=0 tx=0).stop 2023-10-16T20:07:12.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 msgr2=0x7f06980c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 0x7f06980c8a40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f068800ade0 tx=0x7f06880047c0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 shutdown_connections 2023-10-16T20:07:12.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f067c06af00 0x7f067c06d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0698159cf0 0x7f06981e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06980c9720 0x7f06980c8a40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 --2- 172.21.15.152:0/781482803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06980ca530 0x7f06980b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 >> 172.21.15.152:0/781482803 conn(0x7f06980cbb50 msgr2=0x7f069815d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:12.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 shutdown_connections 2023-10-16T20:07:12.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.530+0000 7f06a06d7700 1 -- 172.21.15.152:0/781482803 wait complete. 2023-10-16T20:07:12.545 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:12.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.662+0000 7f6494135700 1 Processor -- start 2023-10-16T20:07:12.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.663+0000 7f6494135700 1 -- start start 2023-10-16T20:07:12.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.663+0000 7f6494135700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f648c144ea0 0x7f648c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.663+0000 7f6494135700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f648c0cbc10 0x7f648c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.663+0000 7f6494135700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0cd4b0 con 0x7f648c0712e0 2023-10-16T20:07:12.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.663+0000 7f6494135700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c15b8f0 con 0x7f648c0cbc10 2023-10-16T20:07:12.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.663+0000 7f6494135700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0cc0c0 con 0x7f648c144ea0 2023-10-16T20:07:12.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64926d2700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f648c0cbc10 0x7f648c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f6491ed1700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f648c0712e0 0x7f648c0716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39764/0 (socket says 172.21.15.152:39764) 2023-10-16T20:07:12.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f6491ed1700 1 -- 172.21.15.152:0/1408176278 learned_addr learned my addr 172.21.15.152:0/1408176278 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:12.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64916d0700 1 --2- 172.21.15.152:0/1408176278 >> v2:172.21.15.163:3300/0 conn(0x7f648c144ea0 0x7f648c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64926d2700 1 -- 172.21.15.152:0/1408176278 >> v2:172.21.15.163:3300/0 conn(0x7f648c144ea0 msgr2=0x7f648c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:12.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64926d2700 1 --2- 172.21.15.152:0/1408176278 >> v2:172.21.15.163:3300/0 conn(0x7f648c144ea0 0x7f648c15f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64926d2700 1 -- 172.21.15.152:0/1408176278 >> v1:172.21.15.152:6789/0 conn(0x7f648c0712e0 legacy=0x7f648c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f6490ecf700 1 -- 172.21.15.152:0/1408176278 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54073593 0 0) 0x7f648c0cd4b0 con 0x7f648c0712e0 2023-10-16T20:07:12.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64926d2700 1 -- 172.21.15.152:0/1408176278 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c15fdb0 con 0x7f648c0cbc10 2023-10-16T20:07:12.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f64926d2700 1 --2- 172.21.15.152:0/1408176278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c0cd940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f648c15ef20 tx=0x7f648400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56297ad422015d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f6490ecf700 1 -- 172.21.15.152:0/1408176278 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400e070 con 0x7f648c0cbc10 2023-10-16T20:07:12.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f6490ecf700 1 -- 172.21.15.152:0/1408176278 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400bbd0 con 0x7f648c0cbc10 2023-10-16T20:07:12.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.664+0000 7f6490ecf700 1 -- 172.21.15.152:0/1408176278 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484012430 con 0x7f648c0cbc10 2023-10-16T20:07:12.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 -- 172.21.15.152:0/1408176278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 msgr2=0x7f648c0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 --2- 172.21.15.152:0/1408176278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c0cd940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f648c15ef20 tx=0x7f648400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:12.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 -- 172.21.15.152:0/1408176278 shutdown_connections 2023-10-16T20:07:12.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 --2- 172.21.15.152:0/1408176278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c0cd940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 --2- 172.21.15.152:0/1408176278 >> v2:172.21.15.163:3300/0 conn(0x7f648c144ea0 0x7f648c15f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 -- 172.21.15.152:0/1408176278 >> 172.21.15.152:0/1408176278 conn(0x7f648c0cfcd0 msgr2=0x7f648c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:12.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 -- 172.21.15.152:0/1408176278 shutdown_connections 2023-10-16T20:07:12.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.665+0000 7f6494135700 1 -- 172.21.15.152:0/1408176278 wait complete. 2023-10-16T20:07:12.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.666+0000 7f6494135700 1 Processor -- start 2023-10-16T20:07:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.666+0000 7f6494135700 1 -- start start 2023-10-16T20:07:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6494135700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f648c0712e0 0x7f648c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6494135700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6494135700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f648c144ea0 0x7f648c1f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6494135700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0ae2b0 con 0x7f648c0cbc10 2023-10-16T20:07:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6494135700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0ad210 con 0x7f648c0712e0 2023-10-16T20:07:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6494135700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0ad4f0 con 0x7f648c144ea0 2023-10-16T20:07:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c1f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59574/0 (socket says 172.21.15.152:59574) 2023-10-16T20:07:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 -- 172.21.15.152:0/1004090501 learned_addr learned my addr 172.21.15.152:0/1004090501 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f6491ed1700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f648c0712e0 0x7f648c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64926d2700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f648c144ea0 0x7f648c1f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 -- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f648c144ea0 msgr2=0x7f648c1f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f648c144ea0 0x7f648c1f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 -- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f648c0712e0 msgr2=0x7f648c0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f648c0712e0 0x7f648c0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 -- 172.21.15.152:0/1004090501 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6484009a70 con 0x7f648c0cbc10 2023-10-16T20:07:12.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64926d2700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f648c144ea0 0x7f648c1f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:12.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64916d0700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c1f63e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e810 tx=0x7f647c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.667+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c013610 con 0x7f648c0cbc10 2023-10-16T20:07:12.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.668+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c013770 con 0x7f648c0cbc10 2023-10-16T20:07:12.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.668+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c0ad7d0 con 0x7f648c0cbc10 2023-10-16T20:07:12.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.668+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c013b20 con 0x7f648c0cbc10 2023-10-16T20:07:12.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.668+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c0add90 con 0x7f648c0cbc10 2023-10-16T20:07:12.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.668+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c0ae100 con 0x7f648c0cbc10 2023-10-16T20:07:12.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.669+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f647c013c80 con 0x7f648c0cbc10 2023-10-16T20:07:12.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.669+0000 7f64827fc700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f647006af00 0x7f647006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:12.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.669+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f647c0894a0 con 0x7f648c0cbc10 2023-10-16T20:07:12.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.669+0000 7f6491ed1700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f647006af00 0x7f647006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:12.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.670+0000 7f6491ed1700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f647006af00 0x7f647006d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6488000f60 tx=0x7f6488007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:12.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.674+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f647c054270 con 0x7f648c0cbc10 2023-10-16T20:07:12.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.880+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f648c04ebb0 con 0x7f648c0cbc10 2023-10-16T20:07:12.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.882+0000 7f64827fc700 1 -- 172.21.15.152:0/1004090501 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f647c057890 con 0x7f648c0cbc10 2023-10-16T20:07:12.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:12.885 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":27,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:12.861938+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:12.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f647006af00 msgr2=0x7f647006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f647006af00 0x7f647006d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6488000f60 tx=0x7f6488007e70 comp rx=0 tx=0).stop 2023-10-16T20:07:12.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 msgr2=0x7f648c1f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:12.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c1f63e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e810 tx=0x7f647c00eb20 comp rx=0 tx=0).stop 2023-10-16T20:07:12.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 shutdown_connections 2023-10-16T20:07:12.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f647006af00 0x7f647006d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f648c144ea0 0x7f648c1f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f648c0712e0 0x7f648c0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 --2- 172.21.15.152:0/1004090501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f648c0cbc10 0x7f648c1f63e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:12.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 >> 172.21.15.152:0/1004090501 conn(0x7f648c0cfcd0 msgr2=0x7f648c0af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:12.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 shutdown_connections 2023-10-16T20:07:12.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:12.884+0000 7f6494135700 1 -- 172.21.15.152:0/1004090501 wait complete. 2023-10-16T20:07:12.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:12.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:13.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.021+0000 7efd810c4700 1 Processor -- start 2023-10-16T20:07:13.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.021+0000 7efd810c4700 1 -- start start 2023-10-16T20:07:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd810c4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 0x7efd7c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd810c4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c0cb3b0 con 0x7efd7c15da20 2023-10-16T20:07:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd810c4700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c15de00 con 0x7efd7c0ce650 2023-10-16T20:07:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd810c4700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0cc1e0 con 0x7efd7c066940 2023-10-16T20:07:13.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd7ad9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efd7c15da20 0x7efd7c0caca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39778/0 (socket says 172.21.15.152:39778) 2023-10-16T20:07:13.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd7ad9d700 1 -- 172.21.15.152:0/1947777323 learned_addr learned my addr 172.21.15.152:0/1947777323 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:13.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.022+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867765918 0 0) 0x7efd7c0cb3b0 con 0x7efd7c15da20 2023-10-16T20:07:13.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7a59c700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 0x7efd7c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd640035b0 con 0x7efd7c15da20 2023-10-16T20:07:13.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1039123307 0 0) 0x7efd640035b0 con 0x7efd7c15da20 2023-10-16T20:07:13.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 msgr2=0x7efd7c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:13.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 0x7efd7c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 >> v1:172.21.15.163:6789/0 conn(0x7efd7c0ce650 legacy=0x7efd7c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0cea90 con 0x7efd7c15da20 2023-10-16T20:07:13.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7efd70001670 con 0x7efd7c15da20 2023-10-16T20:07:13.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 >> v1:172.21.15.152:6789/0 conn(0x7efd7c15da20 legacy=0x7efd7c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd64003a30 0x7efd64003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 0x7efd64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64004d90 0x7efd64005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0cc1e0 con 0x7efd64003a30 2023-10-16T20:07:13.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6400baf0 con 0x7efd64004d90 2023-10-16T20:07:13.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6400bcb0 con 0x7efd7c066940 2023-10-16T20:07:13.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd64003a30 0x7efd64003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7b59e700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64004d90 0x7efd64005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7a59c700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 0x7efd64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 -- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 msgr2=0x7efd64004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:13.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c066940 0x7efd64004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 -- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64004d90 msgr2=0x7efd64005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:13.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64004d90 0x7efd64005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 -- 172.21.15.152:0/1947777323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640035b0 con 0x7efd64003a30 2023-10-16T20:07:13.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7b59e700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64004d90 0x7efd64005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:13.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd64003a30 0x7efd64003e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c210 tx=0x7efd64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4d4f5a3df6ab88 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70007c10 con 0x7efd64003a30 2023-10-16T20:07:13.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000cdd0 con 0x7efd64003a30 2023-10-16T20:07:13.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.023+0000 7efd79d9b700 1 -- 172.21.15.152:0/1947777323 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70005ba0 con 0x7efd64003a30 2023-10-16T20:07:13.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd810c4700 1 -- 172.21.15.152:0/1947777323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd64003a30 msgr2=0x7efd64003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd810c4700 1 --2- 172.21.15.152:0/1947777323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd64003a30 0x7efd64003e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c210 tx=0x7efd64005880 comp rx=0 tx=0).stop 2023-10-16T20:07:13.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd7b59e700 1 -- 172.21.15.152:0/1947777323 reap_dead start 2023-10-16T20:07:13.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd810c4700 1 -- 172.21.15.152:0/1947777323 shutdown_connections 2023-10-16T20:07:13.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd810c4700 1 -- 172.21.15.152:0/1947777323 >> 172.21.15.152:0/1947777323 conn(0x7efd7c0b13e0 msgr2=0x7efd7c0b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:13.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd810c4700 1 -- 172.21.15.152:0/1947777323 shutdown_connections 2023-10-16T20:07:13.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.024+0000 7efd810c4700 1 -- 172.21.15.152:0/1947777323 wait complete. 2023-10-16T20:07:13.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.025+0000 7efd810c4700 1 Processor -- start 2023-10-16T20:07:13.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 -- start start 2023-10-16T20:07:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64003a30 0x7efd7c0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c0c71b0 0x7efd7c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 0x7efd7c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c14c300 con 0x7efd7c0acab0 2023-10-16T20:07:13.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0adf50 con 0x7efd64003a30 2023-10-16T20:07:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd810c4700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0ad340 con 0x7efd7c0c71b0 2023-10-16T20:07:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd7b59e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 0x7efd7c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd7b59e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 0x7efd7c15ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59596/0 (socket says 172.21.15.152:59596) 2023-10-16T20:07:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd7b59e700 1 -- 172.21.15.152:0/584495637 learned_addr learned my addr 172.21.15.152:0/584495637 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd7a59c700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c0c71b0 0x7efd7c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.026+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64003a30 0x7efd7c0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd7b59e700 1 -- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c0c71b0 msgr2=0x7efd7c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd7b59e700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c0c71b0 0x7efd7c14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd7b59e700 1 -- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64003a30 msgr2=0x7efd7c0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd7b59e700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64003a30 0x7efd7c0ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd7b59e700 1 -- 172.21.15.152:0/584495637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0ad620 con 0x7efd7c0acab0 2023-10-16T20:07:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd7b59e700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 0x7efd7c15ba90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0707f0 tx=0x7efd7400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74003c10 con 0x7efd7c0acab0 2023-10-16T20:07:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74003d90 con 0x7efd7c0acab0 2023-10-16T20:07:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0ad900 con 0x7efd7c0acab0 2023-10-16T20:07:13.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74005310 con 0x7efd7c0acab0 2023-10-16T20:07:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.027+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0acf30 con 0x7efd7c0acab0 2023-10-16T20:07:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.028+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c0ad0f0 con 0x7efd7c0acab0 2023-10-16T20:07:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.028+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd74005470 con 0x7efd7c0acab0 2023-10-16T20:07:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.029+0000 7efd637fe700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd6806af00 0x7efd6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.029+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd74089900 con 0x7efd7c0acab0 2023-10-16T20:07:13.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.029+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd6806af00 0x7efd6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.029+0000 7efd7ad9d700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd6806af00 0x7efd6806d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd70001930 tx=0x7efd70007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.033+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd740545f0 con 0x7efd7c0acab0 2023-10-16T20:07:13.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.227+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd7c04ebb0 con 0x7efd7c0acab0 2023-10-16T20:07:13.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.227+0000 7efd637fe700 1 -- 172.21.15.152:0/584495637 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd74057c10 con 0x7efd7c0acab0 2023-10-16T20:07:13.230 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:13.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd6806af00 msgr2=0x7efd6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd6806af00 0x7efd6806d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efd70001930 tx=0x7efd70007000 comp rx=0 tx=0).stop 2023-10-16T20:07:13.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 msgr2=0x7efd7c15ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 0x7efd7c15ba90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0707f0 tx=0x7efd7400edc0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 shutdown_connections 2023-10-16T20:07:13.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efd6806af00 0x7efd6806d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd7c0acab0 0x7efd7c15ba90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efd64003a30 0x7efd7c0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.229+0000 7efd810c4700 1 --2- 172.21.15.152:0/584495637 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efd7c0c71b0 0x7efd7c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.230+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 >> 172.21.15.152:0/584495637 conn(0x7efd7c0b13e0 msgr2=0x7efd7c06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:13.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.230+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 shutdown_connections 2023-10-16T20:07:13.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.230+0000 7efd810c4700 1 -- 172.21.15.152:0/584495637 wait complete. 2023-10-16T20:07:13.244 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:13.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.367+0000 7f7cc5f5d700 1 Processor -- start 2023-10-16T20:07:13.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.367+0000 7f7cc5f5d700 1 -- start start 2023-10-16T20:07:13.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cc5f5d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7cc015dec0 0x7f7cc006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cc5f5d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00cba90 con 0x7f7cc015e350 2023-10-16T20:07:13.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cc5f5d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc015ee40 con 0x7f7cc015a250 2023-10-16T20:07:13.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cc5f5d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00cb510 con 0x7f7cc015dec0 2023-10-16T20:07:13.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbeffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7cc015dec0 0x7f7cc006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7cc015e350 0x7f7cc00cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39802/0 (socket says 172.21.15.152:39802) 2023-10-16T20:07:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbffff700 1 -- 172.21.15.152:0/785378539 learned_addr learned my addr 172.21.15.152:0/785378539 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbeffd700 1 -- 172.21.15.152:0/785378539 >> v1:172.21.15.163:6789/0 conn(0x7f7cc015a250 legacy=0x7f7cc00717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbeffd700 1 -- 172.21.15.152:0/785378539 >> v1:172.21.15.152:6789/0 conn(0x7f7cc015e350 legacy=0x7f7cc00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbeffd700 1 -- 172.21.15.152:0/785378539 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc015e880 con 0x7f7cc015dec0 2023-10-16T20:07:13.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbe7fc700 1 -- 172.21.15.152:0/785378539 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262460855 0 0) 0x7f7cc00cba90 con 0x7f7cc015e350 2023-10-16T20:07:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbeffd700 1 --2- 172.21.15.152:0/785378539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc006d5b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009840 tx=0x7f7cb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd176e962660d0c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbe7fc700 1 -- 172.21.15.152:0/785378539 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4011830 con 0x7f7cc015dec0 2023-10-16T20:07:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbe7fc700 1 -- 172.21.15.152:0/785378539 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4011990 con 0x7f7cc015dec0 2023-10-16T20:07:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.368+0000 7f7cbe7fc700 1 -- 172.21.15.152:0/785378539 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4011d20 con 0x7f7cc015dec0 2023-10-16T20:07:13.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/785378539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 msgr2=0x7f7cc006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/785378539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc006d5b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009840 tx=0x7f7cb4009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/785378539 shutdown_connections 2023-10-16T20:07:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/785378539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc006d5b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/785378539 >> 172.21.15.152:0/785378539 conn(0x7f7cc00ccbe0 msgr2=0x7f7cc00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:13.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/785378539 shutdown_connections 2023-10-16T20:07:13.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.369+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/785378539 wait complete. 2023-10-16T20:07:13.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.370+0000 7f7cc5f5d700 1 Processor -- start 2023-10-16T20:07:13.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.370+0000 7f7cc5f5d700 1 -- start start 2023-10-16T20:07:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cc5f5d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cc015a250 0x7f7cc00c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cc5f5d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc0146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cc5f5d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cc015e350 0x7f7cc014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cc5f5d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0146d50 con 0x7f7cc015dec0 2023-10-16T20:07:13.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cc5f5d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c5970 con 0x7f7cc015a250 2023-10-16T20:07:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cc5f5d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc014f3e0 con 0x7f7cc015e350 2023-10-16T20:07:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc0146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc0146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59606/0 (socket says 172.21.15.152:59606) 2023-10-16T20:07:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 -- 172.21.15.152:0/1753345120 learned_addr learned my addr 172.21.15.152:0/1753345120 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:13.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbf7fe700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cc015a250 0x7f7cc00c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbffff700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cc015e350 0x7f7cc014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 -- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cc015e350 msgr2=0x7f7cc014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cc015e350 0x7f7cc014eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 -- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cc015a250 msgr2=0x7f7cc00c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cc015a250 0x7f7cc00c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.371+0000 7f7cbeffd700 1 -- 172.21.15.152:0/1753345120 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb40094a0 con 0x7f7cc015dec0 2023-10-16T20:07:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.372+0000 7f7cbeffd700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc0146810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4014040 tx=0x7f7cb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.372+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb401a860 con 0x7f7cc015dec0 2023-10-16T20:07:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.372+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb401a9c0 con 0x7f7cc015dec0 2023-10-16T20:07:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.372+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb401ad30 con 0x7f7cc015dec0 2023-10-16T20:07:13.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.372+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc014f6c0 con 0x7f7cc015dec0 2023-10-16T20:07:13.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.372+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc00c5f10 con 0x7f7cc015dec0 2023-10-16T20:07:13.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.373+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc004ebb0 con 0x7f7cc015dec0 2023-10-16T20:07:13.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.373+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7cb4022070 con 0x7f7cc015dec0 2023-10-16T20:07:13.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.374+0000 7f7ca7fff700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7cac06af00 0x7f7cac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.374+0000 7f7cbf7fe700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7cac06af00 0x7f7cac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.374+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7cb408a890 con 0x7f7cc015dec0 2023-10-16T20:07:13.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.374+0000 7f7cbf7fe700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7cac06af00 0x7f7cac06d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0007fd0 tx=0x7f7cb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.378+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7cb4055740 con 0x7f7cc015dec0 2023-10-16T20:07:13.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.566+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cc00b60e0 con 0x7f7cc015dec0 2023-10-16T20:07:13.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.566+0000 7f7ca7fff700 1 -- 172.21.15.152:0/1753345120 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cb4029020 con 0x7f7cc015dec0 2023-10-16T20:07:13.570 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:13.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7cac06af00 msgr2=0x7f7cac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7cac06af00 0x7f7cac06d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0007fd0 tx=0x7f7cb0009040 comp rx=0 tx=0).stop 2023-10-16T20:07:13.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 msgr2=0x7f7cc0146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc0146810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4014040 tx=0x7f7cb4004750 comp rx=0 tx=0).stop 2023-10-16T20:07:13.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 shutdown_connections 2023-10-16T20:07:13.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7cac06af00 0x7f7cac06d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7cc015e350 0x7f7cc014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7cc015a250 0x7f7cc00c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 --2- 172.21.15.152:0/1753345120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cc015dec0 0x7f7cc0146810 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 >> 172.21.15.152:0/1753345120 conn(0x7f7cc00ccbe0 msgr2=0x7f7cc01598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:13.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.568+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 shutdown_connections 2023-10-16T20:07:13.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.569+0000 7f7cc5f5d700 1 -- 172.21.15.152:0/1753345120 wait complete. 2023-10-16T20:07:13.584 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:13.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.704+0000 7f4f7c671700 1 Processor -- start 2023-10-16T20:07:13.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.704+0000 7f4f7c671700 1 -- start start 2023-10-16T20:07:13.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.705+0000 7f4f7c671700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f7415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.705+0000 7f4f7c671700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4f740cdd30 0x7f4f740ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.705+0000 7f4f7c671700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f74161360 con 0x7f4f7406b370 2023-10-16T20:07:13.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.705+0000 7f4f7c671700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f740ce6f0 con 0x7f4f740cdd30 2023-10-16T20:07:13.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.705+0000 7f4f7c671700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7406b750 con 0x7f4f7406a820 2023-10-16T20:07:13.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f7415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f7ac0e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4f740cdd30 0x7f4f740ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f7415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:48270/0 (socket says 172.21.15.152:48270) 2023-10-16T20:07:13.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 -- 172.21.15.152:0/194264288 learned_addr learned my addr 172.21.15.152:0/194264288 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:13.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 -- 172.21.15.152:0/194264288 >> v2:172.21.15.163:3300/0 conn(0x7f4f740cdd30 msgr2=0x7f4f740ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:13.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 --2- 172.21.15.152:0/194264288 >> v2:172.21.15.163:3300/0 conn(0x7f4f740cdd30 0x7f4f740ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 -- 172.21.15.152:0/194264288 >> v1:172.21.15.163:6789/0 conn(0x7f4f7406b370 legacy=0x7f4f7406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 -- 172.21.15.152:0/194264288 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7406dcc0 con 0x7f4f7406a820 2023-10-16T20:07:13.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f79c0c700 1 --2- 172.21.15.152:0/194264288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f7415dcb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f700098f0 tx=0x7f4f70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c40c90051c1d5d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f7940b700 1 -- 172.21.15.152:0/194264288 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70011830 con 0x7f4f7406a820 2023-10-16T20:07:13.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f7940b700 1 -- 172.21.15.152:0/194264288 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70011990 con 0x7f4f7406a820 2023-10-16T20:07:13.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.706+0000 7f4f7940b700 1 -- 172.21.15.152:0/194264288 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70011d20 con 0x7f4f7406a820 2023-10-16T20:07:13.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 -- 172.21.15.152:0/194264288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 msgr2=0x7f4f7415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 --2- 172.21.15.152:0/194264288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f7415dcb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f700098f0 tx=0x7f4f70009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:13.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 -- 172.21.15.152:0/194264288 shutdown_connections 2023-10-16T20:07:13.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 --2- 172.21.15.152:0/194264288 >> v2:172.21.15.163:3300/0 conn(0x7f4f740cdd30 0x7f4f740ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 --2- 172.21.15.152:0/194264288 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f7415dcb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 -- 172.21.15.152:0/194264288 >> 172.21.15.152:0/194264288 conn(0x7f4f740ccbe0 msgr2=0x7f4f740ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:13.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 -- 172.21.15.152:0/194264288 shutdown_connections 2023-10-16T20:07:13.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.707+0000 7f4f7c671700 1 -- 172.21.15.152:0/194264288 wait complete. 2023-10-16T20:07:13.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.708+0000 7f4f7c671700 1 Processor -- start 2023-10-16T20:07:13.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.708+0000 7f4f7c671700 1 -- start start 2023-10-16T20:07:13.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7c671700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f741f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7c671700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f7406b370 0x7f4f740b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7c671700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 0x7f4f740b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7c671700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741f74e0 con 0x7f4f740cdd30 2023-10-16T20:07:13.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7c671700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741f3f00 con 0x7f4f7406b370 2023-10-16T20:07:13.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7c671700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741f6720 con 0x7f4f7406a820 2023-10-16T20:07:13.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 0x7f4f740b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 0x7f4f740b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59624/0 (socket says 172.21.15.152:59624) 2023-10-16T20:07:13.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 -- 172.21.15.152:0/840947717 learned_addr learned my addr 172.21.15.152:0/840947717 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:13.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7a40d700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f741f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f79c0c700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f7406b370 0x7f4f740b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 -- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 msgr2=0x7f4f741f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f741f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 -- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f7406b370 msgr2=0x7f4f740b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f7406b370 0x7f4f740b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 -- 172.21.15.152:0/840947717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009550 con 0x7f4f740cdd30 2023-10-16T20:07:13.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f7ac0e700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 0x7f4f740b51a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00efc0 tx=0x7f4f6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.709+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c009ea0 con 0x7f4f740cdd30 2023-10-16T20:07:13.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.710+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00f040 con 0x7f4f740cdd30 2023-10-16T20:07:13.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.710+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f741f6a00 con 0x7f4f740cdd30 2023-10-16T20:07:13.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.710+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00ced0 con 0x7f4f740cdd30 2023-10-16T20:07:13.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.710+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f741f6fc0 con 0x7f4f740cdd30 2023-10-16T20:07:13.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.711+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f74072cc0 con 0x7f4f740cdd30 2023-10-16T20:07:13.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.711+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f6c014480 con 0x7f4f740cdd30 2023-10-16T20:07:13.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.711+0000 7f4f6affd700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4f5806af00 0x7f4f5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:13.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.712+0000 7f4f7a40d700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4f5806af00 0x7f4f5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:13.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.712+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f6c08a150 con 0x7f4f740cdd30 2023-10-16T20:07:13.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.712+0000 7f4f7a40d700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4f5806af00 0x7f4f5806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007fd0 tx=0x7f4f64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:13.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.716+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f6c054e50 con 0x7f4f740cdd30 2023-10-16T20:07:13.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.909+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f741f71b0 con 0x7f4f740cdd30 2023-10-16T20:07:13.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.909+0000 7f4f6affd700 1 -- 172.21.15.152:0/840947717 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f6c058470 con 0x7f4f740cdd30 2023-10-16T20:07:13.913 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:13.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4f5806af00 msgr2=0x7f4f5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4f5806af00 0x7f4f5806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007fd0 tx=0x7f4f64009040 comp rx=0 tx=0).stop 2023-10-16T20:07:13.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 msgr2=0x7f4f740b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:13.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 0x7f4f740b51a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00efc0 tx=0x7f4f6c00c3a0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 shutdown_connections 2023-10-16T20:07:13.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4f5806af00 0x7f4f5806d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4f7406a820 0x7f4f741f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f740cdd30 0x7f4f740b51a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 --2- 172.21.15.152:0/840947717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f7406b370 0x7f4f740b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:13.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 >> 172.21.15.152:0/840947717 conn(0x7f4f740ccbe0 msgr2=0x7f4f740cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:13.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 shutdown_connections 2023-10-16T20:07:13.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:13.911+0000 7f4f7c671700 1 -- 172.21.15.152:0/840947717 wait complete. 2023-10-16T20:07:13.926 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:14.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.049+0000 7f8b8e7c6700 1 Processor -- start 2023-10-16T20:07:14.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.049+0000 7f8b8e7c6700 1 -- start start 2023-10-16T20:07:14.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8e7c6700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8b8815b4e0 0x7f8b8806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8e7c6700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8b880b33f0 0x7f8b880b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8e7c6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b88070620 con 0x7f8b880cd770 2023-10-16T20:07:14.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8e7c6700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b88070900 con 0x7f8b880b33f0 2023-10-16T20:07:14.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8e7c6700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b88070be0 con 0x7f8b8815b4e0 2023-10-16T20:07:14.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8cd63700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8b880b33f0 0x7f8b880b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b877fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8b880cd770 0x7f8b880b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39826/0 (socket says 172.21.15.152:39826) 2023-10-16T20:07:14.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b877fe700 1 -- 172.21.15.152:0/4035846193 learned_addr learned my addr 172.21.15.152:0/4035846193 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:14.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b87fff700 1 --2- 172.21.15.152:0/4035846193 >> v2:172.21.15.163:3300/0 conn(0x7f8b8815b4e0 0x7f8b8806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8cd63700 1 -- 172.21.15.152:0/4035846193 >> v2:172.21.15.163:3300/0 conn(0x7f8b8815b4e0 msgr2=0x7f8b8806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:14.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8cd63700 1 --2- 172.21.15.152:0/4035846193 >> v2:172.21.15.163:3300/0 conn(0x7f8b8815b4e0 0x7f8b8806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8cd63700 1 -- 172.21.15.152:0/4035846193 >> v1:172.21.15.152:6789/0 conn(0x7f8b880cd770 legacy=0x7f8b880b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8cd63700 1 -- 172.21.15.152:0/4035846193 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88070ec0 con 0x7f8b880b33f0 2023-10-16T20:07:14.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.050+0000 7f8b8cd63700 1 --2- 172.21.15.152:0/4035846193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880b33f0 0x7f8b880b4450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b880c4d60 tx=0x7f8b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71972c17316f970 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b86ffd700 1 -- 172.21.15.152:0/4035846193 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000e070 con 0x7f8b880b33f0 2023-10-16T20:07:14.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b86ffd700 1 -- 172.21.15.152:0/4035846193 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8000bbd0 con 0x7f8b880b33f0 2023-10-16T20:07:14.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b86ffd700 1 -- 172.21.15.152:0/4035846193 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80012430 con 0x7f8b880b33f0 2023-10-16T20:07:14.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/4035846193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880b33f0 msgr2=0x7f8b880b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/4035846193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880b33f0 0x7f8b880b4450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b880c4d60 tx=0x7f8b8000b330 comp rx=0 tx=0).stop 2023-10-16T20:07:14.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/4035846193 shutdown_connections 2023-10-16T20:07:14.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/4035846193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880b33f0 0x7f8b880b4450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/4035846193 >> v2:172.21.15.163:3300/0 conn(0x7f8b8815b4e0 0x7f8b8806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.051+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/4035846193 >> 172.21.15.152:0/4035846193 conn(0x7f8b880cdce0 msgr2=0x7f8b880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:14.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.052+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/4035846193 shutdown_connections 2023-10-16T20:07:14.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.052+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/4035846193 wait complete. 2023-10-16T20:07:14.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.054+0000 7f8b8e7c6700 1 Processor -- start 2023-10-16T20:07:14.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.055+0000 7f8b8e7c6700 1 -- start start 2023-10-16T20:07:14.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8e7c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b880b33f0 0x7f8b881587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8e7c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880cd770 0x7f8b880be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8e7c6700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b8815b4e0 0x7f8b880be5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8e7c6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880c6c70 con 0x7f8b880cd770 2023-10-16T20:07:14.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8e7c6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880c3970 con 0x7f8b880b33f0 2023-10-16T20:07:14.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8e7c6700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b880c6ec0 con 0x7f8b8815b4e0 2023-10-16T20:07:14.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880cd770 0x7f8b880be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b877fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880cd770 0x7f8b880be0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59638/0 (socket says 172.21.15.152:59638) 2023-10-16T20:07:14.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b877fe700 1 -- 172.21.15.152:0/3723653696 learned_addr learned my addr 172.21.15.152:0/3723653696 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:14.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b87fff700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b880b33f0 0x7f8b881587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.056+0000 7f8b8cd63700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b8815b4e0 0x7f8b880be5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b87fff700 1 -- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b8815b4e0 msgr2=0x7f8b880be5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b87fff700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b8815b4e0 0x7f8b880be5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b87fff700 1 -- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880cd770 msgr2=0x7f8b880be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b87fff700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880cd770 0x7f8b880be0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b87fff700 1 -- 172.21.15.152:0/3723653696 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80009a70 con 0x7f8b880b33f0 2023-10-16T20:07:14.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b8cd63700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b8815b4e0 0x7f8b880be5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:14.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b87fff700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b880b33f0 0x7f8b881587e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800d5c0 tx=0x7f8b7800d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b780125f0 con 0x7f8b880b33f0 2023-10-16T20:07:14.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b78012750 con 0x7f8b880b33f0 2023-10-16T20:07:14.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.057+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78012ae0 con 0x7f8b880b33f0 2023-10-16T20:07:14.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.058+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b880c71a0 con 0x7f8b880b33f0 2023-10-16T20:07:14.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.058+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b880c7760 con 0x7f8b880b33f0 2023-10-16T20:07:14.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.058+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8804ebb0 con 0x7f8b880b33f0 2023-10-16T20:07:14.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.059+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8b78012c40 con 0x7f8b880b33f0 2023-10-16T20:07:14.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.059+0000 7f8b84ff9700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8b7406af00 0x7f8b7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.060+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b78089bf0 con 0x7f8b880b33f0 2023-10-16T20:07:14.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.060+0000 7f8b877fe700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8b7406af00 0x7f8b7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.060+0000 7f8b877fe700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8b7406af00 0x7f8b7406d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b880c5a10 tx=0x7f8b7c007f70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.064+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b780549c0 con 0x7f8b880b33f0 2023-10-16T20:07:14.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.250+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8b880d0bf0 con 0x7f8b880b33f0 2023-10-16T20:07:14.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.251+0000 7f8b84ff9700 1 -- 172.21.15.152:0/3723653696 <== mon.1 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b78057fe0 con 0x7f8b880b33f0 2023-10-16T20:07:14.254 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:14.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8b7406af00 msgr2=0x7f8b7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8b7406af00 0x7f8b7406d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b880c5a10 tx=0x7f8b7c007f70 comp rx=0 tx=0).stop 2023-10-16T20:07:14.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b880b33f0 msgr2=0x7f8b881587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b880b33f0 0x7f8b881587e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800d5c0 tx=0x7f8b7800d8d0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 shutdown_connections 2023-10-16T20:07:14.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8b7406af00 0x7f8b7406d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8b8815b4e0 0x7f8b880be5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b880b33f0 0x7f8b881587e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 --2- 172.21.15.152:0/3723653696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b880cd770 0x7f8b880be0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 >> 172.21.15.152:0/3723653696 conn(0x7f8b880cdce0 msgr2=0x7f8b880c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:14.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 shutdown_connections 2023-10-16T20:07:14.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.253+0000 7f8b8e7c6700 1 -- 172.21.15.152:0/3723653696 wait complete. 2023-10-16T20:07:14.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.387+0000 7f72127ae700 1 Processor -- start 2023-10-16T20:07:14.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.387+0000 7f72127ae700 1 -- start start 2023-10-16T20:07:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f72127ae700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f720c0cf7d0 0x7f720c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f72127ae700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f720c0ca7d0 0x7f720c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f72127ae700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720c0cfeb0 con 0x7f720c06a820 2023-10-16T20:07:14.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f72127ae700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720c0ce410 con 0x7f720c0ca7d0 2023-10-16T20:07:14.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f72127ae700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720c0cfc30 con 0x7f720c0cf7d0 2023-10-16T20:07:14.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f7210d4b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f720c0ca7d0 0x7f720c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f720bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f720c06a820 0x7f720c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39840/0 (socket says 172.21.15.152:39840) 2023-10-16T20:07:14.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f720bfff700 1 -- 172.21.15.152:0/855657669 learned_addr learned my addr 172.21.15.152:0/855657669 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:14.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f720b7fe700 1 --2- 172.21.15.152:0/855657669 >> v2:172.21.15.163:3300/0 conn(0x7f720c0cf7d0 0x7f720c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f7210d4b700 1 -- 172.21.15.152:0/855657669 >> v2:172.21.15.163:3300/0 conn(0x7f720c0cf7d0 msgr2=0x7f720c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:14.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f7210d4b700 1 --2- 172.21.15.152:0/855657669 >> v2:172.21.15.163:3300/0 conn(0x7f720c0cf7d0 0x7f720c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f7210d4b700 1 -- 172.21.15.152:0/855657669 >> v1:172.21.15.152:6789/0 conn(0x7f720c06a820 legacy=0x7f720c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f7210d4b700 1 -- 172.21.15.152:0/855657669 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0af9d0 con 0x7f720c0ca7d0 2023-10-16T20:07:14.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f720affd700 1 -- 172.21.15.152:0/855657669 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496091576 0 0) 0x7f720c0cfeb0 con 0x7f720c06a820 2023-10-16T20:07:14.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f720b7fe700 1 --2- 172.21.15.152:0/855657669 >> v2:172.21.15.163:3300/0 conn(0x7f720c0cf7d0 0x7f720c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:14.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.388+0000 7f7210d4b700 1 --2- 172.21.15.152:0/855657669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0ca7d0 0x7f720c071ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f720c06c8a0 tx=0x7f720400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fef7a2d86bfa02e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f720affd700 1 -- 172.21.15.152:0/855657669 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720400e070 con 0x7f720c0ca7d0 2023-10-16T20:07:14.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f720affd700 1 -- 172.21.15.152:0/855657669 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400bbd0 con 0x7f720c0ca7d0 2023-10-16T20:07:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f720affd700 1 -- 172.21.15.152:0/855657669 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204012430 con 0x7f720c0ca7d0 2023-10-16T20:07:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 -- 172.21.15.152:0/855657669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0ca7d0 msgr2=0x7f720c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 --2- 172.21.15.152:0/855657669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0ca7d0 0x7f720c071ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f720c06c8a0 tx=0x7f720400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 -- 172.21.15.152:0/855657669 shutdown_connections 2023-10-16T20:07:14.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 --2- 172.21.15.152:0/855657669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0ca7d0 0x7f720c071ea0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 --2- 172.21.15.152:0/855657669 >> v2:172.21.15.163:3300/0 conn(0x7f720c0cf7d0 0x7f720c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 -- 172.21.15.152:0/855657669 >> 172.21.15.152:0/855657669 conn(0x7f720c0d0180 msgr2=0x7f720c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 -- 172.21.15.152:0/855657669 shutdown_connections 2023-10-16T20:07:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.389+0000 7f72127ae700 1 -- 172.21.15.152:0/855657669 wait complete. 2023-10-16T20:07:14.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.390+0000 7f72127ae700 1 Processor -- start 2023-10-16T20:07:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 -- start start 2023-10-16T20:07:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f720c06a820 0x7f720c1f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f720c0ca7d0 0x7f720c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 0x7f720c15f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c0aea40 con 0x7f720c0cf7d0 2023-10-16T20:07:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c1f3030 con 0x7f720c0ca7d0 2023-10-16T20:07:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f72127ae700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720c06ea00 con 0x7f720c06a820 2023-10-16T20:07:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f7210d4b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 0x7f720c15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f7210d4b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 0x7f720c15f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59652/0 (socket says 172.21.15.152:59652) 2023-10-16T20:07:14.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.391+0000 7f7210d4b700 1 -- 172.21.15.152:0/873124181 learned_addr learned my addr 172.21.15.152:0/873124181 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f720bfff700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f720c06a820 0x7f720c1f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f720b7fe700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f720c0ca7d0 0x7f720c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7210d4b700 1 -- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f720c06a820 msgr2=0x7f720c1f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7210d4b700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f720c06a820 0x7f720c1f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7210d4b700 1 -- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f720c0ca7d0 msgr2=0x7f720c06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7210d4b700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f720c0ca7d0 0x7f720c06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7210d4b700 1 -- 172.21.15.152:0/873124181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204009a70 con 0x7f720c0cf7d0 2023-10-16T20:07:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f720bfff700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f720c06a820 0x7f720c1f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7210d4b700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 0x7f720c15f880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f720c06c8d0 tx=0x7f7204004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204012430 con 0x7f720c0cf7d0 2023-10-16T20:07:14.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7204020070 con 0x7f720c0cf7d0 2023-10-16T20:07:14.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204004280 con 0x7f720c0cf7d0 2023-10-16T20:07:14.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c0addc0 con 0x7f720c0cf7d0 2023-10-16T20:07:14.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.392+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c0ae380 con 0x7f720c0cf7d0 2023-10-16T20:07:14.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.393+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c0af3d0 con 0x7f720c0cf7d0 2023-10-16T20:07:14.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.393+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f72040043e0 con 0x7f720c0cf7d0 2023-10-16T20:07:14.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.394+0000 7f7208ff9700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71f806af00 0x7f71f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.394+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7204022070 con 0x7f720c0cf7d0 2023-10-16T20:07:14.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.394+0000 7f720bfff700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71f806af00 0x7f71f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.394+0000 7f720bfff700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71f806af00 0x7f71f806d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000f60 tx=0x7f71fc007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.398+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72040565e0 con 0x7f720c0cf7d0 2023-10-16T20:07:14.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.591+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f720c04ebb0 con 0x7f720c0cf7d0 2023-10-16T20:07:14.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.592+0000 7f7208ff9700 1 -- 172.21.15.152:0/873124181 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f7204059c00 con 0x7f720c0cf7d0 2023-10-16T20:07:14.595 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:14.595 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:14.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71f806af00 msgr2=0x7f71f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71f806af00 0x7f71f806d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000f60 tx=0x7f71fc007cc0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 msgr2=0x7f720c15f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 0x7f720c15f880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f720c06c8d0 tx=0x7f7204004b20 comp rx=0 tx=0).stop 2023-10-16T20:07:14.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 shutdown_connections 2023-10-16T20:07:14.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f71f806af00 0x7f71f806d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f720c06a820 0x7f720c1f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720c0cf7d0 0x7f720c15f880 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 --2- 172.21.15.152:0/873124181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f720c0ca7d0 0x7f720c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 >> 172.21.15.152:0/873124181 conn(0x7f720c0d0180 msgr2=0x7f720c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:14.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 shutdown_connections 2023-10-16T20:07:14.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.594+0000 7f72127ae700 1 -- 172.21.15.152:0/873124181 wait complete. 2023-10-16T20:07:14.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:14.610 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.731+0000 7f11fd86f700 1 Processor -- start 2023-10-16T20:07:14.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.731+0000 7f11fd86f700 1 -- start start 2023-10-16T20:07:14.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.731+0000 7f11fd86f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f11f80b3430 0x7f11f8161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.731+0000 7f11fd86f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80d17a0 con 0x7f11f80cf2f0 2023-10-16T20:07:14.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.731+0000 7f11fd86f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80d0ee0 con 0x7f11f80cf6d0 2023-10-16T20:07:14.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.731+0000 7f11fd86f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80d1150 con 0x7f11f80b3430 2023-10-16T20:07:14.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f6ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f11f80cf2f0 0x7f11f80b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39854/0 (socket says 172.21.15.152:39854) 2023-10-16T20:07:14.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f6ffd700 1 -- 172.21.15.152:0/630266204 learned_addr learned my addr 172.21.15.152:0/630266204 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:14.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f77fe700 1 --2- 172.21.15.152:0/630266204 >> v2:172.21.15.163:3300/0 conn(0x7f11f80b3430 0x7f11f8161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498798489 0 0) 0x7f11f80d17a0 con 0x7f11f80cf2f0 2023-10-16T20:07:14.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e40035b0 con 0x7f11f80cf2f0 2023-10-16T20:07:14.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209985386 0 0) 0x7f11e40035b0 con 0x7f11f80cf2f0 2023-10-16T20:07:14.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 >> v2:172.21.15.163:3300/0 conn(0x7f11f80b3430 msgr2=0x7f11f8161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:14.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 --2- 172.21.15.152:0/630266204 >> v2:172.21.15.163:3300/0 conn(0x7f11f80b3430 0x7f11f8161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 >> v1:172.21.15.163:6789/0 conn(0x7f11f80cf6d0 legacy=0x7f11f8161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80d1430 con 0x7f11f80cf2f0 2023-10-16T20:07:14.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f11e0001670 con 0x7f11f80cf2f0 2023-10-16T20:07:14.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 >> v1:172.21.15.152:6789/0 conn(0x7f11f80cf2f0 legacy=0x7f11f80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e4003a00 0x7f11e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4004850 0x7f11e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4005210 0x7f11e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80d1150 con 0x7f11e4004850 2023-10-16T20:07:14.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c0b0 con 0x7f11e4003a00 2023-10-16T20:07:14.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c270 con 0x7f11e4005210 2023-10-16T20:07:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f67fc700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4004850 0x7f11e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f6ffd700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e4003a00 0x7f11e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.732+0000 7f11f77fe700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4005210 0x7f11e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.742 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f67fc700 1 -- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4005210 msgr2=0x7f11e400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f67fc700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4005210 0x7f11e400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f67fc700 1 -- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e4003a00 msgr2=0x7f11e4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f67fc700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e4003a00 0x7f11e4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f67fc700 1 -- 172.21.15.152:0/630266204 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40035b0 con 0x7f11e4004850 2023-10-16T20:07:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f77fe700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4005210 0x7f11e400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:14.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f77fe700 1 -- 172.21.15.152:0/630266204 reap_dead start 2023-10-16T20:07:14.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f67fc700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4004850 0x7f11e4004cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11e80017c0 tx=0x7f11e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea69765dba11d21c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80052d0 con 0x7f11e4004850 2023-10-16T20:07:14.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8005430 con 0x7f11e4004850 2023-10-16T20:07:14.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11f5ffb700 1 -- 172.21.15.152:0/630266204 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80038c0 con 0x7f11e4004850 2023-10-16T20:07:14.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11fd86f700 1 -- 172.21.15.152:0/630266204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4004850 msgr2=0x7f11e4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11fd86f700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4004850 0x7f11e4004cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f11e80017c0 tx=0x7f11e4005880 comp rx=0 tx=0).stop 2023-10-16T20:07:14.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11fd86f700 1 -- 172.21.15.152:0/630266204 shutdown_connections 2023-10-16T20:07:14.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11fd86f700 1 --2- 172.21.15.152:0/630266204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4004850 0x7f11e4004cd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11fd86f700 1 -- 172.21.15.152:0/630266204 >> 172.21.15.152:0/630266204 conn(0x7f11f806a820 msgr2=0x7f11f806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:14.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.733+0000 7f11fd86f700 1 -- 172.21.15.152:0/630266204 shutdown_connections 2023-10-16T20:07:14.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.734+0000 7f11fd86f700 1 -- 172.21.15.152:0/630266204 wait complete. 2023-10-16T20:07:14.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.735+0000 7f11fd86f700 1 Processor -- start 2023-10-16T20:07:14.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.735+0000 7f11fd86f700 1 -- start start 2023-10-16T20:07:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11fd86f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4004850 0x7f11f80c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11fd86f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 0x7f11f8159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11fd86f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f81f3460 0x7f11f8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11fd86f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f81589d0 con 0x7f11f80b1c40 2023-10-16T20:07:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11fd86f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c6870 con 0x7f11f81f3460 2023-10-16T20:07:14.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11fd86f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c6b10 con 0x7f11e4004850 2023-10-16T20:07:14.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11f67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 0x7f11f8159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11f67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 0x7f11f8159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59668/0 (socket says 172.21.15.152:59668) 2023-10-16T20:07:14.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11f67fc700 1 -- 172.21.15.152:0/3930758355 learned_addr learned my addr 172.21.15.152:0/3930758355 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:14.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11f77fe700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f81f3460 0x7f11f8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.736+0000 7f11f6ffd700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4004850 0x7f11f80c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f67fc700 1 -- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4004850 msgr2=0x7f11f80c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f67fc700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4004850 0x7f11f80c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f67fc700 1 -- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f81f3460 msgr2=0x7f11f8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f67fc700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f81f3460 0x7f11f8157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f67fc700 1 -- 172.21.15.152:0/3930758355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80c6df0 con 0x7f11f80b1c40 2023-10-16T20:07:14.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f77fe700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f81f3460 0x7f11f8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:14.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11f67fc700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 0x7f11f8159df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f11e8015040 tx=0x7f11e8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8001290 con 0x7f11f80b1c40 2023-10-16T20:07:14.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8006860 con 0x7f11f80b1c40 2023-10-16T20:07:14.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f80c70d0 con 0x7f11f80b1c40 2023-10-16T20:07:14.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8006bf0 con 0x7f11f80b1c40 2023-10-16T20:07:14.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.737+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f80c42d0 con 0x7f11f80b1c40 2023-10-16T20:07:14.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.738+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f80cdb20 con 0x7f11f80b1c40 2023-10-16T20:07:14.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.738+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f11e8019040 con 0x7f11f80b1c40 2023-10-16T20:07:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.739+0000 7f11effff700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f11d806af00 0x7f11d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.739+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f11e808a380 con 0x7f11f80b1c40 2023-10-16T20:07:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.739+0000 7f11f6ffd700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f11d806af00 0x7f11d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.739+0000 7f11f6ffd700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f11d806af00 0x7f11d806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11e0001c90 tx=0x7f11e0000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:14.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.743+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11e80551b0 con 0x7f11f80b1c40 2023-10-16T20:07:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.933+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11f80cfd60 con 0x7f11f80b1c40 2023-10-16T20:07:14.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.934+0000 7f11effff700 1 -- 172.21.15.152:0/3930758355 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11e80587d0 con 0x7f11f80b1c40 2023-10-16T20:07:14.937 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f11d806af00 msgr2=0x7f11d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f11d806af00 0x7f11d806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11e0001c90 tx=0x7f11e0000ed0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 msgr2=0x7f11f8159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 0x7f11f8159df0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f11e8015040 tx=0x7f11e8001120 comp rx=0 tx=0).stop 2023-10-16T20:07:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 shutdown_connections 2023-10-16T20:07:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f11d806af00 0x7f11d806d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f11e4004850 0x7f11f80c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f81f3460 0x7f11f8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 --2- 172.21.15.152:0/3930758355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11f80b1c40 0x7f11f8159df0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 >> 172.21.15.152:0/3930758355 conn(0x7f11f806a820 msgr2=0x7f11f8144ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:14.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 shutdown_connections 2023-10-16T20:07:14.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:14.936+0000 7f11fd86f700 1 -- 172.21.15.152:0/3930758355 wait complete. 2023-10-16T20:07:14.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:15.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.072+0000 7ff902b7c700 1 Processor -- start 2023-10-16T20:07:15.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.072+0000 7ff902b7c700 1 -- start start 2023-10-16T20:07:15.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff902b7c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8fc0cac60 0x7ff8fc0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff902b7c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc0ca7d0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff902b7c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8fc06eed0 con 0x7ff8fc0d0df0 2023-10-16T20:07:15.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff902b7c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc0cf900 con 0x7ff8fc0cac60 2023-10-16T20:07:15.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fbfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8fc0cac60 0x7ff8fc0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff900918700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff8fc06eaf0 0x7ff8fc0cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39874/0 (socket says 172.21.15.152:39874) 2023-10-16T20:07:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fbfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8fc0cac60 0x7ff8fc0cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59678/0 (socket says 172.21.15.152:59678) 2023-10-16T20:07:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff900918700 1 -- 172.21.15.152:0/2017394083 learned_addr learned my addr 172.21.15.152:0/2017394083 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fbfff700 1 -- 172.21.15.152:0/2017394083 >> v1:172.21.15.163:6789/0 conn(0x7ff8fc0d0df0 legacy=0x7ff8fc0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fbfff700 1 -- 172.21.15.152:0/2017394083 >> v1:172.21.15.152:6789/0 conn(0x7ff8fc06eaf0 legacy=0x7ff8fc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fbfff700 1 -- 172.21.15.152:0/2017394083 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc161e00 con 0x7ff8fc0cac60 2023-10-16T20:07:15.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fb7fe700 1 -- 172.21.15.152:0/2017394083 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959133371 0 0) 0x7ff8fc0ca7d0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.073+0000 7ff8fbfff700 1 --2- 172.21.15.152:0/2017394083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0cf3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009840 tx=0x7ff8e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b36bd4360ada42c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff8fb7fe700 1 -- 172.21.15.152:0/2017394083 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8004230 con 0x7ff8fc0cac60 2023-10-16T20:07:15.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff8fb7fe700 1 -- 172.21.15.152:0/2017394083 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8004390 con 0x7ff8fc0cac60 2023-10-16T20:07:15.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff8fb7fe700 1 -- 172.21.15.152:0/2017394083 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80036a0 con 0x7ff8fc0cac60 2023-10-16T20:07:15.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 -- 172.21.15.152:0/2017394083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc0cac60 msgr2=0x7ff8fc0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 --2- 172.21.15.152:0/2017394083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0cf3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009840 tx=0x7ff8e8009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:15.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 -- 172.21.15.152:0/2017394083 shutdown_connections 2023-10-16T20:07:15.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 --2- 172.21.15.152:0/2017394083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0cf3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 -- 172.21.15.152:0/2017394083 >> 172.21.15.152:0/2017394083 conn(0x7ff8fc0d0180 msgr2=0x7ff8fc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:15.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 -- 172.21.15.152:0/2017394083 shutdown_connections 2023-10-16T20:07:15.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.074+0000 7ff902b7c700 1 -- 172.21.15.152:0/2017394083 wait complete. 2023-10-16T20:07:15.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.075+0000 7ff902b7c700 1 Processor -- start 2023-10-16T20:07:15.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.075+0000 7ff902b7c700 1 -- start start 2023-10-16T20:07:15.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff902b7c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 0x7ff8fc1f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff902b7c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff902b7c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8fc0d0df0 0x7ff8fc0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff902b7c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1f4190 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff902b7c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b6e80 con 0x7ff8fc0cac60 2023-10-16T20:07:15.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff902b7c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc1f3df0 con 0x7ff8fc0d0df0 2023-10-16T20:07:15.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff900918700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 0x7ff8fc1f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff900918700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 0x7ff8fc1f6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59682/0 (socket says 172.21.15.152:59682) 2023-10-16T20:07:15.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff900918700 1 -- 172.21.15.152:0/1076091377 learned_addr learned my addr 172.21.15.152:0/1076091377 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:15.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff8fbfff700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.076+0000 7ff901119700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8fc0d0df0 0x7ff8fc0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff900918700 1 -- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8fc0d0df0 msgr2=0x7ff8fc0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff900918700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8fc0d0df0 0x7ff8fc0c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff900918700 1 -- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8fc0cac60 msgr2=0x7ff8fc0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff900918700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff900918700 1 -- 172.21.15.152:0/1076091377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80094a0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff900918700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 0x7ff8fc1f6220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00011e0 tx=0x7ff8f000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0004c80 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0004e00 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc1f6a70 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0007310 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.077+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc1f6760 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.078+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc1f42d0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.078+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8f0007470 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.079+0000 7ff8f97fa700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff8e006af00 0x7ff8e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.079+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff8f0089540 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.079+0000 7ff8fbfff700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff8e006af00 0x7ff8e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.079+0000 7ff8fbfff700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff8e006af00 0x7ff8e006d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80090b0 tx=0x7ff8e801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.083+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8fc1f42d0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.271+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8fc06f6e0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.271+0000 7ff8f97fa700 1 -- 172.21.15.152:0/1076091377 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8f00542c0 con 0x7ff8fc06eaf0 2023-10-16T20:07:15.274 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:15.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff8e006af00 msgr2=0x7ff8e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff8e006af00 0x7ff8e006d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80090b0 tx=0x7ff8e801c040 comp rx=0 tx=0).stop 2023-10-16T20:07:15.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 msgr2=0x7ff8fc1f6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 0x7ff8fc1f6220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00011e0 tx=0x7ff8f000ca30 comp rx=0 tx=0).stop 2023-10-16T20:07:15.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 shutdown_connections 2023-10-16T20:07:15.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff8e006af00 0x7ff8e006d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff8fc0d0df0 0x7ff8fc0c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8fc06eaf0 0x7ff8fc1f6220 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 --2- 172.21.15.152:0/1076091377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8fc0cac60 0x7ff8fc0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 >> 172.21.15.152:0/1076091377 conn(0x7ff8fc0d0180 msgr2=0x7ff8fc0ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:15.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 shutdown_connections 2023-10-16T20:07:15.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.273+0000 7ff902b7c700 1 -- 172.21.15.152:0/1076091377 wait complete. 2023-10-16T20:07:15.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:15.411 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.408+0000 7f73e569a700 1 Processor -- start 2023-10-16T20:07:15.412 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73e569a700 1 -- start start 2023-10-16T20:07:15.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73e569a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f73e006bdf0 0x7f73e015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73e569a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f73e015fd30 0x7f73e00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73e569a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00cec30 con 0x7f73e015b4d0 2023-10-16T20:07:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73e569a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00cee80 con 0x7f73e015fd30 2023-10-16T20:07:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73e569a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00cf160 con 0x7f73e006bdf0 2023-10-16T20:07:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73df7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f73e015fd30 0x7f73e00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73df7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f73e015fd30 0x7f73e00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59694/0 (socket says 172.21.15.152:59694) 2023-10-16T20:07:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.409+0000 7f73df7fe700 1 -- 172.21.15.152:0/1466520846 learned_addr learned my addr 172.21.15.152:0/1466520846 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73de7fc700 1 --2- 172.21.15.152:0/1466520846 >> v2:172.21.15.163:3300/0 conn(0x7f73e006bdf0 0x7f73e015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73df7fe700 1 -- 172.21.15.152:0/1466520846 >> v2:172.21.15.163:3300/0 conn(0x7f73e006bdf0 msgr2=0x7f73e015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73df7fe700 1 --2- 172.21.15.152:0/1466520846 >> v2:172.21.15.163:3300/0 conn(0x7f73e006bdf0 0x7f73e015f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73df7fe700 1 -- 172.21.15.152:0/1466520846 >> v1:172.21.15.163:6789/0 conn(0x7f73e015b4d0 legacy=0x7f73e015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73df7fe700 1 -- 172.21.15.152:0/1466520846 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00cf440 con 0x7f73e015fd30 2023-10-16T20:07:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73de7fc700 1 --2- 172.21.15.152:0/1466520846 >> v2:172.21.15.163:3300/0 conn(0x7f73e006bdf0 0x7f73e015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73df7fe700 1 --2- 172.21.15.152:0/1466520846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e015fd30 0x7f73e00cd500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73e00c9f10 tx=0x7f73d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dcfdee67d34de server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73ddffb700 1 -- 172.21.15.152:0/1466520846 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800e070 con 0x7f73e015fd30 2023-10-16T20:07:15.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73ddffb700 1 -- 172.21.15.152:0/1466520846 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800b9c0 con 0x7f73e015fd30 2023-10-16T20:07:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73ddffb700 1 -- 172.21.15.152:0/1466520846 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800bd70 con 0x7f73e015fd30 2023-10-16T20:07:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.410+0000 7f73e569a700 1 -- 172.21.15.152:0/1466520846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e015fd30 msgr2=0x7f73e00cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 --2- 172.21.15.152:0/1466520846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e015fd30 0x7f73e00cd500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73e00c9f10 tx=0x7f73d800b330 comp rx=0 tx=0).stop 2023-10-16T20:07:15.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 -- 172.21.15.152:0/1466520846 shutdown_connections 2023-10-16T20:07:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 --2- 172.21.15.152:0/1466520846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e015fd30 0x7f73e00cd500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 --2- 172.21.15.152:0/1466520846 >> v2:172.21.15.163:3300/0 conn(0x7f73e006bdf0 0x7f73e015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 -- 172.21.15.152:0/1466520846 >> 172.21.15.152:0/1466520846 conn(0x7f73e00b14b0 msgr2=0x7f73e00b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 -- 172.21.15.152:0/1466520846 shutdown_connections 2023-10-16T20:07:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.411+0000 7f73e569a700 1 -- 172.21.15.152:0/1466520846 wait complete. 2023-10-16T20:07:15.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.412+0000 7f73e569a700 1 Processor -- start 2023-10-16T20:07:15.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.412+0000 7f73e569a700 1 -- start start 2023-10-16T20:07:15.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 0x7f73e01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73e015b4d0 0x7f73e00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73e015fd30 0x7f73e006df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0154700 con 0x7f73e006bdf0 2023-10-16T20:07:15.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00c3f30 con 0x7f73e015b4d0 2023-10-16T20:07:15.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e006ce70 con 0x7f73e015fd30 2023-10-16T20:07:15.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 0x7f73e01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 0x7f73e01541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59696/0 (socket says 172.21.15.152:59696) 2023-10-16T20:07:15.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 -- 172.21.15.152:0/2731676373 learned_addr learned my addr 172.21.15.152:0/2731676373 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:15.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73de7fc700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73e015b4d0 0x7f73e00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 -- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73e015fd30 msgr2=0x7f73e006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73df7fe700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73e015fd30 0x7f73e006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73e015fd30 0x7f73e006df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 -- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73e015b4d0 msgr2=0x7f73e00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73e015b4d0 0x7f73e00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 -- 172.21.15.152:0/2731676373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009b30 con 0x7f73e006bdf0 2023-10-16T20:07:15.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73de7fc700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73e015b4d0 0x7f73e00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:15.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73deffd700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 0x7f73e01541c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c490 tx=0x7f73d400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d40052d0 con 0x7f73e006bdf0 2023-10-16T20:07:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4005450 con 0x7f73e006bdf0 2023-10-16T20:07:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e006d150 con 0x7f73e006bdf0 2023-10-16T20:07:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.413+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4006aa0 con 0x7f73e006bdf0 2023-10-16T20:07:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.414+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e006d710 con 0x7f73e006bdf0 2023-10-16T20:07:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.415+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e00743d0 con 0x7f73e006bdf0 2023-10-16T20:07:15.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.415+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f73d4003680 con 0x7f73e006bdf0 2023-10-16T20:07:15.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.415+0000 7f73c77fe700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f73cc06af00 0x7f73cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.415+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f73d4088c50 con 0x7f73e006bdf0 2023-10-16T20:07:15.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.415+0000 7f73de7fc700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f73cc06af00 0x7f73cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.416+0000 7f73de7fc700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f73cc06af00 0x7f73cc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f73e015de10 tx=0x7f73d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.420+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73d408e020 con 0x7f73e006bdf0 2023-10-16T20:07:15.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.612+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73e004ebb0 con 0x7f73e006bdf0 2023-10-16T20:07:15.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.612+0000 7f73c77fe700 1 -- 172.21.15.152:0/2731676373 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73d4053940 con 0x7f73e006bdf0 2023-10-16T20:07:15.615 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:15.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f73cc06af00 msgr2=0x7f73cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f73cc06af00 0x7f73cc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f73e015de10 tx=0x7f73d0008040 comp rx=0 tx=0).stop 2023-10-16T20:07:15.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 msgr2=0x7f73e01541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 0x7f73e01541c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c490 tx=0x7f73d400c850 comp rx=0 tx=0).stop 2023-10-16T20:07:15.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 shutdown_connections 2023-10-16T20:07:15.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f73cc06af00 0x7f73cc06d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f73e015fd30 0x7f73e006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73e006bdf0 0x7f73e01541c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 --2- 172.21.15.152:0/2731676373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73e015b4d0 0x7f73e00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 >> 172.21.15.152:0/2731676373 conn(0x7f73e00b14b0 msgr2=0x7f73e0071300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:15.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 shutdown_connections 2023-10-16T20:07:15.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.614+0000 7f73e569a700 1 -- 172.21.15.152:0/2731676373 wait complete. 2023-10-16T20:07:15.629 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:15.753 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.750+0000 7fbe4e940700 1 Processor -- start 2023-10-16T20:07:15.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.750+0000 7fbe4e940700 1 -- start start 2023-10-16T20:07:15.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.751+0000 7fbe4e940700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe4e940700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe480cba90 con 0x7fbe4815dec0 2023-10-16T20:07:15.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe4e940700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4815ee40 con 0x7fbe4806dcc0 2023-10-16T20:07:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe4e940700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480cb510 con 0x7fbe4815a250 2023-10-16T20:07:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe477fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbe4815dec0 0x7fbe4806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39904/0 (socket says 172.21.15.152:39904) 2023-10-16T20:07:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe477fe700 1 -- 172.21.15.152:0/48026900 learned_addr learned my addr 172.21.15.152:0/48026900 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe47fff700 1 --2- 172.21.15.152:0/48026900 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541565975 0 0) 0x7fbe480cba90 con 0x7fbe4815dec0 2023-10-16T20:07:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe340035b0 con 0x7fbe4815dec0 2023-10-16T20:07:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470260074 0 0) 0x7fbe4815ee40 con 0x7fbe4806dcc0 2023-10-16T20:07:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe480cba90 con 0x7fbe4806dcc0 2023-10-16T20:07:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101950292 0 0) 0x7fbe340035b0 con 0x7fbe4815dec0 2023-10-16T20:07:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe47fff700 1 -- 172.21.15.152:0/48026900 >> v1:172.21.15.163:6789/0 conn(0x7fbe4806dcc0 legacy=0x7fbe480cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe47fff700 1 -- 172.21.15.152:0/48026900 >> v1:172.21.15.152:6789/0 conn(0x7fbe4815dec0 legacy=0x7fbe4806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe47fff700 1 -- 172.21.15.152:0/48026900 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4815e880 con 0x7fbe4815a250 2023-10-16T20:07:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.752+0000 7fbe47fff700 1 --2- 172.21.15.152:0/48026900 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480717b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009870 tx=0x7fbe30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7e8ca3728ca248 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38001670 con 0x7fbe4815a250 2023-10-16T20:07:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30004030 con 0x7fbe4815a250 2023-10-16T20:07:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe46ffd700 1 -- 172.21.15.152:0/48026900 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe300043c0 con 0x7fbe4815a250 2023-10-16T20:07:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 -- 172.21.15.152:0/48026900 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 msgr2=0x7fbe480717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 --2- 172.21.15.152:0/48026900 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480717b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009870 tx=0x7fbe30009b80 comp rx=0 tx=0).stop 2023-10-16T20:07:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 -- 172.21.15.152:0/48026900 shutdown_connections 2023-10-16T20:07:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 --2- 172.21.15.152:0/48026900 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480717b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 -- 172.21.15.152:0/48026900 >> 172.21.15.152:0/48026900 conn(0x7fbe480ccbe0 msgr2=0x7fbe480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:15.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 -- 172.21.15.152:0/48026900 shutdown_connections 2023-10-16T20:07:15.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.753+0000 7fbe4e940700 1 -- 172.21.15.152:0/48026900 wait complete. 2023-10-16T20:07:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.755+0000 7fbe4e940700 1 Processor -- start 2023-10-16T20:07:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.755+0000 7fbe4e940700 1 -- start start 2023-10-16T20:07:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4e940700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 0x7fbe4814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4e940700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4e940700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe4815dec0 0x7fbe48157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4e940700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c9150 con 0x7fbe4806dcc0 2023-10-16T20:07:15.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4e940700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c9430 con 0x7fbe4815dec0 2023-10-16T20:07:15.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4e940700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480c9710 con 0x7fbe4815a250 2023-10-16T20:07:15.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 0x7fbe4814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 0x7fbe4814d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59710/0 (socket says 172.21.15.152:59710) 2023-10-16T20:07:15.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 -- 172.21.15.152:0/1651277568 learned_addr learned my addr 172.21.15.152:0/1651277568 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:15.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe477fe700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe4cedd700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe4815dec0 0x7fbe48157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 -- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 msgr2=0x7fbe480c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 -- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe4815dec0 msgr2=0x7fbe48157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe4815dec0 0x7fbe48157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 -- 172.21.15.152:0/1651277568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300094a0 con 0x7fbe4806dcc0 2023-10-16T20:07:15.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.756+0000 7fbe47fff700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 0x7fbe4814d7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe30000c00 tx=0x7fbe30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.757+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30011830 con 0x7fbe4806dcc0 2023-10-16T20:07:15.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.757+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3001f070 con 0x7fbe4806dcc0 2023-10-16T20:07:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.757+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480c99f0 con 0x7fbe4806dcc0 2023-10-16T20:07:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.757+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30011bd0 con 0x7fbe4806dcc0 2023-10-16T20:07:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.757+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480c8c40 con 0x7fbe4806dcc0 2023-10-16T20:07:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.758+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4804ebb0 con 0x7fbe4806dcc0 2023-10-16T20:07:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.758+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe30011d30 con 0x7fbe4806dcc0 2023-10-16T20:07:15.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.758+0000 7fbe44ff9700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbe2806af00 0x7fbe2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:15.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.759+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe30021070 con 0x7fbe4806dcc0 2023-10-16T20:07:15.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.759+0000 7fbe477fe700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbe2806af00 0x7fbe2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:15.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.759+0000 7fbe477fe700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbe2806af00 0x7fbe2806d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbe480d0040 tx=0x7fbe38001590 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:15.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.763+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbe30056190 con 0x7fbe4806dcc0 2023-10-16T20:07:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.955+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbe480cb6f0 con 0x7fbe4806dcc0 2023-10-16T20:07:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.955+0000 7fbe44ff9700 1 -- 172.21.15.152:0/1651277568 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbe300597b0 con 0x7fbe4806dcc0 2023-10-16T20:07:15.958 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:15.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbe2806af00 msgr2=0x7fbe2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbe2806af00 0x7fbe2806d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbe480d0040 tx=0x7fbe38001590 comp rx=0 tx=0).stop 2023-10-16T20:07:15.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 msgr2=0x7fbe4814d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:15.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 0x7fbe4814d7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe30000c00 tx=0x7fbe30004750 comp rx=0 tx=0).stop 2023-10-16T20:07:15.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 shutdown_connections 2023-10-16T20:07:15.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbe2806af00 0x7fbe2806d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe4815dec0 0x7fbe48157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe4806dcc0 0x7fbe4814d7d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 --2- 172.21.15.152:0/1651277568 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbe4815a250 0x7fbe480c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 >> 172.21.15.152:0/1651277568 conn(0x7fbe480ccbe0 msgr2=0x7fbe4806f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 shutdown_connections 2023-10-16T20:07:15.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:15.957+0000 7fbe4e940700 1 -- 172.21.15.152:0/1651277568 wait complete. 2023-10-16T20:07:15.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:16.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.090+0000 7f9cc1131700 1 Processor -- start 2023-10-16T20:07:16.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.090+0000 7f9cc1131700 1 -- start start 2023-10-16T20:07:16.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cc1131700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9cbc0ae1c0 0x7f9cbc0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cc1131700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9cbc06dc70 0x7f9cbc0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cc1131700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc161350 con 0x7f9cbc06e290 2023-10-16T20:07:16.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cc1131700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc1615f0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cc1131700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc1618d0 con 0x7f9cbc0ae1c0 2023-10-16T20:07:16.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cbb59e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9cbc06dc70 0x7f9cbc0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cbb59e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9cbc06dc70 0x7f9cbc0cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59722/0 (socket says 172.21.15.152:59722) 2023-10-16T20:07:16.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cba59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9cbc06e290 0x7f9cbc06a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39918/0 (socket says 172.21.15.152:39918) 2023-10-16T20:07:16.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cbb59e700 1 -- 172.21.15.152:0/512648243 learned_addr learned my addr 172.21.15.152:0/512648243 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:16.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cbad9d700 1 --2- 172.21.15.152:0/512648243 >> v2:172.21.15.163:3300/0 conn(0x7f9cbc0ae1c0 0x7f9cbc0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cbb59e700 1 -- 172.21.15.152:0/512648243 >> v2:172.21.15.163:3300/0 conn(0x7f9cbc0ae1c0 msgr2=0x7f9cbc0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:16.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.091+0000 7f9cbb59e700 1 --2- 172.21.15.152:0/512648243 >> v2:172.21.15.163:3300/0 conn(0x7f9cbc0ae1c0 0x7f9cbc0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cbb59e700 1 -- 172.21.15.152:0/512648243 >> v1:172.21.15.152:6789/0 conn(0x7f9cbc06e290 legacy=0x7f9cbc06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cb9d9b700 1 -- 172.21.15.152:0/512648243 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709749590 0 0) 0x7f9cbc161350 con 0x7f9cbc06e290 2023-10-16T20:07:16.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cbb59e700 1 -- 172.21.15.152:0/512648243 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc161bb0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cbad9d700 1 --2- 172.21.15.152:0/512648243 >> v2:172.21.15.163:3300/0 conn(0x7f9cbc0ae1c0 0x7f9cbc0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:16.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cbb59e700 1 --2- 172.21.15.152:0/512648243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0cd9f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc066e00 tx=0x7f9cb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c2b964b728b2af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cb9d9b700 1 -- 172.21.15.152:0/512648243 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400e070 con 0x7f9cbc06dc70 2023-10-16T20:07:16.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cb9d9b700 1 -- 172.21.15.152:0/512648243 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb400b9c0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cb9d9b700 1 -- 172.21.15.152:0/512648243 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400bd70 con 0x7f9cbc06dc70 2023-10-16T20:07:16.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 -- 172.21.15.152:0/512648243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 msgr2=0x7f9cbc0cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 --2- 172.21.15.152:0/512648243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0cd9f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc066e00 tx=0x7f9cb400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:16.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 -- 172.21.15.152:0/512648243 shutdown_connections 2023-10-16T20:07:16.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 --2- 172.21.15.152:0/512648243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0cd9f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 --2- 172.21.15.152:0/512648243 >> v2:172.21.15.163:3300/0 conn(0x7f9cbc0ae1c0 0x7f9cbc0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 -- 172.21.15.152:0/512648243 >> 172.21.15.152:0/512648243 conn(0x7f9cbc0cfcd0 msgr2=0x7f9cbc0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:16.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 -- 172.21.15.152:0/512648243 shutdown_connections 2023-10-16T20:07:16.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.092+0000 7f9cc1131700 1 -- 172.21.15.152:0/512648243 wait complete. 2023-10-16T20:07:16.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.094+0000 7f9cc1131700 1 Processor -- start 2023-10-16T20:07:16.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.094+0000 7f9cc1131700 1 -- start start 2023-10-16T20:07:16.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9cbc06e290 0x7f9cbc1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9cbc0ae1c0 0x7f9cbc1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc154c20 con 0x7f9cbc06dc70 2023-10-16T20:07:16.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc154010 con 0x7f9cbc0ae1c0 2023-10-16T20:07:16.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1542f0 con 0x7f9cbc06e290 2023-10-16T20:07:16.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59724/0 (socket says 172.21.15.152:59724) 2023-10-16T20:07:16.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 -- 172.21.15.152:0/842688228 learned_addr learned my addr 172.21.15.152:0/842688228 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:16.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbb59e700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9cbc0ae1c0 0x7f9cbc1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cba59c700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9cbc06e290 0x7f9cbc1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 -- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9cbc06e290 msgr2=0x7f9cbc1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9cbc06e290 0x7f9cbc1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 -- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9cbc0ae1c0 msgr2=0x7f9cbc1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9cbc0ae1c0 0x7f9cbc1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 -- 172.21.15.152:0/842688228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009b30 con 0x7f9cbc06dc70 2023-10-16T20:07:16.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbb59e700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9cbc0ae1c0 0x7f9cbc1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:16.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cbad9d700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0c5460 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c750 tx=0x7f9cb000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011800 con 0x7f9cbc06dc70 2023-10-16T20:07:16.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0011960 con 0x7f9cbc06dc70 2023-10-16T20:07:16.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc1545d0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0011cd0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.095+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc0c59a0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.096+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc154f00 con 0x7f9cbc06dc70 2023-10-16T20:07:16.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.097+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9cb0021350 con 0x7f9cbc06dc70 2023-10-16T20:07:16.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.097+0000 7f9ca37fe700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9ca806af00 0x7f9ca806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.097+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9cb0089930 con 0x7f9cbc06dc70 2023-10-16T20:07:16.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.097+0000 7f9cba59c700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9ca806af00 0x7f9ca806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.098+0000 7f9cba59c700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9ca806af00 0x7f9ca806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc156650 tx=0x7f9cac007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.101+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cb0054620 con 0x7f9cbc06dc70 2023-10-16T20:07:16.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.290+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cbc04ebb0 con 0x7f9cbc06dc70 2023-10-16T20:07:16.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.291+0000 7f9ca37fe700 1 -- 172.21.15.152:0/842688228 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f9cb005e070 con 0x7f9cbc06dc70 2023-10-16T20:07:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:16.295 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:16.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.293+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9ca806af00 msgr2=0x7f9ca806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.293+0000 7f9cc1131700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9ca806af00 0x7f9ca806d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc156650 tx=0x7f9cac007be0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.293+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 msgr2=0x7f9cbc0c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.293+0000 7f9cc1131700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0c5460 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c750 tx=0x7f9cb000cb10 comp rx=0 tx=0).stop 2023-10-16T20:07:16.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 shutdown_connections 2023-10-16T20:07:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9ca806af00 0x7f9ca806d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9cbc0ae1c0 0x7f9cbc1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9cbc06dc70 0x7f9cbc0c5460 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 --2- 172.21.15.152:0/842688228 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9cbc06e290 0x7f9cbc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 >> 172.21.15.152:0/842688228 conn(0x7f9cbc0cfcd0 msgr2=0x7f9cbc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:16.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 shutdown_connections 2023-10-16T20:07:16.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.294+0000 7f9cc1131700 1 -- 172.21.15.152:0/842688228 wait complete. 2023-10-16T20:07:16.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:16.310 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.430+0000 7f80981ea700 1 Processor -- start 2023-10-16T20:07:16.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.430+0000 7f80981ea700 1 -- start start 2023-10-16T20:07:16.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f80981ea700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f809006d6e0 0x7f809006db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f80981ea700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809006e080 con 0x7f809006f3a0 2023-10-16T20:07:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f80981ea700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80900cb7e0 con 0x7f809015a290 2023-10-16T20:07:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f80981ea700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80900cbac0 con 0x7f809006d6e0 2023-10-16T20:07:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8095785700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f809006d6e0 0x7f809006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8095785700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f809006d6e0 0x7f809006db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59734/0 (socket says 172.21.15.152:59734) 2023-10-16T20:07:16.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8095785700 1 -- 172.21.15.152:0/626633158 learned_addr learned my addr 172.21.15.152:0/626633158 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8096787700 1 --1- 172.21.15.152:0/626633158 >> v1:172.21.15.152:6789/0 conn(0x7f809006f3a0 0x7f809006f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39934/0 (socket says 172.21.15.152:39934) 2023-10-16T20:07:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8095785700 1 -- 172.21.15.152:0/626633158 >> v1:172.21.15.163:6789/0 conn(0x7f809015a290 legacy=0x7f80900cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8095785700 1 -- 172.21.15.152:0/626633158 >> v1:172.21.15.152:6789/0 conn(0x7f809006f3a0 legacy=0x7f809006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.431+0000 7f8094f84700 1 -- 172.21.15.152:0/626633158 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971910294 0 0) 0x7f809006e080 con 0x7f809006f3a0 2023-10-16T20:07:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f8095785700 1 -- 172.21.15.152:0/626633158 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900cbda0 con 0x7f809006d6e0 2023-10-16T20:07:16.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f8095785700 1 --2- 172.21.15.152:0/626633158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809006d6e0 0x7f809006db40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f808c0098f0 tx=0x7f808c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336f5d78db09bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f8094f84700 1 -- 172.21.15.152:0/626633158 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00b8a0 con 0x7f809006d6e0 2023-10-16T20:07:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f8094f84700 1 -- 172.21.15.152:0/626633158 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00ba00 con 0x7f809006d6e0 2023-10-16T20:07:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f8094f84700 1 -- 172.21.15.152:0/626633158 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00bd90 con 0x7f809006d6e0 2023-10-16T20:07:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 -- 172.21.15.152:0/626633158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809006d6e0 msgr2=0x7f809006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 --2- 172.21.15.152:0/626633158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809006d6e0 0x7f809006db40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f808c0098f0 tx=0x7f808c009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 -- 172.21.15.152:0/626633158 shutdown_connections 2023-10-16T20:07:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 --2- 172.21.15.152:0/626633158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809006d6e0 0x7f809006db40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 -- 172.21.15.152:0/626633158 >> 172.21.15.152:0/626633158 conn(0x7f80900d0250 msgr2=0x7f80900d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 -- 172.21.15.152:0/626633158 shutdown_connections 2023-10-16T20:07:16.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.432+0000 7f80981ea700 1 -- 172.21.15.152:0/626633158 wait complete. 2023-10-16T20:07:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 Processor -- start 2023-10-16T20:07:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 -- start start 2023-10-16T20:07:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f809006d6e0 0x7f809014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809006f3a0 0x7f80900afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 0x7f809015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80901f4da0 con 0x7f809015a290 2023-10-16T20:07:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80901f4490 con 0x7f809006f3a0 2023-10-16T20:07:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.434+0000 7f80981ea700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80900b0730 con 0x7f809006d6e0 2023-10-16T20:07:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 0x7f809015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 0x7f809015cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59742/0 (socket says 172.21.15.152:59742) 2023-10-16T20:07:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 -- 172.21.15.152:0/3110057253 learned_addr learned my addr 172.21.15.152:0/3110057253 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8095f86700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f809006d6e0 0x7f809014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8095785700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809006f3a0 0x7f80900afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 -- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f809006d6e0 msgr2=0x7f809014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f809006d6e0 0x7f809014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 -- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809006f3a0 msgr2=0x7f80900afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809006f3a0 0x7f80900afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 -- 172.21.15.152:0/3110057253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009550 con 0x7f809015a290 2023-10-16T20:07:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8095f86700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f809006d6e0 0x7f809014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8095785700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809006f3a0 0x7f80900afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f8096787700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 0x7f809015cbe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8088002230 tx=0x7f808800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800ac20 con 0x7f809015a290 2023-10-16T20:07:16.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808800ada0 con 0x7f809015a290 2023-10-16T20:07:16.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80901f46e0 con 0x7f809015a290 2023-10-16T20:07:16.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088007310 con 0x7f809015a290 2023-10-16T20:07:16.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.435+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8090155fd0 con 0x7f809015a290 2023-10-16T20:07:16.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.436+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80901f4ee0 con 0x7f809015a290 2023-10-16T20:07:16.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.437+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8088007470 con 0x7f809015a290 2023-10-16T20:07:16.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.437+0000 7f80867fc700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f807406af00 0x7f807406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.437+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80880897f0 con 0x7f809015a290 2023-10-16T20:07:16.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.437+0000 7f8095f86700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f807406af00 0x7f807406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.437+0000 7f8095f86700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f807406af00 0x7f807406d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8080000f60 tx=0x7f8080009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.441+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80901f4ee0 con 0x7f809015a290 2023-10-16T20:07:16.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.630+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80901f4ee0 con 0x7f809015a290 2023-10-16T20:07:16.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.631+0000 7f80867fc700 1 -- 172.21.15.152:0/3110057253 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80901f4ee0 con 0x7f809015a290 2023-10-16T20:07:16.634 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:16.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.632+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f807406af00 msgr2=0x7f807406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.632+0000 7f80981ea700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f807406af00 0x7f807406d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8080000f60 tx=0x7f8080009040 comp rx=0 tx=0).stop 2023-10-16T20:07:16.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.632+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 msgr2=0x7f809015cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.632+0000 7f80981ea700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 0x7f809015cbe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8088002230 tx=0x7f808800a060 comp rx=0 tx=0).stop 2023-10-16T20:07:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 shutdown_connections 2023-10-16T20:07:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f807406af00 0x7f807406d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f809006d6e0 0x7f809014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f809015a290 0x7f809015cbe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 --2- 172.21.15.152:0/3110057253 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809006f3a0 0x7f80900afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 >> 172.21.15.152:0/3110057253 conn(0x7f80900d0250 msgr2=0x7f80900ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:16.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 shutdown_connections 2023-10-16T20:07:16.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.633+0000 7f80981ea700 1 -- 172.21.15.152:0/3110057253 wait complete. 2023-10-16T20:07:16.647 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:16.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.767+0000 7f1280f85700 1 Processor -- start 2023-10-16T20:07:16.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.767+0000 7f1280f85700 1 -- start start 2023-10-16T20:07:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.768+0000 7f1280f85700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06af30 0x7f127c1613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.768+0000 7f1280f85700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c15eb20 con 0x7f127c06fd90 2023-10-16T20:07:16.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.768+0000 7f1280f85700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c070170 con 0x7f127c06eed0 2023-10-16T20:07:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.768+0000 7f1280f85700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c06f380 con 0x7f127c06af30 2023-10-16T20:07:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127a59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f127c06fd90 0x7f127c071840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39944/0 (socket says 172.21.15.152:39944) 2023-10-16T20:07:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127a59c700 1 -- 172.21.15.152:0/431874881 learned_addr learned my addr 172.21.15.152:0/431874881 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127ad9d700 1 --2- 172.21.15.152:0/431874881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06af30 0x7f127c1613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564460644 0 0) 0x7f127c15eb20 con 0x7f127c06fd90 2023-10-16T20:07:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12640035b0 con 0x7f127c06fd90 2023-10-16T20:07:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577422796 0 0) 0x7f127c070170 con 0x7f127c06eed0 2023-10-16T20:07:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f127c15eb20 con 0x7f127c06eed0 2023-10-16T20:07:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127ad9d700 1 -- 172.21.15.152:0/431874881 >> v1:172.21.15.163:6789/0 conn(0x7f127c06eed0 legacy=0x7f127c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3374583174 0 0) 0x7f12640035b0 con 0x7f127c06fd90 2023-10-16T20:07:16.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127ad9d700 1 -- 172.21.15.152:0/431874881 >> v1:172.21.15.152:6789/0 conn(0x7f127c06fd90 legacy=0x7f127c071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127ad9d700 1 -- 172.21.15.152:0/431874881 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c15df10 con 0x7f127c06af30 2023-10-16T20:07:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127ad9d700 1 --2- 172.21.15.152:0/431874881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06af30 0x7f127c1613e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1274009dc0 tx=0x7f127400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c297bcf9e59fb23 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400e070 con 0x7f127c06af30 2023-10-16T20:07:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.769+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274003a20 con 0x7f127c06af30 2023-10-16T20:07:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f127959a700 1 -- 172.21.15.152:0/431874881 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270001670 con 0x7f127c06af30 2023-10-16T20:07:16.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 -- 172.21.15.152:0/431874881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06af30 msgr2=0x7f127c1613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 --2- 172.21.15.152:0/431874881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06af30 0x7f127c1613e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1274009dc0 tx=0x7f127400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 -- 172.21.15.152:0/431874881 shutdown_connections 2023-10-16T20:07:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 --2- 172.21.15.152:0/431874881 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06af30 0x7f127c1613e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 -- 172.21.15.152:0/431874881 >> 172.21.15.152:0/431874881 conn(0x7f127c0d0250 msgr2=0x7f127c0d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:16.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 -- 172.21.15.152:0/431874881 shutdown_connections 2023-10-16T20:07:16.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.770+0000 7f1280f85700 1 -- 172.21.15.152:0/431874881 wait complete. 2023-10-16T20:07:16.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.771+0000 7f1280f85700 1 Processor -- start 2023-10-16T20:07:16.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 -- start start 2023-10-16T20:07:16.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f127c06af30 0x7f127c0af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 0x7f127c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06fd90 0x7f127c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c151ce0 con 0x7f127c06eed0 2023-10-16T20:07:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c158210 con 0x7f127c06af30 2023-10-16T20:07:16.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1280f85700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1584b0 con 0x7f127c06fd90 2023-10-16T20:07:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1279d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 0x7f127c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1279d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 0x7f127c151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59754/0 (socket says 172.21.15.152:59754) 2023-10-16T20:07:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f1279d9b700 1 -- 172.21.15.152:0/1998033728 learned_addr learned my addr 172.21.15.152:0/1998033728 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.772+0000 7f127a59c700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f127c06af30 0x7f127c0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f127ad9d700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06fd90 0x7f127c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1279d9b700 1 -- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06fd90 msgr2=0x7f127c1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1279d9b700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06fd90 0x7f127c1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1279d9b700 1 -- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f127c06af30 msgr2=0x7f127c0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1279d9b700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f127c06af30 0x7f127c0af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1279d9b700 1 -- 172.21.15.152:0/1998033728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009a70 con 0x7f127c06eed0 2023-10-16T20:07:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f127a59c700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f127c06af30 0x7f127c0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1279d9b700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 0x7f127c151260 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c520 tx=0x7f126c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0052d0 con 0x7f127c06eed0 2023-10-16T20:07:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c005430 con 0x7f127c06eed0 2023-10-16T20:07:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c158790 con 0x7f127c06eed0 2023-10-16T20:07:16.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0038a0 con 0x7f127c06eed0 2023-10-16T20:07:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.773+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c158d50 con 0x7f127c06eed0 2023-10-16T20:07:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.774+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c04ebb0 con 0x7f127c06eed0 2023-10-16T20:07:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.774+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f126c003a00 con 0x7f127c06eed0 2023-10-16T20:07:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.775+0000 7f126affd700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f125c06af00 0x7f125c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:16.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.775+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f126c088dc0 con 0x7f127c06eed0 2023-10-16T20:07:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.775+0000 7f127a59c700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f125c06af00 0x7f125c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.775+0000 7f127a59c700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f125c06af00 0x7f125c06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1270001eb0 tx=0x7f1270001cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:16.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.779+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f126c053ae0 con 0x7f127c06eed0 2023-10-16T20:07:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.976+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f127c15e780 con 0x7f127c06eed0 2023-10-16T20:07:16.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.976+0000 7f126affd700 1 -- 172.21.15.152:0/1998033728 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f126c003cb0 con 0x7f127c06eed0 2023-10-16T20:07:16.980 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f125c06af00 msgr2=0x7f125c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f125c06af00 0x7f125c06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1270001eb0 tx=0x7f1270001cc0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 msgr2=0x7f127c151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 0x7f127c151260 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c520 tx=0x7f126c00c830 comp rx=0 tx=0).stop 2023-10-16T20:07:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 shutdown_connections 2023-10-16T20:07:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f125c06af00 0x7f125c06d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f127c06fd90 0x7f127c1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f127c06af30 0x7f127c0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 --2- 172.21.15.152:0/1998033728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f127c06eed0 0x7f127c151260 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 >> 172.21.15.152:0/1998033728 conn(0x7f127c0d0250 msgr2=0x7f127c072500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 shutdown_connections 2023-10-16T20:07:16.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:16.978+0000 7f1280f85700 1 -- 172.21.15.152:0/1998033728 wait complete. 2023-10-16T20:07:16.993 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:17.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.113+0000 7f68ddf98700 1 Processor -- start 2023-10-16T20:07:17.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.113+0000 7f68ddf98700 1 -- start start 2023-10-16T20:07:17.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.114+0000 7f68ddf98700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f68d815a250 0x7f68d80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.114+0000 7f68ddf98700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80cba90 con 0x7f68d815dec0 2023-10-16T20:07:17.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.114+0000 7f68ddf98700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d815ee40 con 0x7f68d806dcc0 2023-10-16T20:07:17.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.114+0000 7f68ddf98700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80cb510 con 0x7f68d815a250 2023-10-16T20:07:17.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.114+0000 7f68d6ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f68d815dec0 0x7f68d806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39960/0 (socket says 172.21.15.152:39960) 2023-10-16T20:07:17.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.114+0000 7f68d6ffd700 1 -- 172.21.15.152:0/440383962 learned_addr learned my addr 172.21.15.152:0/440383962 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:17.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426848782 0 0) 0x7f68d80cba90 con 0x7f68d815dec0 2023-10-16T20:07:17.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d77fe700 1 --2- 172.21.15.152:0/440383962 >> v2:172.21.15.163:3300/0 conn(0x7f68d815a250 0x7f68d80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c40035b0 con 0x7f68d815dec0 2023-10-16T20:07:17.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135787375 0 0) 0x7f68c40035b0 con 0x7f68d815dec0 2023-10-16T20:07:17.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 >> v2:172.21.15.163:3300/0 conn(0x7f68d815a250 msgr2=0x7f68d80717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:17.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 --2- 172.21.15.152:0/440383962 >> v2:172.21.15.163:3300/0 conn(0x7f68d815a250 0x7f68d80717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 >> v1:172.21.15.163:6789/0 conn(0x7f68d806dcc0 legacy=0x7f68d80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d815e880 con 0x7f68d815dec0 2023-10-16T20:07:17.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f68c0001670 con 0x7f68d815dec0 2023-10-16T20:07:17.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 >> v1:172.21.15.152:6789/0 conn(0x7f68d815dec0 legacy=0x7f68d806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4003a00 0x7f68c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68c4004850 0x7f68c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c4005210 0x7f68c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80cb510 con 0x7f68c4005210 2023-10-16T20:07:17.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c400c0b0 con 0x7f68c4004850 2023-10-16T20:07:17.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c400c270 con 0x7f68c4003a00 2023-10-16T20:07:17.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d7fff700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c4005210 0x7f68c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d6ffd700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68c4004850 0x7f68c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d77fe700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4003a00 0x7f68c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d7fff700 1 -- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4003a00 msgr2=0x7f68c4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:17.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d7fff700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4003a00 0x7f68c4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d7fff700 1 -- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68c4004850 msgr2=0x7f68c4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d7fff700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68c4004850 0x7f68c4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.115+0000 7f68d7fff700 1 -- 172.21.15.152:0/440383962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40035b0 con 0x7f68c4005210 2023-10-16T20:07:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68d7fff700 1 -- 172.21.15.152:0/440383962 reap_dead start 2023-10-16T20:07:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68d7fff700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c4005210 0x7f68c400ba10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f68d8071760 tx=0x7f68c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98798ac84563974 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0001db0 con 0x7f68c4005210 2023-10-16T20:07:17.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000cc90 con 0x7f68c4005210 2023-10-16T20:07:17.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68d67fc700 1 -- 172.21.15.152:0/440383962 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0003a00 con 0x7f68c4005210 2023-10-16T20:07:17.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 -- 172.21.15.152:0/440383962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c4005210 msgr2=0x7f68c400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c4005210 0x7f68c400ba10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f68d8071760 tx=0x7f68c4005880 comp rx=0 tx=0).stop 2023-10-16T20:07:17.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 -- 172.21.15.152:0/440383962 shutdown_connections 2023-10-16T20:07:17.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 --2- 172.21.15.152:0/440383962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68c4005210 0x7f68c400ba10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 -- 172.21.15.152:0/440383962 >> 172.21.15.152:0/440383962 conn(0x7f68d80ccbe0 msgr2=0x7f68d80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:17.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 -- 172.21.15.152:0/440383962 shutdown_connections 2023-10-16T20:07:17.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.116+0000 7f68ddf98700 1 -- 172.21.15.152:0/440383962 wait complete. 2023-10-16T20:07:17.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 Processor -- start 2023-10-16T20:07:17.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 -- start start 2023-10-16T20:07:17.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4005210 0x7f68d81f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68d80b59a0 0x7f68d80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 0x7f68d81f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d81f42c0 con 0x7f68d80cc180 2023-10-16T20:07:17.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80cc610 con 0x7f68d80b59a0 2023-10-16T20:07:17.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.118+0000 7f68ddf98700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d81f7110 con 0x7f68c4005210 2023-10-16T20:07:17.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 0x7f68d81f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 0x7f68d81f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59776/0 (socket says 172.21.15.152:59776) 2023-10-16T20:07:17.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 -- 172.21.15.152:0/348870407 learned_addr learned my addr 172.21.15.152:0/348870407 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d6ffd700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68d80b59a0 0x7f68d80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d77fe700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4005210 0x7f68d81f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 -- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4005210 msgr2=0x7f68d81f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4005210 0x7f68d81f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 -- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68d80b59a0 msgr2=0x7f68d80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68d80b59a0 0x7f68d80cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 -- 172.21.15.152:0/348870407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d81f6b50 con 0x7f68d80cc180 2023-10-16T20:07:17.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d77fe700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4005210 0x7f68d81f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:17.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d6ffd700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68d80b59a0 0x7f68d80cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:17.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68d7fff700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 0x7f68d81f46e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005040 tx=0x7f68d00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0003e90 con 0x7f68d80cc180 2023-10-16T20:07:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00050d0 con 0x7f68d80cc180 2023-10-16T20:07:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d81f6e30 con 0x7f68d80cc180 2023-10-16T20:07:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0005460 con 0x7f68d80cc180 2023-10-16T20:07:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.119+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d81f67b0 con 0x7f68d80cc180 2023-10-16T20:07:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.120+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d81f4400 con 0x7f68d80cc180 2023-10-16T20:07:17.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.121+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f68d00055c0 con 0x7f68d80cc180 2023-10-16T20:07:17.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.121+0000 7f68cffff700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f68b806af00 0x7f68b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.121+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f68d008ac70 con 0x7f68d80cc180 2023-10-16T20:07:17.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.121+0000 7f68d77fe700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f68b806af00 0x7f68b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.121+0000 7f68d77fe700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f68b806af00 0x7f68b806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007b50 tx=0x7f68c800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.126+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68d81f4400 con 0x7f68d80cc180 2023-10-16T20:07:17.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.318+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68d81f4400 con 0x7f68d80cc180 2023-10-16T20:07:17.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.319+0000 7f68cffff700 1 -- 172.21.15.152:0/348870407 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68d81f4400 con 0x7f68d80cc180 2023-10-16T20:07:17.322 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:17.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f68b806af00 msgr2=0x7f68b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f68b806af00 0x7f68b806d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007b50 tx=0x7f68c800d040 comp rx=0 tx=0).stop 2023-10-16T20:07:17.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 msgr2=0x7f68d81f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 0x7f68d81f46e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005040 tx=0x7f68d00014a0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 shutdown_connections 2023-10-16T20:07:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f68b806af00 0x7f68b806d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f68c4005210 0x7f68d81f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68d80cc180 0x7f68d81f46e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 --2- 172.21.15.152:0/348870407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f68d80b59a0 0x7f68d80cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 >> 172.21.15.152:0/348870407 conn(0x7f68d80ccbe0 msgr2=0x7f68d81581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:17.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 shutdown_connections 2023-10-16T20:07:17.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.321+0000 7f68ddf98700 1 -- 172.21.15.152:0/348870407 wait complete. 2023-10-16T20:07:17.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:17.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.456+0000 7fcdc19a3700 1 Processor -- start 2023-10-16T20:07:17.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.456+0000 7fcdc19a3700 1 -- start start 2023-10-16T20:07:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdc19a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdc19a3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcdbc06a820 0x7fcdbc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdc19a3700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcdbc0cdd30 0x7fcdbc0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdc19a3700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdbc0ce6d0 con 0x7fcdbc0cdd30 2023-10-16T20:07:17.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdc19a3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdbc161360 con 0x7fcdbc06a820 2023-10-16T20:07:17.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdc19a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc06b750 con 0x7fcdbc06b370 2023-10-16T20:07:17.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdbb7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcdbc0cdd30 0x7fcdbc0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.457+0000 7fcdbb7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcdbc0cdd30 0x7fcdbc0ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59784/0 (socket says 172.21.15.152:59784) 2023-10-16T20:07:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 -- 172.21.15.152:0/2488379098 learned_addr learned my addr 172.21.15.152:0/2488379098 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdba7fc700 1 --2- 172.21.15.152:0/2488379098 >> v2:172.21.15.163:3300/0 conn(0x7fcdbc06a820 0x7fcdbc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbaffd700 1 --2- 172.21.15.152:0/2488379098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 -- 172.21.15.152:0/2488379098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 msgr2=0x7fcdbc15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:17.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 --2- 172.21.15.152:0/2488379098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 -- 172.21.15.152:0/2488379098 >> v2:172.21.15.163:3300/0 conn(0x7fcdbc06a820 msgr2=0x7fcdbc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 --2- 172.21.15.152:0/2488379098 >> v2:172.21.15.163:3300/0 conn(0x7fcdbc06a820 0x7fcdbc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 -- 172.21.15.152:0/2488379098 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc15e300 con 0x7fcdbc0cdd30 2023-10-16T20:07:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdbb7fe700 1 --2- 172.21.15.152:0/2488379098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0ce190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc06d480 tx=0x7fcdb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33055d38fe41d51c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdb9ffb700 1 -- 172.21.15.152:0/2488379098 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400e070 con 0x7fcdbc0cdd30 2023-10-16T20:07:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdb9ffb700 1 -- 172.21.15.152:0/2488379098 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400b9c0 con 0x7fcdbc0cdd30 2023-10-16T20:07:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.458+0000 7fcdb9ffb700 1 -- 172.21.15.152:0/2488379098 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400bd70 con 0x7fcdbc0cdd30 2023-10-16T20:07:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 -- 172.21.15.152:0/2488379098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc0cdd30 msgr2=0x7fcdbc0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/2488379098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0ce190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc06d480 tx=0x7fcdb400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:17.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 -- 172.21.15.152:0/2488379098 shutdown_connections 2023-10-16T20:07:17.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/2488379098 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/2488379098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0ce190 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/2488379098 >> v2:172.21.15.163:3300/0 conn(0x7fcdbc06a820 0x7fcdbc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 -- 172.21.15.152:0/2488379098 >> 172.21.15.152:0/2488379098 conn(0x7fcdbc0ccbe0 msgr2=0x7fcdbc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:17.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 -- 172.21.15.152:0/2488379098 shutdown_connections 2023-10-16T20:07:17.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.459+0000 7fcdc19a3700 1 -- 172.21.15.152:0/2488379098 wait complete. 2023-10-16T20:07:17.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.460+0000 7fcdc19a3700 1 Processor -- start 2023-10-16T20:07:17.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.460+0000 7fcdc19a3700 1 -- start start 2023-10-16T20:07:17.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdc19a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 0x7fcdbc1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdc19a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdc19a3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdc19a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0b2da0 con 0x7fcdbc06a820 2023-10-16T20:07:17.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdc19a3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0af3c0 con 0x7fcdbc0cdd30 2023-10-16T20:07:17.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdc19a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0af6a0 con 0x7fcdbc06b370 2023-10-16T20:07:17.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 0x7fcdbc1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 0x7fcdbc1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59788/0 (socket says 172.21.15.152:59788) 2023-10-16T20:07:17.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 -- 172.21.15.152:0/3910267496 learned_addr learned my addr 172.21.15.152:0/3910267496 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:17.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdba7fc700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbb7fe700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 -- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 msgr2=0x7fcdbc0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 -- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdbc0cdd30 msgr2=0x7fcdbc0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 -- 172.21.15.152:0/3910267496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4009b30 con 0x7fcdbc06a820 2023-10-16T20:07:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.461+0000 7fcdbaffd700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 0x7fcdbc1555d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d800 tx=0x7fcdb000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.462+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00125f0 con 0x7fcdbc06a820 2023-10-16T20:07:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.462+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0012750 con 0x7fcdbc06a820 2023-10-16T20:07:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.462+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0012b00 con 0x7fcdbc06a820 2023-10-16T20:07:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.462+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc0b2ff0 con 0x7fcdbc06a820 2023-10-16T20:07:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.462+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc0af000 con 0x7fcdbc06a820 2023-10-16T20:07:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.463+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc072d10 con 0x7fcdbc06a820 2023-10-16T20:07:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.463+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcdb0012c60 con 0x7fcdbc06a820 2023-10-16T20:07:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.463+0000 7fcda3fff700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcda806af00 0x7fcda806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.464+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcdb0089a10 con 0x7fcdbc06a820 2023-10-16T20:07:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.464+0000 7fcdba7fc700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcda806af00 0x7fcda806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.464+0000 7fcdba7fc700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcda806af00 0x7fcda806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc15f2c0 tx=0x7fcdac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.468+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcdb0054700 con 0x7fcdbc06a820 2023-10-16T20:07:17.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.657+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcdbc04ebb0 con 0x7fcdbc06a820 2023-10-16T20:07:17.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.657+0000 7fcda3fff700 1 -- 172.21.15.152:0/3910267496 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcdb0057d20 con 0x7fcdbc06a820 2023-10-16T20:07:17.661 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:17.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcda806af00 msgr2=0x7fcda806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcda806af00 0x7fcda806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc15f2c0 tx=0x7fcdac008040 comp rx=0 tx=0).stop 2023-10-16T20:07:17.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 msgr2=0x7fcdbc1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 0x7fcdbc1555d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d800 tx=0x7fcdb000db10 comp rx=0 tx=0).stop 2023-10-16T20:07:17.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 shutdown_connections 2023-10-16T20:07:17.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcda806af00 0x7fcda806d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdbc0cdd30 0x7fcdbc0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdbc06a820 0x7fcdbc1555d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 --2- 172.21.15.152:0/3910267496 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcdbc06b370 0x7fcdbc0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 >> 172.21.15.152:0/3910267496 conn(0x7fcdbc0ccbe0 msgr2=0x7fcdbc0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:17.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 shutdown_connections 2023-10-16T20:07:17.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.659+0000 7fcdc19a3700 1 -- 172.21.15.152:0/3910267496 wait complete. 2023-10-16T20:07:17.683 INFO:tasks.cephfs_test_runner:Starting test: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) That when a client unmounts, the thread count on the MDS goes back 2023-10-16T20:07:17.684 INFO:tasks.cephfs_test_runner:test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-16T20:07:17.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:17.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.804+0000 7f60ddafe700 1 Processor -- start 2023-10-16T20:07:17.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.804+0000 7f60ddafe700 1 -- start start 2023-10-16T20:07:17.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.804+0000 7f60ddafe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f60d815dbf0 0x7f60d80af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.804+0000 7f60ddafe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60d80af030 0x7f60d8161560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60ddafe700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80caee0 con 0x7f60d815d810 2023-10-16T20:07:17.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60ddafe700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80cf990 con 0x7f60d80af030 2023-10-16T20:07:17.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60ddafe700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80cfc30 con 0x7f60d815dbf0 2023-10-16T20:07:17.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d7fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60d80af030 0x7f60d8161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d77fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f60d815d810 0x7f60d80ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39992/0 (socket says 172.21.15.152:39992) 2023-10-16T20:07:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d77fe700 1 -- 172.21.15.152:0/4012967475 learned_addr learned my addr 172.21.15.152:0/4012967475 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d6ffd700 1 --2- 172.21.15.152:0/4012967475 >> v2:172.21.15.163:3300/0 conn(0x7f60d815dbf0 0x7f60d80af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d7fff700 1 -- 172.21.15.152:0/4012967475 >> v2:172.21.15.163:3300/0 conn(0x7f60d815dbf0 msgr2=0x7f60d80af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d7fff700 1 --2- 172.21.15.152:0/4012967475 >> v2:172.21.15.163:3300/0 conn(0x7f60d815dbf0 0x7f60d80af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d7fff700 1 -- 172.21.15.152:0/4012967475 >> v1:172.21.15.152:6789/0 conn(0x7f60d815d810 legacy=0x7f60d80ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d7fff700 1 -- 172.21.15.152:0/4012967475 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80cff10 con 0x7f60d80af030 2023-10-16T20:07:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d67fc700 1 -- 172.21.15.152:0/4012967475 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905352540 0 0) 0x7f60d80caee0 con 0x7f60d815d810 2023-10-16T20:07:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d7fff700 1 --2- 172.21.15.152:0/4012967475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d80af030 0x7f60d8161560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60d806f750 tx=0x7f60d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbc202030d5c35a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d67fc700 1 -- 172.21.15.152:0/4012967475 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000e070 con 0x7f60d80af030 2023-10-16T20:07:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d67fc700 1 -- 172.21.15.152:0/4012967475 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d000bbd0 con 0x7f60d80af030 2023-10-16T20:07:17.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.805+0000 7f60d67fc700 1 -- 172.21.15.152:0/4012967475 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0012430 con 0x7f60d80af030 2023-10-16T20:07:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 -- 172.21.15.152:0/4012967475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d80af030 msgr2=0x7f60d8161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 --2- 172.21.15.152:0/4012967475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d80af030 0x7f60d8161560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f60d806f750 tx=0x7f60d000b330 comp rx=0 tx=0).stop 2023-10-16T20:07:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 -- 172.21.15.152:0/4012967475 shutdown_connections 2023-10-16T20:07:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 --2- 172.21.15.152:0/4012967475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d80af030 0x7f60d8161560 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 --2- 172.21.15.152:0/4012967475 >> v2:172.21.15.163:3300/0 conn(0x7f60d815dbf0 0x7f60d80af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 -- 172.21.15.152:0/4012967475 >> 172.21.15.152:0/4012967475 conn(0x7f60d80d0180 msgr2=0x7f60d80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:17.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 -- 172.21.15.152:0/4012967475 shutdown_connections 2023-10-16T20:07:17.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.806+0000 7f60ddafe700 1 -- 172.21.15.152:0/4012967475 wait complete. 2023-10-16T20:07:17.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.807+0000 7f60ddafe700 1 Processor -- start 2023-10-16T20:07:17.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.807+0000 7f60ddafe700 1 -- start start 2023-10-16T20:07:17.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60ddafe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d80af030 0x7f60d80d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60ddafe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d815d810 0x7f60d815e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60ddafe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 0x7f60d815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60ddafe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d814eb70 con 0x7f60d815dbf0 2023-10-16T20:07:17.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60ddafe700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80b1730 con 0x7f60d815d810 2023-10-16T20:07:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60ddafe700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80b12a0 con 0x7f60d80af030 2023-10-16T20:07:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 0x7f60d815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 0x7f60d815e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59804/0 (socket says 172.21.15.152:59804) 2023-10-16T20:07:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 -- 172.21.15.152:0/1227252800 learned_addr learned my addr 172.21.15.152:0/1227252800 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:17.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d77fe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d80af030 0x7f60d80d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d6ffd700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d815d810 0x7f60d815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 -- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d80af030 msgr2=0x7f60d80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d80af030 0x7f60d80d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 -- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d815d810 msgr2=0x7f60d815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:17.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d815d810 0x7f60d815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:17.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.808+0000 7f60d7fff700 1 -- 172.21.15.152:0/1227252800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0009a70 con 0x7f60d815dbf0 2023-10-16T20:07:17.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.809+0000 7f60d7fff700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 0x7f60d815e7d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60d0013000 tx=0x7f60d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.809+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0012430 con 0x7f60d815dbf0 2023-10-16T20:07:17.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.809+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0020070 con 0x7f60d815dbf0 2023-10-16T20:07:17.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.809+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d80b0690 con 0x7f60d815dbf0 2023-10-16T20:07:17.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.809+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0004280 con 0x7f60d815dbf0 2023-10-16T20:07:17.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.809+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d80b0c50 con 0x7f60d815dbf0 2023-10-16T20:07:17.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.810+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d804ebb0 con 0x7f60d815dbf0 2023-10-16T20:07:17.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.810+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f60d00043e0 con 0x7f60d815dbf0 2023-10-16T20:07:17.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.811+0000 7f60bffff700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60c406af00 0x7f60c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:17.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.811+0000 7f60d77fe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60c406af00 0x7f60c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:17.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.811+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f60d0022070 con 0x7f60d815dbf0 2023-10-16T20:07:17.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.811+0000 7f60d77fe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60c406af00 0x7f60c406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000f60 tx=0x7f60c8007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:17.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:17.815+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60d0056b00 con 0x7f60d815dbf0 2023-10-16T20:07:18.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.008+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d80b13e0 con 0x7f60d815dbf0 2023-10-16T20:07:18.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.009+0000 7f60bffff700 1 -- 172.21.15.152:0/1227252800 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f60d005a120 con 0x7f60d815dbf0 2023-10-16T20:07:18.012 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:18.012 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:18.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60c406af00 msgr2=0x7f60c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60c406af00 0x7f60c406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000f60 tx=0x7f60c8007be0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 msgr2=0x7f60d815e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 0x7f60d815e7d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60d0013000 tx=0x7f60d0004ad0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 shutdown_connections 2023-10-16T20:07:18.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f60c406af00 0x7f60c406d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60d80af030 0x7f60d80d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60d815dbf0 0x7f60d815e7d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 --2- 172.21.15.152:0/1227252800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60d815d810 0x7f60d815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 >> 172.21.15.152:0/1227252800 conn(0x7f60d80d0180 msgr2=0x7f60d80ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:18.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 shutdown_connections 2023-10-16T20:07:18.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.011+0000 7f60ddafe700 1 -- 172.21.15.152:0/1227252800 wait complete. 2023-10-16T20:07:18.027 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:18.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:18.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.148+0000 7f96e4bbf700 1 Processor -- start 2023-10-16T20:07:18.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.148+0000 7f96e4bbf700 1 -- start start 2023-10-16T20:07:18.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96e4bbf700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e006b370 0x7f96e015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96e4bbf700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f96e006a820 0x7f96e006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96e4bbf700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e0161360 con 0x7f96e00cdd30 2023-10-16T20:07:18.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96e4bbf700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e006b750 con 0x7f96e006a820 2023-10-16T20:07:18.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96e4bbf700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015e300 con 0x7f96e006b370 2023-10-16T20:07:18.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f96e006a820 0x7f96e006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f96e006a820 0x7f96e006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59808/0 (socket says 172.21.15.152:59808) 2023-10-16T20:07:18.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 -- 172.21.15.152:0/539089771 learned_addr learned my addr 172.21.15.152:0/539089771 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:18.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 -- 172.21.15.152:0/539089771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e006b370 msgr2=0x7f96e015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:18.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96de59c700 1 --2- 172.21.15.152:0/539089771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e006b370 0x7f96e015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 --2- 172.21.15.152:0/539089771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e006b370 0x7f96e015dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 -- 172.21.15.152:0/539089771 >> v1:172.21.15.163:6789/0 conn(0x7f96e00cdd30 legacy=0x7f96e01617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:18.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 -- 172.21.15.152:0/539089771 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e015e5e0 con 0x7f96e006a820 2023-10-16T20:07:18.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96ddd9b700 1 --2- 172.21.15.152:0/539089771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e006d5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f96d40098f0 tx=0x7f96d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f57ed10cdf096c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.149+0000 7f96dd59a700 1 -- 172.21.15.152:0/539089771 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4004230 con 0x7f96e006a820 2023-10-16T20:07:18.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96dd59a700 1 -- 172.21.15.152:0/539089771 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4004390 con 0x7f96e006a820 2023-10-16T20:07:18.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96dd59a700 1 -- 172.21.15.152:0/539089771 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d40036a0 con 0x7f96e006a820 2023-10-16T20:07:18.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 -- 172.21.15.152:0/539089771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 msgr2=0x7f96e006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/539089771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e006d5b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f96d40098f0 tx=0x7f96d4009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:18.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 -- 172.21.15.152:0/539089771 shutdown_connections 2023-10-16T20:07:18.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/539089771 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e006b370 0x7f96e015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/539089771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e006d5b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 -- 172.21.15.152:0/539089771 >> 172.21.15.152:0/539089771 conn(0x7f96e00ccbe0 msgr2=0x7f96e00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:18.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 -- 172.21.15.152:0/539089771 shutdown_connections 2023-10-16T20:07:18.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.150+0000 7f96e4bbf700 1 -- 172.21.15.152:0/539089771 wait complete. 2023-10-16T20:07:18.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.151+0000 7f96e4bbf700 1 Processor -- start 2023-10-16T20:07:18.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.151+0000 7f96e4bbf700 1 -- start start 2023-10-16T20:07:18.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96e4bbf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e0071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96e4bbf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e006b370 0x7f96e01e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96e4bbf700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e00cdd30 0x7f96e0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96e4bbf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01e6500 con 0x7f96e006a820 2023-10-16T20:07:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96e4bbf700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01e6da0 con 0x7f96e006b370 2023-10-16T20:07:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96e4bbf700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01e84c0 con 0x7f96e00cdd30 2023-10-16T20:07:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96de59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e0071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96de59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e0071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59814/0 (socket says 172.21.15.152:59814) 2023-10-16T20:07:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.152+0000 7f96de59c700 1 -- 172.21.15.152:0/1282672745 learned_addr learned my addr 172.21.15.152:0/1282672745 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96de59c700 1 -- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e00cdd30 msgr2=0x7f96e0154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96de59c700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e00cdd30 0x7f96e0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96de59c700 1 -- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e006b370 msgr2=0x7f96e01e7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96ddd9b700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e006b370 0x7f96e01e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96de59c700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e006b370 0x7f96e01e7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96de59c700 1 -- 172.21.15.152:0/1282672745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4009550 con 0x7f96e006a820 2023-10-16T20:07:18.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96de59c700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e0071db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c7f0 tx=0x7f96d000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011800 con 0x7f96e006a820 2023-10-16T20:07:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0011960 con 0x7f96e006a820 2023-10-16T20:07:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01e6750 con 0x7f96e006a820 2023-10-16T20:07:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011cf0 con 0x7f96e006a820 2023-10-16T20:07:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.153+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0155a80 con 0x7f96e006a820 2023-10-16T20:07:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.154+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0072d10 con 0x7f96e006a820 2023-10-16T20:07:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.154+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f96d0018360 con 0x7f96e006a820 2023-10-16T20:07:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.155+0000 7f96ceffd700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f96c006af00 0x7f96c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.155+0000 7f96ddd9b700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f96c006af00 0x7f96c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.155+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96d0089980 con 0x7f96e006a820 2023-10-16T20:07:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.155+0000 7f96ddd9b700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f96c006af00 0x7f96c006d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96e01e7790 tx=0x7f96d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.159+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96d0054680 con 0x7f96e006a820 2023-10-16T20:07:18.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.348+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96e004ebb0 con 0x7f96e006a820 2023-10-16T20:07:18.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.348+0000 7f96ceffd700 1 -- 172.21.15.152:0/1282672745 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96d0057ca0 con 0x7f96e006a820 2023-10-16T20:07:18.352 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:18.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f96c006af00 msgr2=0x7f96c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f96c006af00 0x7f96c006d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96e01e7790 tx=0x7f96d4008030 comp rx=0 tx=0).stop 2023-10-16T20:07:18.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 msgr2=0x7f96e0071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e0071db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c7f0 tx=0x7f96d000cbb0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 shutdown_connections 2023-10-16T20:07:18.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f96c006af00 0x7f96c006d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f96e00cdd30 0x7f96e0154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96e006a820 0x7f96e0071db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 --2- 172.21.15.152:0/1282672745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96e006b370 0x7f96e01e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.350+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 >> 172.21.15.152:0/1282672745 conn(0x7f96e00ccbe0 msgr2=0x7f96e0160060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:18.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.351+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 shutdown_connections 2023-10-16T20:07:18.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.351+0000 7f96e4bbf700 1 -- 172.21.15.152:0/1282672745 wait complete. 2023-10-16T20:07:18.365 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:18.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.486+0000 7feaed732700 1 Processor -- start 2023-10-16T20:07:18.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.486+0000 7feaed732700 1 -- start start 2023-10-16T20:07:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feaed732700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feae806a820 0x7feae815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feaed732700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7feae80cdd30 0x7feae80ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feaed732700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae8161360 con 0x7feae806b370 2023-10-16T20:07:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feaed732700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80ce720 con 0x7feae806a820 2023-10-16T20:07:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feaed732700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae806b750 con 0x7feae80cdd30 2023-10-16T20:07:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feae67fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feae806a820 0x7feae815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feae67fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feae806a820 0x7feae815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59824/0 (socket says 172.21.15.152:59824) 2023-10-16T20:07:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.487+0000 7feae67fc700 1 -- 172.21.15.152:0/2613276836 learned_addr learned my addr 172.21.15.152:0/2613276836 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae77fe700 1 --2- 172.21.15.152:0/2613276836 >> v2:172.21.15.163:3300/0 conn(0x7feae80cdd30 0x7feae80ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae67fc700 1 -- 172.21.15.152:0/2613276836 >> v2:172.21.15.163:3300/0 conn(0x7feae80cdd30 msgr2=0x7feae80ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae67fc700 1 --2- 172.21.15.152:0/2613276836 >> v2:172.21.15.163:3300/0 conn(0x7feae80cdd30 0x7feae80ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae67fc700 1 -- 172.21.15.152:0/2613276836 >> v1:172.21.15.163:6789/0 conn(0x7feae806b370 legacy=0x7feae806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae67fc700 1 -- 172.21.15.152:0/2613276836 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae806dcc0 con 0x7feae806a820 2023-10-16T20:07:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae77fe700 1 --2- 172.21.15.152:0/2613276836 >> v2:172.21.15.163:3300/0 conn(0x7feae80cdd30 0x7feae80ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae67fc700 1 --2- 172.21.15.152:0/2613276836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806a820 0x7feae815dcb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feae815b880 tx=0x7fead8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6517cab0659a56d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae5ffb700 1 -- 172.21.15.152:0/2613276836 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8004230 con 0x7feae806a820 2023-10-16T20:07:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae5ffb700 1 -- 172.21.15.152:0/2613276836 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8004390 con 0x7feae806a820 2023-10-16T20:07:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feae5ffb700 1 -- 172.21.15.152:0/2613276836 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80036a0 con 0x7feae806a820 2023-10-16T20:07:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 -- 172.21.15.152:0/2613276836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806a820 msgr2=0x7feae815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 --2- 172.21.15.152:0/2613276836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806a820 0x7feae815dcb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feae815b880 tx=0x7fead8009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 -- 172.21.15.152:0/2613276836 shutdown_connections 2023-10-16T20:07:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 --2- 172.21.15.152:0/2613276836 >> v2:172.21.15.163:3300/0 conn(0x7feae80cdd30 0x7feae80ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 --2- 172.21.15.152:0/2613276836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806a820 0x7feae815dcb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 -- 172.21.15.152:0/2613276836 >> 172.21.15.152:0/2613276836 conn(0x7feae80ccbe0 msgr2=0x7feae80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:18.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 -- 172.21.15.152:0/2613276836 shutdown_connections 2023-10-16T20:07:18.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.488+0000 7feaed732700 1 -- 172.21.15.152:0/2613276836 wait complete. 2023-10-16T20:07:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.490+0000 7feaed732700 1 Processor -- start 2023-10-16T20:07:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.490+0000 7feaed732700 1 -- start start 2023-10-16T20:07:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.490+0000 7feaed732700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feae806a820 0x7feae8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.490+0000 7feaed732700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 0x7feae80c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feaed732700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feae80cdd30 0x7feae80c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feaed732700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80b3dc0 con 0x7feae806b370 2023-10-16T20:07:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feaed732700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8158370 con 0x7feae806a820 2023-10-16T20:07:18.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feaed732700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80b4010 con 0x7feae80cdd30 2023-10-16T20:07:18.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 0x7feae80c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 0x7feae80c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59830/0 (socket says 172.21.15.152:59830) 2023-10-16T20:07:18.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 -- 172.21.15.152:0/1392631987 learned_addr learned my addr 172.21.15.152:0/1392631987 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:18.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae6ffd700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feae806a820 0x7feae8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae77fe700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feae80cdd30 0x7feae80c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 -- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feae80cdd30 msgr2=0x7feae80c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feae80cdd30 0x7feae80c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 -- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feae806a820 msgr2=0x7feae8156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feae806a820 0x7feae8156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 -- 172.21.15.152:0/1392631987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009550 con 0x7feae806b370 2023-10-16T20:07:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae6ffd700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feae806a820 0x7feae8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feae67fc700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 0x7feae80c40a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fead8009130 tx=0x7fead8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8011630 con 0x7feae806b370 2023-10-16T20:07:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8011790 con 0x7feae806b370 2023-10-16T20:07:18.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae80b42f0 con 0x7feae806b370 2023-10-16T20:07:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8011b00 con 0x7feae806b370 2023-10-16T20:07:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.491+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80b48b0 con 0x7feae806b370 2023-10-16T20:07:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.492+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8072d10 con 0x7feae806b370 2023-10-16T20:07:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.493+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fead8011c60 con 0x7feae806b370 2023-10-16T20:07:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.493+0000 7feacf7fe700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fead406af00 0x7fead406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.493+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fead808afc0 con 0x7feae806b370 2023-10-16T20:07:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.493+0000 7feae6ffd700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fead406af00 0x7fead406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.493+0000 7feae6ffd700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fead406af00 0x7fead406d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feadc003f40 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.497+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fead80bdca0 con 0x7feae806b370 2023-10-16T20:07:18.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.686+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feae804ebb0 con 0x7feae806b370 2023-10-16T20:07:18.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.687+0000 7feacf7fe700 1 -- 172.21.15.152:0/1392631987 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fead8055df0 con 0x7feae806b370 2023-10-16T20:07:18.690 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:18.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fead406af00 msgr2=0x7fead406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fead406af00 0x7fead406d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feadc003f40 tx=0x7feadc009040 comp rx=0 tx=0).stop 2023-10-16T20:07:18.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 msgr2=0x7feae80c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 0x7feae80c40a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fead8009130 tx=0x7fead8004750 comp rx=0 tx=0).stop 2023-10-16T20:07:18.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 shutdown_connections 2023-10-16T20:07:18.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fead406af00 0x7fead406d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7feae80cdd30 0x7feae80c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feae806a820 0x7feae8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 --2- 172.21.15.152:0/1392631987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae806b370 0x7feae80c40a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 >> 172.21.15.152:0/1392631987 conn(0x7feae80ccbe0 msgr2=0x7feae80ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:18.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 shutdown_connections 2023-10-16T20:07:18.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.689+0000 7feaed732700 1 -- 172.21.15.152:0/1392631987 wait complete. 2023-10-16T20:07:18.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:18.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.825+0000 7f8ffb407700 1 Processor -- start 2023-10-16T20:07:18.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.825+0000 7f8ffb407700 1 -- start start 2023-10-16T20:07:18.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ffb407700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40b33f0 0x7f8ff406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ffb407700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ff40cd770 0x7f8ff40b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ffb407700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff4070620 con 0x7f8ff415b4e0 2023-10-16T20:07:18.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ffb407700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff4070900 con 0x7f8ff40cd770 2023-10-16T20:07:18.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ffb407700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff4070be0 con 0x7f8ff40b33f0 2023-10-16T20:07:18.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ff40cd770 0x7f8ff40b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ff40cd770 0x7f8ff40b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59840/0 (socket says 172.21.15.152:59840) 2023-10-16T20:07:18.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 -- 172.21.15.152:0/1599816084 learned_addr learned my addr 172.21.15.152:0/1599816084 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:18.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff89a2700 1 --2- 172.21.15.152:0/1599816084 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40b33f0 0x7f8ff406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 -- 172.21.15.152:0/1599816084 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40b33f0 msgr2=0x7f8ff406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:18.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 --2- 172.21.15.152:0/1599816084 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40b33f0 0x7f8ff406f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 -- 172.21.15.152:0/1599816084 >> v1:172.21.15.163:6789/0 conn(0x7f8ff415b4e0 legacy=0x7f8ff40b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 -- 172.21.15.152:0/1599816084 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff4070ec0 con 0x7f8ff40cd770 2023-10-16T20:07:18.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8ff99a4700 1 --2- 172.21.15.152:0/1599816084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff40cd770 0x7f8ff40b4450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009e50 tx=0x7f8fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffbeb8ee85f1674 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8febfff700 1 -- 172.21.15.152:0/1599816084 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00e070 con 0x7f8ff40cd770 2023-10-16T20:07:18.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.826+0000 7f8febfff700 1 -- 172.21.15.152:0/1599816084 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec00b9c0 con 0x7f8ff40cd770 2023-10-16T20:07:18.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8febfff700 1 -- 172.21.15.152:0/1599816084 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00bd70 con 0x7f8ff40cd770 2023-10-16T20:07:18.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 -- 172.21.15.152:0/1599816084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff40cd770 msgr2=0x7f8ff40b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 --2- 172.21.15.152:0/1599816084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff40cd770 0x7f8ff40b4450 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009e50 tx=0x7f8fec00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:18.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 -- 172.21.15.152:0/1599816084 shutdown_connections 2023-10-16T20:07:18.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 --2- 172.21.15.152:0/1599816084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff40cd770 0x7f8ff40b4450 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 --2- 172.21.15.152:0/1599816084 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40b33f0 0x7f8ff406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 -- 172.21.15.152:0/1599816084 >> 172.21.15.152:0/1599816084 conn(0x7f8ff40cdce0 msgr2=0x7f8ff40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:18.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 -- 172.21.15.152:0/1599816084 shutdown_connections 2023-10-16T20:07:18.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.827+0000 7f8ffb407700 1 -- 172.21.15.152:0/1599816084 wait complete. 2023-10-16T20:07:18.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.828+0000 7f8ffb407700 1 Processor -- start 2023-10-16T20:07:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.828+0000 7f8ffb407700 1 -- start start 2023-10-16T20:07:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ffb407700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ff40b33f0 0x7f8ff4155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ffb407700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40cd770 0x7f8ff41e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ffb407700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 0x7f8ff41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ffb407700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c7330 con 0x7f8ff415b4e0 2023-10-16T20:07:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ffb407700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c7610 con 0x7f8ff40b33f0 2023-10-16T20:07:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ffb407700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c78f0 con 0x7f8ff40cd770 2023-10-16T20:07:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 0x7f8ff41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 0x7f8ff41546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59846/0 (socket says 172.21.15.152:59846) 2023-10-16T20:07:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 -- 172.21.15.152:0/2249624671 learned_addr learned my addr 172.21.15.152:0/2249624671 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff89a2700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40cd770 0x7f8ff41e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff91a3700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ff40b33f0 0x7f8ff4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 -- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40cd770 msgr2=0x7f8ff41e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40cd770 0x7f8ff41e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 -- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ff40b33f0 msgr2=0x7f8ff4155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ff40b33f0 0x7f8ff4155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.829+0000 7f8ff99a4700 1 -- 172.21.15.152:0/2249624671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec009b30 con 0x7f8ff415b4e0 2023-10-16T20:07:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.830+0000 7f8ff99a4700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 0x7f8ff41546e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40b3920 tx=0x7f8fec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.830+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec004800 con 0x7f8ff415b4e0 2023-10-16T20:07:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.830+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec004960 con 0x7f8ff415b4e0 2023-10-16T20:07:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.830+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff40c7bd0 con 0x7f8ff415b4e0 2023-10-16T20:07:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.830+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec01c680 con 0x7f8ff415b4e0 2023-10-16T20:07:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.830+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff41e1120 con 0x7f8ff415b4e0 2023-10-16T20:07:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.831+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff404ebb0 con 0x7f8ff415b4e0 2023-10-16T20:07:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.831+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8fec01c7e0 con 0x7f8ff415b4e0 2023-10-16T20:07:18.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.832+0000 7f8fe9ffb700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8fd806af00 0x7f8fd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.832+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8fec08b540 con 0x7f8ff415b4e0 2023-10-16T20:07:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.832+0000 7f8ff91a3700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8fd806af00 0x7f8fd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.832+0000 7f8ff91a3700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8fd806af00 0x7f8fd806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ff41589d0 tx=0x7f8ff0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:18.836+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fec0562c0 con 0x7f8ff415b4e0 2023-10-16T20:07:19.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.027+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ff40c7d60 con 0x7f8ff415b4e0 2023-10-16T20:07:19.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.028+0000 7f8fe9ffb700 1 -- 172.21.15.152:0/2249624671 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fec0598e0 con 0x7f8ff415b4e0 2023-10-16T20:07:19.031 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:19.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8fd806af00 msgr2=0x7f8fd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8fd806af00 0x7f8fd806d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ff41589d0 tx=0x7f8ff0009040 comp rx=0 tx=0).stop 2023-10-16T20:07:19.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 msgr2=0x7f8ff41546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 0x7f8ff41546e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40b3920 tx=0x7f8fec004ad0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 shutdown_connections 2023-10-16T20:07:19.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8fd806af00 0x7f8fd806d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ff415b4e0 0x7f8ff41546e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ff40b33f0 0x7f8ff4155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 --2- 172.21.15.152:0/2249624671 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ff40cd770 0x7f8ff41e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 >> 172.21.15.152:0/2249624671 conn(0x7f8ff40cdce0 msgr2=0x7f8ff40c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:19.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 shutdown_connections 2023-10-16T20:07:19.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.030+0000 7f8ffb407700 1 -- 172.21.15.152:0/2249624671 wait complete. 2023-10-16T20:07:19.045 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:19.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.167+0000 7fd0e33de700 1 Processor -- start 2023-10-16T20:07:19.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.168+0000 7fd0e33de700 1 -- start start 2023-10-16T20:07:19.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.168+0000 7fd0e33de700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 0x7fd0dc0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.168+0000 7fd0e33de700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd0dc06dcc0 0x7fd0dc0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.168+0000 7fd0e33de700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0cba90 con 0x7fd0dc15dec0 2023-10-16T20:07:19.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.168+0000 7fd0e33de700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cb510 con 0x7fd0dc06dcc0 2023-10-16T20:07:19.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.168+0000 7fd0e33de700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15ee40 con 0x7fd0dc15a250 2023-10-16T20:07:19.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e0979700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd0dc15dec0 0x7fd0dc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40048/0 (socket says 172.21.15.152:40048) 2023-10-16T20:07:19.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e0979700 1 -- 172.21.15.152:0/2011486663 learned_addr learned my addr 172.21.15.152:0/2011486663 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:19.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e117a700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 0x7fd0dc0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e197b700 1 --2- 172.21.15.152:0/2011486663 >> v2:172.21.15.163:3300/0 conn(0x7fd0dc06dcc0 0x7fd0dc0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999169498 0 0) 0x7fd0dc0cba90 con 0x7fd0dc15dec0 2023-10-16T20:07:19.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c80035b0 con 0x7fd0dc15dec0 2023-10-16T20:07:19.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684138324 0 0) 0x7fd0c80035b0 con 0x7fd0dc15dec0 2023-10-16T20:07:19.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 msgr2=0x7fd0dc0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 0x7fd0dc0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 >> v2:172.21.15.163:3300/0 conn(0x7fd0dc06dcc0 msgr2=0x7fd0dc0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 --2- 172.21.15.152:0/2011486663 >> v2:172.21.15.163:3300/0 conn(0x7fd0dc06dcc0 0x7fd0dc0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc15e880 con 0x7fd0dc15dec0 2023-10-16T20:07:19.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fd0d8001670 con 0x7fd0dc15dec0 2023-10-16T20:07:19.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 >> v1:172.21.15.152:6789/0 conn(0x7fd0dc15dec0 legacy=0x7fd0dc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 0x7fd0c8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0c8003f80 0x7fd0c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8004d90 0x7fd0c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cb510 con 0x7fd0c8004d90 2023-10-16T20:07:19.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15ee40 con 0x7fd0c8003f80 2023-10-16T20:07:19.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c800dc20 con 0x7fd0dc15a250 2023-10-16T20:07:19.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e197b700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8004d90 0x7fd0c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e117a700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 0x7fd0c8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e0979700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0c8003f80 0x7fd0c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e197b700 1 -- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 msgr2=0x7fd0c8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e197b700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc15a250 0x7fd0c8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e197b700 1 -- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0c8003f80 msgr2=0x7fd0c8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.169+0000 7fd0e197b700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0c8003f80 0x7fd0c8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e197b700 1 -- 172.21.15.152:0/2011486663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80035b0 con 0x7fd0c8004d90 2023-10-16T20:07:19.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e197b700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8004d90 0x7fd0c8005210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009f90 tx=0x7fd0c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f595bd229d15219 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:19.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400ebd0 con 0x7fd0c8004d90 2023-10-16T20:07:19.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400f040 con 0x7fd0c8004d90 2023-10-16T20:07:19.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0d3fff700 1 -- 172.21.15.152:0/2011486663 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4014480 con 0x7fd0c8004d90 2023-10-16T20:07:19.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e33de700 1 -- 172.21.15.152:0/2011486663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8004d90 msgr2=0x7fd0c8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e33de700 1 --2- 172.21.15.152:0/2011486663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8004d90 0x7fd0c8005210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009f90 tx=0x7fd0c8005880 comp rx=0 tx=0).stop 2023-10-16T20:07:19.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e197b700 1 -- 172.21.15.152:0/2011486663 reap_dead start 2023-10-16T20:07:19.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e33de700 1 -- 172.21.15.152:0/2011486663 shutdown_connections 2023-10-16T20:07:19.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e33de700 1 -- 172.21.15.152:0/2011486663 >> 172.21.15.152:0/2011486663 conn(0x7fd0dc0ccbe0 msgr2=0x7fd0dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:19.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e33de700 1 -- 172.21.15.152:0/2011486663 shutdown_connections 2023-10-16T20:07:19.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.170+0000 7fd0e33de700 1 -- 172.21.15.152:0/2011486663 wait complete. 2023-10-16T20:07:19.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 Processor -- start 2023-10-16T20:07:19.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 -- start start 2023-10-16T20:07:19.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc0b57e0 0x7fd0dc1f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc0b2da0 0x7fd0dc0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 0x7fd0dc071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc1f2520 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0c86f0 con 0x7fd0dc0b57e0 2023-10-16T20:07:19.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e33de700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc1f2730 con 0x7fd0dc0b2da0 2023-10-16T20:07:19.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.172+0000 7fd0e197b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 0x7fd0dc071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 0x7fd0dc071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59866/0 (socket says 172.21.15.152:59866) 2023-10-16T20:07:19.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 -- 172.21.15.152:0/1140472731 learned_addr learned my addr 172.21.15.152:0/1140472731 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:19.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e117a700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc0b57e0 0x7fd0dc1f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e0979700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc0b2da0 0x7fd0dc0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 -- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc0b2da0 msgr2=0x7fd0dc0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc0b2da0 0x7fd0dc0716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 -- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc0b57e0 msgr2=0x7fd0dc1f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc0b57e0 0x7fd0dc1f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 -- 172.21.15.152:0/1140472731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc1f2a10 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e197b700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 0x7fd0dc071bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e700 tx=0x7fd0d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4007000 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d4003c30 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003de0 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc1f2cf0 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.173+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc0c4180 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.174+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc0c8b80 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.175+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0d4014910 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.175+0000 7fd0d1ffb700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0c006af30 0x7fd0c006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.175+0000 7fd0e117a700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0c006af30 0x7fd0c006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.175+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0d408b0b0 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.175+0000 7fd0e117a700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0c006af30 0x7fd0c006d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009aa0 tx=0x7fd0cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:19.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.180+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0dc0c8b80 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.369+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd0dc0c8b80 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.370+0000 7fd0d1ffb700 1 -- 172.21.15.152:0/1140472731 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd0dc0c8b80 con 0x7fd0dc0b5bc0 2023-10-16T20:07:19.373 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0c006af30 msgr2=0x7fd0c006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0c006af30 0x7fd0c006d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009aa0 tx=0x7fd0cc008040 comp rx=0 tx=0).stop 2023-10-16T20:07:19.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 msgr2=0x7fd0dc071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 0x7fd0dc071bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e700 tx=0x7fd0d4009750 comp rx=0 tx=0).stop 2023-10-16T20:07:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 shutdown_connections 2023-10-16T20:07:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd0c006af30 0x7fd0c006d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0dc0b5bc0 0x7fd0dc071bf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0dc0b57e0 0x7fd0dc1f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 --2- 172.21.15.152:0/1140472731 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd0dc0b2da0 0x7fd0dc0716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 >> 172.21.15.152:0/1140472731 conn(0x7fd0dc0ccbe0 msgr2=0x7fd0dc0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 shutdown_connections 2023-10-16T20:07:19.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.372+0000 7fd0e33de700 1 -- 172.21.15.152:0/1140472731 wait complete. 2023-10-16T20:07:19.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close' 2023-10-16T20:07:19.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.505+0000 7f784f753700 1 Processor -- start 2023-10-16T20:07:19.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.505+0000 7f784f753700 1 -- start start 2023-10-16T20:07:19.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.506+0000 7f784f753700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7848152470 0x7f78480cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.506+0000 7f784f753700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7848070d70 con 0x7f78480b3410 2023-10-16T20:07:19.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.506+0000 7f784f753700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784815c990 con 0x7f78480cb8d0 2023-10-16T20:07:19.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.506+0000 7f784f753700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7848071200 con 0x7f7848152470 2023-10-16T20:07:19.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.506+0000 7f784dcf0700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f78480b3410 0x7f78480b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40072/0 (socket says 172.21.15.152:40072) 2023-10-16T20:07:19.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.506+0000 7f784dcf0700 1 -- 172.21.15.152:0/3125891845 learned_addr learned my addr 172.21.15.152:0/3125891845 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:19.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784d4ef700 1 --2- 172.21.15.152:0/3125891845 >> v2:172.21.15.163:3300/0 conn(0x7f7848152470 0x7f78480cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921878497 0 0) 0x7f7848070d70 con 0x7f78480b3410 2023-10-16T20:07:19.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78340035b0 con 0x7f78480b3410 2023-10-16T20:07:19.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459205523 0 0) 0x7f78340035b0 con 0x7f78480b3410 2023-10-16T20:07:19.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 >> v2:172.21.15.163:3300/0 conn(0x7f7848152470 msgr2=0x7f78480cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 --2- 172.21.15.152:0/3125891845 >> v2:172.21.15.163:3300/0 conn(0x7f7848152470 0x7f78480cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 >> v1:172.21.15.163:6789/0 conn(0x7f78480cb8d0 legacy=0x7f78480b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480cbd80 con 0x7f78480b3410 2023-10-16T20:07:19.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f78400019f0 con 0x7f78480b3410 2023-10-16T20:07:19.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 >> v1:172.21.15.152:6789/0 conn(0x7f78480b3410 legacy=0x7f78480b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7834003a00 0x7f7834003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834004850 0x7f7834004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7834005210 0x7f783400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848071200 con 0x7f7834005210 2023-10-16T20:07:19.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783400c160 con 0x7f7834003a00 2023-10-16T20:07:19.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783400c320 con 0x7f7834004850 2023-10-16T20:07:19.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784dcf0700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7834005210 0x7f783400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784d4ef700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7834003a00 0x7f7834003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784ccee700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834004850 0x7f7834004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784dcf0700 1 -- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834004850 msgr2=0x7f7834004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784dcf0700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834004850 0x7f7834004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784dcf0700 1 -- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7834003a00 msgr2=0x7f7834003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:19.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784dcf0700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7834003a00 0x7f7834003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.507+0000 7f784dcf0700 1 -- 172.21.15.152:0/3125891845 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340035b0 con 0x7f7834005210 2023-10-16T20:07:19.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784dcf0700 1 -- 172.21.15.152:0/3125891845 reap_dead start 2023-10-16T20:07:19.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784dcf0700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7834005210 0x7f783400ba10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7848072790 tx=0x7f7834005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8d15f42704e794 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:19.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400055b0 con 0x7f7834005210 2023-10-16T20:07:19.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000dae0 con 0x7f7834005210 2023-10-16T20:07:19.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f783ffff700 1 -- 172.21.15.152:0/3125891845 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000de90 con 0x7f7834005210 2023-10-16T20:07:19.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 -- 172.21.15.152:0/3125891845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7834005210 msgr2=0x7f783400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7834005210 0x7f783400ba10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7848072790 tx=0x7f7834005880 comp rx=0 tx=0).stop 2023-10-16T20:07:19.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 -- 172.21.15.152:0/3125891845 shutdown_connections 2023-10-16T20:07:19.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 --2- 172.21.15.152:0/3125891845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7834005210 0x7f783400ba10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 -- 172.21.15.152:0/3125891845 >> 172.21.15.152:0/3125891845 conn(0x7f78480cdd00 msgr2=0x7f78480ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:19.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 -- 172.21.15.152:0/3125891845 shutdown_connections 2023-10-16T20:07:19.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.508+0000 7f784f753700 1 -- 172.21.15.152:0/3125891845 wait complete. 2023-10-16T20:07:19.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.510+0000 7f784f753700 1 Processor -- start 2023-10-16T20:07:19.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.510+0000 7f784f753700 1 -- start start 2023-10-16T20:07:19.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784f753700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834005210 0x7f78481f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784f753700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 0x7f7848156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784f753700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7848150180 0x7f7848150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784f753700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784814efc0 con 0x7f784806cf00 2023-10-16T20:07:19.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784f753700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481f2bb0 con 0x7f7848150180 2023-10-16T20:07:19.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784f753700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848150b40 con 0x7f7834005210 2023-10-16T20:07:19.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 0x7f7848156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 0x7f7848156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59882/0 (socket says 172.21.15.152:59882) 2023-10-16T20:07:19.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 -- 172.21.15.152:0/379763641 learned_addr learned my addr 172.21.15.152:0/379763641 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:19.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784dcf0700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7848150180 0x7f7848150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784d4ef700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834005210 0x7f78481f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 -- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834005210 msgr2=0x7f78481f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834005210 0x7f78481f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 -- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7848150180 msgr2=0x7f7848150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7848150180 0x7f7848150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 -- 172.21.15.152:0/379763641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848158320 con 0x7f784806cf00 2023-10-16T20:07:19.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784d4ef700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834005210 0x7f78481f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:19.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784dcf0700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7848150180 0x7f7848150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:19.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.511+0000 7f784ccee700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 0x7f7848156a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f784400f850 tx=0x7f784400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:19.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.512+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440050d0 con 0x7f784806cf00 2023-10-16T20:07:19.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.512+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844005230 con 0x7f784806cf00 2023-10-16T20:07:19.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.512+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844003680 con 0x7f784806cf00 2023-10-16T20:07:19.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.512+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7848157280 con 0x7f784806cf00 2023-10-16T20:07:19.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.512+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7848157840 con 0x7f784806cf00 2023-10-16T20:07:19.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.513+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784804ebb0 con 0x7f784806cf00 2023-10-16T20:07:19.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.513+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78440037e0 con 0x7f784806cf00 2023-10-16T20:07:19.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.513+0000 7f783dffb700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f782c06af00 0x7f782c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:19.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.514+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7844089700 con 0x7f784806cf00 2023-10-16T20:07:19.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.514+0000 7f784d4ef700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f782c06af00 0x7f782c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:19.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.514+0000 7f784d4ef700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f782c06af00 0x7f782c06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f78480d0f00 tx=0x7f7838008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:19.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.518+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78440543f0 con 0x7f784806cf00 2023-10-16T20:07:19.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.789+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]} v 0) v1 -- 0x7f784806f630 con 0x7f784806cf00 2023-10-16T20:07:19.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.894+0000 7f783dffb700 1 -- 172.21.15.152:0/379763641 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_sessionmap.TestSessionMap.test_mount_conn_close"]}]=0 v66) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7844057a10 con 0x7f784806cf00 2023-10-16T20:07:19.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f782c06af00 msgr2=0x7f782c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f782c06af00 0x7f782c06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f78480d0f00 tx=0x7f7838008040 comp rx=0 tx=0).stop 2023-10-16T20:07:19.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 msgr2=0x7f7848156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:19.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 0x7f7848156a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f784400f850 tx=0x7f784400fc10 comp rx=0 tx=0).stop 2023-10-16T20:07:19.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 shutdown_connections 2023-10-16T20:07:19.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f782c06af00 0x7f782c06d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7834005210 0x7f78481f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7848150180 0x7f7848150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 --2- 172.21.15.152:0/379763641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f784806cf00 0x7f7848156a00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:19.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 >> 172.21.15.152:0/379763641 conn(0x7f78480cdd00 msgr2=0x7f784815f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:19.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 shutdown_connections 2023-10-16T20:07:19.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:19.896+0000 7f784f753700 1 -- 172.21.15.152:0/379763641 wait complete. 2023-10-16T20:07:19.911 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T20:07:20.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.032+0000 7f53ae473700 1 Processor -- start 2023-10-16T20:07:20.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.032+0000 7f53ae473700 1 -- start start 2023-10-16T20:07:20.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53ae473700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f53a806fd90 0x7f53a806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53ae473700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a815eb20 con 0x7f53a806af30 2023-10-16T20:07:20.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53ae473700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a8070170 con 0x7f53a8071840 2023-10-16T20:07:20.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53ae473700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a815df10 con 0x7f53a806fd90 2023-10-16T20:07:20.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53aca10700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f53a806af30 0x7f53a81613e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40092/0 (socket says 172.21.15.152:40092) 2023-10-16T20:07:20.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53aca10700 1 -- 172.21.15.152:0/3494268989 learned_addr learned my addr 172.21.15.152:0/3494268989 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:20.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53a7fff700 1 --2- 172.21.15.152:0/3494268989 >> v2:172.21.15.163:3300/0 conn(0x7f53a806fd90 0x7f53a806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951532810 0 0) 0x7f53a815eb20 con 0x7f53a806af30 2023-10-16T20:07:20.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.033+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53900035b0 con 0x7f53a806af30 2023-10-16T20:07:20.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 747589347 0 0) 0x7f53900035b0 con 0x7f53a806af30 2023-10-16T20:07:20.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 >> v2:172.21.15.163:3300/0 conn(0x7f53a806fd90 msgr2=0x7f53a806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:20.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 --2- 172.21.15.152:0/3494268989 >> v2:172.21.15.163:3300/0 conn(0x7f53a806fd90 0x7f53a806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 >> v1:172.21.15.163:6789/0 conn(0x7f53a8071840 legacy=0x7f53a806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a815e1f0 con 0x7f53a806af30 2023-10-16T20:07:20.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f53a00019f0 con 0x7f53a806af30 2023-10-16T20:07:20.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 >> v1:172.21.15.152:6789/0 conn(0x7f53a806af30 legacy=0x7f53a81613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5390003a00 0x7f5390003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5390004850 0x7f5390004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390005210 0x7f539000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815df10 con 0x7f5390004850 2023-10-16T20:07:20.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539000c0b0 con 0x7f5390003a00 2023-10-16T20:07:20.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539000c270 con 0x7f5390005210 2023-10-16T20:07:20.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5390004850 0x7f5390004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a7fff700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5390003a00 0x7f5390003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53aca10700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390005210 0x7f539000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 -- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390005210 msgr2=0x7f539000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:20.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390005210 0x7f539000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 -- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5390003a00 msgr2=0x7f5390003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:20.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5390003a00 0x7f5390003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53aca10700 1 -- 172.21.15.152:0/3494268989 reap_dead start 2023-10-16T20:07:20.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 -- 172.21.15.152:0/3494268989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900035b0 con 0x7f5390004850 2023-10-16T20:07:20.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a77fe700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5390004850 0x7f5390004cd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f53980017c0 tx=0x7f5390005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6dd6b0aa9db897 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:20.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980052d0 con 0x7f5390004850 2023-10-16T20:07:20.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398005430 con 0x7f5390004850 2023-10-16T20:07:20.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.034+0000 7f53a6ffd700 1 -- 172.21.15.152:0/3494268989 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980038c0 con 0x7f5390004850 2023-10-16T20:07:20.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 -- 172.21.15.152:0/3494268989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5390004850 msgr2=0x7f5390004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5390004850 0x7f5390004cd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f53980017c0 tx=0x7f5390005880 comp rx=0 tx=0).stop 2023-10-16T20:07:20.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 -- 172.21.15.152:0/3494268989 shutdown_connections 2023-10-16T20:07:20.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 --2- 172.21.15.152:0/3494268989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5390004850 0x7f5390004cd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 -- 172.21.15.152:0/3494268989 >> 172.21.15.152:0/3494268989 conn(0x7f53a80d0250 msgr2=0x7f53a80d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:20.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 -- 172.21.15.152:0/3494268989 shutdown_connections 2023-10-16T20:07:20.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.035+0000 7f53ae473700 1 -- 172.21.15.152:0/3494268989 wait complete. 2023-10-16T20:07:20.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.036+0000 7f53ae473700 1 Processor -- start 2023-10-16T20:07:20.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.036+0000 7f53ae473700 1 -- start start 2023-10-16T20:07:20.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53ae473700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390004850 0x7f53a80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53ae473700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 0x7f53a815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53ae473700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53a8158210 0x7f53a81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53ae473700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a815aef0 con 0x7f53a80b3880 2023-10-16T20:07:20.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53ae473700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b4970 con 0x7f53a8158210 2023-10-16T20:07:20.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53ae473700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80b3d60 con 0x7f5390004850 2023-10-16T20:07:20.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 0x7f53a815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 0x7f53a815fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59904/0 (socket says 172.21.15.152:59904) 2023-10-16T20:07:20.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 -- 172.21.15.152:0/2677990993 learned_addr learned my addr 172.21.15.152:0/2677990993 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:20.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53aca10700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53a8158210 0x7f53a81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a7fff700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390004850 0x7f53a80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 -- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390004850 msgr2=0x7f53a80b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390004850 0x7f53a80b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 -- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53a8158210 msgr2=0x7f53a81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53a8158210 0x7f53a81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a77fe700 1 -- 172.21.15.152:0/2677990993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80b4040 con 0x7f53a80b3880 2023-10-16T20:07:20.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.037+0000 7f53a7fff700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390004850 0x7f53a80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:20.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.038+0000 7f53a77fe700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 0x7f53a815fd80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5398005040 tx=0x7f5398001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:20.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.038+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398001290 con 0x7f53a80b3880 2023-10-16T20:07:20.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.038+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398007040 con 0x7f53a80b3880 2023-10-16T20:07:20.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.038+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980073d0 con 0x7f53a80b3880 2023-10-16T20:07:20.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.038+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80b4320 con 0x7f53a80b3880 2023-10-16T20:07:20.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.038+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a80b5af0 con 0x7f53a80b3880 2023-10-16T20:07:20.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.039+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a80b4b20 con 0x7f53a80b3880 2023-10-16T20:07:20.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.039+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5398007530 con 0x7f53a80b3880 2023-10-16T20:07:20.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.039+0000 7f53a4ff9700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f539406af30 0x7f539406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.040+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f539808a1b0 con 0x7f53a80b3880 2023-10-16T20:07:20.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.040+0000 7f53a7fff700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f539406af30 0x7f539406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.040+0000 7f53a7fff700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f539406af30 0x7f539406d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f539c009ce0 tx=0x7f539c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:20.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.044+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53a80b4b20 con 0x7f53a80b3880 2023-10-16T20:07:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.240+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f53a80af7d0 con 0x7f53a80b3880 2023-10-16T20:07:20.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.243+0000 7f53a4ff9700 1 -- 172.21.15.152:0/2677990993 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5398055050 con 0x7f53a80b3880 2023-10-16T20:07:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f539406af30 msgr2=0x7f539406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f539406af30 0x7f539406d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f539c009ce0 tx=0x7f539c008040 comp rx=0 tx=0).stop 2023-10-16T20:07:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 msgr2=0x7f53a815fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 0x7f53a815fd80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5398005040 tx=0x7f5398001120 comp rx=0 tx=0).stop 2023-10-16T20:07:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 shutdown_connections 2023-10-16T20:07:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f539406af30 0x7f539406d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5390004850 0x7f53a80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53a8158210 0x7f53a81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 --2- 172.21.15.152:0/2677990993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a80b3880 0x7f53a815fd80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 >> 172.21.15.152:0/2677990993 conn(0x7f53a80d0250 msgr2=0x7f53a80b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:20.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 shutdown_connections 2023-10-16T20:07:20.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.246+0000 7f53ae473700 1 -- 172.21.15.152:0/2677990993 wait complete. 2023-10-16T20:07:20.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T20:07:20.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T20:07:20.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T20:07:20.352 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T20:07:20.352 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:20.353 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:20.370 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:20.371 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:20.428 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:20.428 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:20.485 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:20.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.641+0000 7f007a8bd700 1 Processor -- start 2023-10-16T20:07:20.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.641+0000 7f007a8bd700 1 -- start start 2023-10-16T20:07:20.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.642+0000 7f007a8bd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f00740cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.642+0000 7f007a8bd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f007415e7f0 0x7f007406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.642+0000 7f007a8bd700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740cfeb0 con 0x7f00740ca7d0 2023-10-16T20:07:20.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.642+0000 7f007a8bd700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740ce410 con 0x7f007415e7f0 2023-10-16T20:07:20.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.642+0000 7f007a8bd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007415ec70 con 0x7f007406a820 2023-10-16T20:07:20.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f007415e7f0 0x7f007406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0073fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f00740cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0073fff700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f00740cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:48562/0 (socket says 172.21.15.152:48562) 2023-10-16T20:07:20.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0073fff700 1 -- 172.21.15.152:0/3178264447 learned_addr learned my addr 172.21.15.152:0/3178264447 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:20.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0078e5a700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f00740ca7d0 0x7f0074071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:55292/0 (socket says 172.21.15.152:55292) 2023-10-16T20:07:20.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f007415e7f0 0x7f007406ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:60912/0 (socket says 172.21.15.152:60912) 2023-10-16T20:07:20.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 -- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 msgr2=0x7f00740cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:20.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 --2- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f00740cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 -- 172.21.15.152:0/3178264447 >> v1:172.21.15.163:6789/0 conn(0x7f00740ca7d0 legacy=0x7f0074071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 -- 172.21.15.152:0/3178264447 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740af9d0 con 0x7f007415e7f0 2023-10-16T20:07:20.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0072ffd700 1 -- 172.21.15.152:0/3178264447 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654283174 0 0) 0x7f00740cfeb0 con 0x7f00740ca7d0 2023-10-16T20:07:20.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f00737fe700 1 --2- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f007415e7f0 0x7f007406ac00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f005c009840 tx=0x7f005c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=811001e07f98bc53 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:20.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0072ffd700 1 -- 172.21.15.152:0/3178264447 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c011830 con 0x7f007415e7f0 2023-10-16T20:07:20.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0072ffd700 1 -- 172.21.15.152:0/3178264447 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c011990 con 0x7f007415e7f0 2023-10-16T20:07:20.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.643+0000 7f0072ffd700 1 -- 172.21.15.152:0/3178264447 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c011d20 con 0x7f007415e7f0 2023-10-16T20:07:20.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 -- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f007415e7f0 msgr2=0x7f007406ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 --2- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f007415e7f0 0x7f007406ac00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f005c009840 tx=0x7f005c009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:20.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 -- 172.21.15.152:0/3178264447 shutdown_connections 2023-10-16T20:07:20.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 --2- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f00740cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 --2- 172.21.15.152:0/3178264447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f007415e7f0 0x7f007406ac00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 -- 172.21.15.152:0/3178264447 >> 172.21.15.152:0/3178264447 conn(0x7f00740d0180 msgr2=0x7f00740d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:20.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 -- 172.21.15.152:0/3178264447 shutdown_connections 2023-10-16T20:07:20.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.644+0000 7f007a8bd700 1 -- 172.21.15.152:0/3178264447 wait complete. 2023-10-16T20:07:20.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.645+0000 7f007a8bd700 1 Processor -- start 2023-10-16T20:07:20.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.645+0000 7f007a8bd700 1 -- start start 2023-10-16T20:07:20.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f007a8bd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f0074157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f007a8bd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00740ca7d0 0x7f0074155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f007a8bd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 0x7f00740b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f007a8bd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074156c70 con 0x7f007415e7f0 2023-10-16T20:07:20.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f007a8bd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074155b40 con 0x7f00740ca7d0 2023-10-16T20:07:20.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f007a8bd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00741f72b0 con 0x7f007406a820 2023-10-16T20:07:20.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 0x7f00740b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 0x7f00740b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59920/0 (socket says 172.21.15.152:59920) 2023-10-16T20:07:20.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 -- 172.21.15.152:0/396845457 learned_addr learned my addr 172.21.15.152:0/396845457 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:20.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f00737fe700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00740ca7d0 0x7f0074155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0073fff700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f0074157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 -- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 msgr2=0x7f0074157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f0074157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 -- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00740ca7d0 msgr2=0x7f0074155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00740ca7d0 0x7f0074155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.646+0000 7f0078e5a700 1 -- 172.21.15.152:0/396845457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0094a0 con 0x7f007415e7f0 2023-10-16T20:07:20.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.647+0000 7f0078e5a700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 0x7f00740b08a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f006c00cba0 tx=0x7f006c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:20.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.647+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00aaa0 con 0x7f007415e7f0 2023-10-16T20:07:20.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.647+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00ac00 con 0x7f007415e7f0 2023-10-16T20:07:20.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.647+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00741562d0 con 0x7f007415e7f0 2023-10-16T20:07:20.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.647+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0070d0 con 0x7f007415e7f0 2023-10-16T20:07:20.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.647+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074156890 con 0x7f007415e7f0 2023-10-16T20:07:20.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.648+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074156db0 con 0x7f007415e7f0 2023-10-16T20:07:20.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.648+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f006c007230 con 0x7f007415e7f0 2023-10-16T20:07:20.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.648+0000 7f0070ff9700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f005406af00 0x7f005406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.649+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f006c0895e0 con 0x7f007415e7f0 2023-10-16T20:07:20.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.649+0000 7f0073fff700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f005406af00 0x7f005406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.649+0000 7f0073fff700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f005406af00 0x7f005406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0064009bd0 tx=0x7f00640092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:20.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.653+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0074156db0 con 0x7f007415e7f0 2023-10-16T20:07:20.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.847+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0074156db0 con 0x7f007415e7f0 2023-10-16T20:07:20.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.849+0000 7f0070ff9700 1 -- 172.21.15.152:0/396845457 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f0074156db0 con 0x7f007415e7f0 2023-10-16T20:07:20.852 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:20.852 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:20.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f005406af00 msgr2=0x7f005406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f005406af00 0x7f005406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0064009bd0 tx=0x7f00640092c0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 msgr2=0x7f00740b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 0x7f00740b08a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f006c00cba0 tx=0x7f006c00ceb0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 shutdown_connections 2023-10-16T20:07:20.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f005406af00 0x7f005406d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f007406a820 0x7f0074157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f007415e7f0 0x7f00740b08a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 --2- 172.21.15.152:0/396845457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00740ca7d0 0x7f0074155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 >> 172.21.15.152:0/396845457 conn(0x7f00740d0180 msgr2=0x7f0074071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:20.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 shutdown_connections 2023-10-16T20:07:20.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.851+0000 7f007a8bd700 1 -- 172.21.15.152:0/396845457 wait complete. 2023-10-16T20:07:20.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:20.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:20.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.988+0000 7fc30377f700 1 Processor -- start 2023-10-16T20:07:20.992 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.989+0000 7fc30377f700 1 -- start start 2023-10-16T20:07:20.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.989+0000 7fc30377f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc2fc15b210 0x7fc2fc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.989+0000 7fc30377f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0b3220 con 0x7fc2fc0cf540 2023-10-16T20:07:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.989+0000 7fc30377f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0b34f0 con 0x7fc2fc161f30 2023-10-16T20:07:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.989+0000 7fc30377f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc161240 con 0x7fc2fc15b210 2023-10-16T20:07:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc301d1c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc2fc0cf540 0x7fc2fc15dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40124/0 (socket says 172.21.15.152:40124) 2023-10-16T20:07:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc301d1c700 1 -- 172.21.15.152:0/2617806185 learned_addr learned my addr 172.21.15.152:0/2617806185 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:20.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc30151b700 1 --2- 172.21.15.152:0/2617806185 >> v2:172.21.15.163:3300/0 conn(0x7fc2fc15b210 0x7fc2fc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51893737 0 0) 0x7fc2fc0b3220 con 0x7fc2fc0cf540 2023-10-16T20:07:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e80035b0 con 0x7fc2fc0cf540 2023-10-16T20:07:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532574109 0 0) 0x7fc2e80035b0 con 0x7fc2fc0cf540 2023-10-16T20:07:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 >> v2:172.21.15.163:3300/0 conn(0x7fc2fc15b210 msgr2=0x7fc2fc0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:20.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 --2- 172.21.15.152:0/2617806185 >> v2:172.21.15.163:3300/0 conn(0x7fc2fc15b210 0x7fc2fc0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:20.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 >> v1:172.21.15.163:6789/0 conn(0x7fc2fc161f30 legacy=0x7fc2fc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc161450 con 0x7fc2fc0cf540 2023-10-16T20:07:20.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fc2f40019f0 con 0x7fc2fc0cf540 2023-10-16T20:07:20.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc30151b700 1 --2- 172.21.15.152:0/2617806185 >> v2:172.21.15.163:3300/0 conn(0x7fc2fc15b210 0x7fc2fc0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:20.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 >> v1:172.21.15.152:6789/0 conn(0x7fc2fc0cf540 legacy=0x7fc2fc15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:20.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2e8003a00 0x7fc2e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8004850 0x7fc2e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8005210 0x7fc2e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:20.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc161240 con 0x7fc2e8005210 2023-10-16T20:07:20.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e800c1b0 con 0x7fc2e8004850 2023-10-16T20:07:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e800c370 con 0x7fc2e8003a00 2023-10-16T20:07:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc301d1c700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8005210 0x7fc2e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc300d1a700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8004850 0x7fc2e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.990+0000 7fc30151b700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2e8003a00 0x7fc2e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 -- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2e8003a00 msgr2=0x7fc2e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:21.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2e8003a00 0x7fc2e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 -- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8004850 msgr2=0x7fc2e8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:21.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8004850 0x7fc2e8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 -- 172.21.15.152:0/2617806185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80035b0 con 0x7fc2e8005210 2023-10-16T20:07:21.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 -- 172.21.15.152:0/2617806185 reap_dead start 2023-10-16T20:07:21.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc301d1c700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8005210 0x7fc2e800ba10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400a830 tx=0x7fc2e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2f78caa68b3668 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400a2f0 con 0x7fc2e8005210 2023-10-16T20:07:21.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4012620 con 0x7fc2e8005210 2023-10-16T20:07:21.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc2f3fff700 1 -- 172.21.15.152:0/2617806185 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40129d0 con 0x7fc2e8005210 2023-10-16T20:07:21.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc30377f700 1 -- 172.21.15.152:0/2617806185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8005210 msgr2=0x7fc2e800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc30377f700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8005210 0x7fc2e800ba10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400a830 tx=0x7fc2e8005880 comp rx=0 tx=0).stop 2023-10-16T20:07:21.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc30377f700 1 -- 172.21.15.152:0/2617806185 shutdown_connections 2023-10-16T20:07:21.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc30377f700 1 --2- 172.21.15.152:0/2617806185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2e8005210 0x7fc2e800ba10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc30377f700 1 -- 172.21.15.152:0/2617806185 >> 172.21.15.152:0/2617806185 conn(0x7fc2fc0cdce0 msgr2=0x7fc2fc0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:21.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.991+0000 7fc30377f700 1 -- 172.21.15.152:0/2617806185 shutdown_connections 2023-10-16T20:07:21.003 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.992+0000 7fc30377f700 1 -- 172.21.15.152:0/2617806185 wait complete. 2023-10-16T20:07:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.993+0000 7fc30377f700 1 Processor -- start 2023-10-16T20:07:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.993+0000 7fc30377f700 1 -- start start 2023-10-16T20:07:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30377f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8005210 0x7fc2fc1f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30377f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 0x7fc2fc1f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30377f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2fc1f46d0 0x7fc2fc146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30377f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc144620 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30377f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc1f7590 con 0x7fc2e8005210 2023-10-16T20:07:21.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30377f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc145ab0 con 0x7fc2fc1f46d0 2023-10-16T20:07:21.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 0x7fc2fc1f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 0x7fc2fc1f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59936/0 (socket says 172.21.15.152:59936) 2023-10-16T20:07:21.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 -- 172.21.15.152:0/703180270 learned_addr learned my addr 172.21.15.152:0/703180270 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:21.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc301d1c700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2fc1f46d0 0x7fc2fc146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc30151b700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8005210 0x7fc2fc1f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 -- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2fc1f46d0 msgr2=0x7fc2fc146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2fc1f46d0 0x7fc2fc146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 -- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8005210 msgr2=0x7fc2fc1f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8005210 0x7fc2fc1f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.994+0000 7fc300d1a700 1 -- 172.21.15.152:0/703180270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc143ae0 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.995+0000 7fc300d1a700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 0x7fc2fc1f4190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800f610 tx=0x7fc2f800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.995+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80052e0 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.995+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8005440 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.995+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc143d80 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.995+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80038a0 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.995+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc144340 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.996+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc04ebb0 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.996+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc2f8003a00 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.996+0000 7fc2f1ffb700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc2e006af00 0x7fc2e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.997+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2f8089660 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.997+0000 7fc30151b700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc2e006af00 0x7fc2e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:20.997+0000 7fc30151b700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc2e006af00 0x7fc2e006d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0cc630 tx=0x7fc2ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.001+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc2f8054350 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.193+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2fc06d900 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.193+0000 7fc2f1ffb700 1 -- 172.21.15.152:0/703180270 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2f8003cb0 con 0x7fc2fc0cbee0 2023-10-16T20:07:21.197 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:21.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.195+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc2e006af00 msgr2=0x7fc2e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.195+0000 7fc30377f700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc2e006af00 0x7fc2e006d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0cc630 tx=0x7fc2ec008040 comp rx=0 tx=0).stop 2023-10-16T20:07:21.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.195+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 msgr2=0x7fc2fc1f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.195+0000 7fc30377f700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 0x7fc2fc1f4190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800f610 tx=0x7fc2f800f9d0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 shutdown_connections 2023-10-16T20:07:21.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc2e006af00 0x7fc2e006d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2fc1f46d0 0x7fc2fc146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e8005210 0x7fc2fc1f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 --2- 172.21.15.152:0/703180270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2fc0cbee0 0x7fc2fc1f4190 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 >> 172.21.15.152:0/703180270 conn(0x7fc2fc0cdce0 msgr2=0x7fc2fc158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:21.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 shutdown_connections 2023-10-16T20:07:21.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.196+0000 7fc30377f700 1 -- 172.21.15.152:0/703180270 wait complete. 2023-10-16T20:07:21.211 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 Processor -- start 2023-10-16T20:07:21.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 -- start start 2023-10-16T20:07:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe1b415b470 0x7fe1b40b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe1b40d04e0 0x7fe1b415f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b415fe40 con 0x7fe1b40b2d20 2023-10-16T20:07:21.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40cb970 con 0x7fe1b415b470 2023-10-16T20:07:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.333+0000 7fe1bb13e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40cbc50 con 0x7fe1b40d04e0 2023-10-16T20:07:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe1b415b470 0x7fe1b40b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe1b415b470 0x7fe1b40b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59942/0 (socket says 172.21.15.152:59942) 2023-10-16T20:07:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 -- 172.21.15.152:0/3162411593 learned_addr learned my addr 172.21.15.152:0/3162411593 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b3fff700 1 --2- 172.21.15.152:0/3162411593 >> v2:172.21.15.163:3300/0 conn(0x7fe1b40d04e0 0x7fe1b415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 -- 172.21.15.152:0/3162411593 >> v2:172.21.15.163:3300/0 conn(0x7fe1b40d04e0 msgr2=0x7fe1b415f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 --2- 172.21.15.152:0/3162411593 >> v2:172.21.15.163:3300/0 conn(0x7fe1b40d04e0 0x7fe1b415f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 -- 172.21.15.152:0/3162411593 >> v1:172.21.15.163:6789/0 conn(0x7fe1b40b2d20 legacy=0x7fe1b40d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 -- 172.21.15.152:0/3162411593 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40cbf30 con 0x7fe1b415b470 2023-10-16T20:07:21.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b3fff700 1 --2- 172.21.15.152:0/3162411593 >> v2:172.21.15.163:3300/0 conn(0x7fe1b40d04e0 0x7fe1b415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b8eda700 1 --2- 172.21.15.152:0/3162411593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b40b40b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1b406fbc0 tx=0x7fe1a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8d8f580f492ee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b37fe700 1 -- 172.21.15.152:0/3162411593 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8004230 con 0x7fe1b415b470 2023-10-16T20:07:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b37fe700 1 -- 172.21.15.152:0/3162411593 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8004390 con 0x7fe1b415b470 2023-10-16T20:07:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.334+0000 7fe1b37fe700 1 -- 172.21.15.152:0/3162411593 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80036a0 con 0x7fe1b415b470 2023-10-16T20:07:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 -- 172.21.15.152:0/3162411593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 msgr2=0x7fe1b40b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/3162411593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b40b40b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1b406fbc0 tx=0x7fe1a8009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 -- 172.21.15.152:0/3162411593 shutdown_connections 2023-10-16T20:07:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/3162411593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b40b40b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/3162411593 >> v2:172.21.15.163:3300/0 conn(0x7fe1b40d04e0 0x7fe1b415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 -- 172.21.15.152:0/3162411593 >> 172.21.15.152:0/3162411593 conn(0x7fe1b406a820 msgr2=0x7fe1b406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:21.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 -- 172.21.15.152:0/3162411593 shutdown_connections 2023-10-16T20:07:21.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.335+0000 7fe1bb13e700 1 -- 172.21.15.152:0/3162411593 wait complete. 2023-10-16T20:07:21.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.336+0000 7fe1bb13e700 1 Processor -- start 2023-10-16T20:07:21.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.336+0000 7fe1bb13e700 1 -- start start 2023-10-16T20:07:21.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1bb13e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1b40b2d20 0x7fe1b40affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1bb13e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1b40d04e0 0x7fe1b4157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1bb13e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b4157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1bb13e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b406c4e0 con 0x7fe1b415b470 2023-10-16T20:07:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1bb13e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40cade0 con 0x7fe1b40d04e0 2023-10-16T20:07:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1bb13e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b406b930 con 0x7fe1b40b2d20 2023-10-16T20:07:21.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b4157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b4157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59950/0 (socket says 172.21.15.152:59950) 2023-10-16T20:07:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 -- 172.21.15.152:0/2953342616 learned_addr learned my addr 172.21.15.152:0/2953342616 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b3fff700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1b40d04e0 0x7fe1b4157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b8eda700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1b40b2d20 0x7fe1b40affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 -- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1b40b2d20 msgr2=0x7fe1b40affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1b40b2d20 0x7fe1b40affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 -- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1b40d04e0 msgr2=0x7fe1b4157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1b40d04e0 0x7fe1b4157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 -- 172.21.15.152:0/2953342616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8009550 con 0x7fe1b415b470 2023-10-16T20:07:21.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.337+0000 7fe1b96db700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b4157940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c7a0 tx=0x7fe1ac00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.338+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac003e10 con 0x7fe1b415b470 2023-10-16T20:07:21.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.338+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac005070 con 0x7fe1b415b470 2023-10-16T20:07:21.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.338+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40b04f0 con 0x7fe1b415b470 2023-10-16T20:07:21.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.338+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac005420 con 0x7fe1b415b470 2023-10-16T20:07:21.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.338+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b406be20 con 0x7fe1b415b470 2023-10-16T20:07:21.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.339+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b406c620 con 0x7fe1b415b470 2023-10-16T20:07:21.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.339+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1ac005580 con 0x7fe1b415b470 2023-10-16T20:07:21.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.339+0000 7fe1b17fa700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe19806af00 0x7fe19806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.340+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1ac088f00 con 0x7fe1b415b470 2023-10-16T20:07:21.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.340+0000 7fe1b8eda700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe19806af00 0x7fe19806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.340+0000 7fe1b8eda700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe19806af00 0x7fe19806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009130 tx=0x7fe1a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.344+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1b406c620 con 0x7fe1b415b470 2023-10-16T20:07:21.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.533+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1b406c620 con 0x7fe1b415b470 2023-10-16T20:07:21.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.534+0000 7fe1b17fa700 1 -- 172.21.15.152:0/2953342616 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1b406c620 con 0x7fe1b415b470 2023-10-16T20:07:21.537 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe19806af00 msgr2=0x7fe19806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe19806af00 0x7fe19806d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009130 tx=0x7fe1a8008030 comp rx=0 tx=0).stop 2023-10-16T20:07:21.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 msgr2=0x7fe1b4157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b4157940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c7a0 tx=0x7fe1ac00cab0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 shutdown_connections 2023-10-16T20:07:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe19806af00 0x7fe19806d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe1b40b2d20 0x7fe1b40affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b415b470 0x7fe1b4157940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 --2- 172.21.15.152:0/2953342616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe1b40d04e0 0x7fe1b4157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 >> 172.21.15.152:0/2953342616 conn(0x7fe1b406a820 msgr2=0x7fe1b40d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 shutdown_connections 2023-10-16T20:07:21.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.536+0000 7fe1bb13e700 1 -- 172.21.15.152:0/2953342616 wait complete. 2023-10-16T20:07:21.551 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:21.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.671+0000 7f943765f700 1 Processor -- start 2023-10-16T20:07:21.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.671+0000 7f943765f700 1 -- start start 2023-10-16T20:07:21.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f943765f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f94300ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f943765f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f94300cfab0 0x7f94300b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f943765f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f943006b7c0 0x7f943006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f943765f700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94300b9590 con 0x7f943006b7c0 2023-10-16T20:07:21.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f943765f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943006c190 con 0x7f94300cfab0 2023-10-16T20:07:21.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f943765f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94300cea10 con 0x7f943015d6b0 2023-10-16T20:07:21.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f9435bfc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f943006b7c0 0x7f943006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f9435bfc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f943006b7c0 0x7f943006bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59956/0 (socket says 172.21.15.152:59956) 2023-10-16T20:07:21.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.672+0000 7f9435bfc700 1 -- 172.21.15.152:0/2392374652 learned_addr learned my addr 172.21.15.152:0/2392374652 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:21.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9434bfa700 1 --2- 172.21.15.152:0/2392374652 >> v2:172.21.15.163:3300/0 conn(0x7f94300cfab0 0x7f94300b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f94353fb700 1 --2- 172.21.15.152:0/2392374652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f94300ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9435bfc700 1 -- 172.21.15.152:0/2392374652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 msgr2=0x7f94300ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:21.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9435bfc700 1 --2- 172.21.15.152:0/2392374652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f94300ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9435bfc700 1 -- 172.21.15.152:0/2392374652 >> v2:172.21.15.163:3300/0 conn(0x7f94300cfab0 msgr2=0x7f94300b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:21.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9435bfc700 1 --2- 172.21.15.152:0/2392374652 >> v2:172.21.15.163:3300/0 conn(0x7f94300cfab0 0x7f94300b9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9435bfc700 1 -- 172.21.15.152:0/2392374652 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94300cecf0 con 0x7f943006b7c0 2023-10-16T20:07:21.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9435bfc700 1 --2- 172.21.15.152:0/2392374652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943006bc50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9430072f50 tx=0x7f942800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e2d57f86d4acb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9427fff700 1 -- 172.21.15.152:0/2392374652 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800e070 con 0x7f943006b7c0 2023-10-16T20:07:21.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9427fff700 1 -- 172.21.15.152:0/2392374652 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800b9c0 con 0x7f943006b7c0 2023-10-16T20:07:21.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.673+0000 7f9427fff700 1 -- 172.21.15.152:0/2392374652 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800bd70 con 0x7f943006b7c0 2023-10-16T20:07:21.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 -- 172.21.15.152:0/2392374652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 msgr2=0x7f943006bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 --2- 172.21.15.152:0/2392374652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943006bc50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9430072f50 tx=0x7f942800b330 comp rx=0 tx=0).stop 2023-10-16T20:07:21.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 -- 172.21.15.152:0/2392374652 shutdown_connections 2023-10-16T20:07:21.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 --2- 172.21.15.152:0/2392374652 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f94300ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 --2- 172.21.15.152:0/2392374652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943006bc50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 --2- 172.21.15.152:0/2392374652 >> v2:172.21.15.163:3300/0 conn(0x7f94300cfab0 0x7f94300b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 -- 172.21.15.152:0/2392374652 >> 172.21.15.152:0/2392374652 conn(0x7f9430072340 msgr2=0x7f9430072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:21.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 -- 172.21.15.152:0/2392374652 shutdown_connections 2023-10-16T20:07:21.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.674+0000 7f943765f700 1 -- 172.21.15.152:0/2392374652 wait complete. 2023-10-16T20:07:21.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.675+0000 7f943765f700 1 Processor -- start 2023-10-16T20:07:21.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.675+0000 7f943765f700 1 -- start start 2023-10-16T20:07:21.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94300cfab0 0x7f94301433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f9430144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430144850 con 0x7f943006b7c0 2023-10-16T20:07:21.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430143900 con 0x7f94300cfab0 2023-10-16T20:07:21.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94301451b0 con 0x7f943015d6b0 2023-10-16T20:07:21.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59960/0 (socket says 172.21.15.152:59960) 2023-10-16T20:07:21.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 -- 172.21.15.152:0/3160170494 learned_addr learned my addr 172.21.15.152:0/3160170494 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:21.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f9434bfa700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94300cfab0 0x7f94301433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f9435bfc700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f9430144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 -- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 msgr2=0x7f9430144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f9430144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 -- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94300cfab0 msgr2=0x7f94301433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94300cfab0 0x7f94301433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 -- 172.21.15.152:0/3160170494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428009b30 con 0x7f943006b7c0 2023-10-16T20:07:21.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f94353fb700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943015c0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f942000d800 tx=0x7f942000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200125f0 con 0x7f943006b7c0 2023-10-16T20:07:21.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420012750 con 0x7f943006b7c0 2023-10-16T20:07:21.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9430143bd0 con 0x7f943006b7c0 2023-10-16T20:07:21.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.676+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420012b00 con 0x7f943006b7c0 2023-10-16T20:07:21.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.677+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9430144190 con 0x7f943006b7c0 2023-10-16T20:07:21.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.678+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943004ebb0 con 0x7f943006b7c0 2023-10-16T20:07:21.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.678+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9420012c60 con 0x7f943006b7c0 2023-10-16T20:07:21.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.678+0000 7f9425ffb700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f941406af00 0x7f941406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:21.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.678+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9420089d00 con 0x7f943006b7c0 2023-10-16T20:07:21.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.678+0000 7f9434bfa700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f941406af00 0x7f941406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:21.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.679+0000 7f9434bfa700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f941406af00 0x7f941406d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f94300ccf80 tx=0x7f942c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:21.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.682+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9420054a80 con 0x7f943006b7c0 2023-10-16T20:07:21.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.874+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94300d0780 con 0x7f943006b7c0 2023-10-16T20:07:21.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.874+0000 7f9425ffb700 1 -- 172.21.15.152:0/3160170494 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94200580a0 con 0x7f943006b7c0 2023-10-16T20:07:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:21.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f941406af00 msgr2=0x7f941406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f941406af00 0x7f941406d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f94300ccf80 tx=0x7f942c008040 comp rx=0 tx=0).stop 2023-10-16T20:07:21.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 msgr2=0x7f943015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:21.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943015c0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f942000d800 tx=0x7f942000dbc0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 shutdown_connections 2023-10-16T20:07:21.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f941406af00 0x7f941406d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f943015d6b0 0x7f9430144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f943006b7c0 0x7f943015c0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 --2- 172.21.15.152:0/3160170494 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94300cfab0 0x7f94301433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:21.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 >> 172.21.15.152:0/3160170494 conn(0x7f9430072340 msgr2=0x7f94300b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:21.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 shutdown_connections 2023-10-16T20:07:21.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:21.876+0000 7f943765f700 1 -- 172.21.15.152:0/3160170494 wait complete. 2023-10-16T20:07:21.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:22.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.012+0000 7f84d539d700 1 Processor -- start 2023-10-16T20:07:22.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.013+0000 7f84d539d700 1 -- start start 2023-10-16T20:07:22.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.013+0000 7f84d539d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84d015d630 0x7f84d00ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.013+0000 7f84d539d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f84d00caf20 0x7f84d006b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.013+0000 7f84d539d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d006c1a0 con 0x7f84d006bd70 2023-10-16T20:07:22.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.013+0000 7f84d539d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d00cbdb0 con 0x7f84d015d630 2023-10-16T20:07:22.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.013+0000 7f84d539d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d00cb510 con 0x7f84d00caf20 2023-10-16T20:07:22.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84d015d630 0x7f84d00ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84d4b9c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f84d006bd70 0x7f84d0161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40170/0 (socket says 172.21.15.152:40170) 2023-10-16T20:07:22.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84d015d630 0x7f84d00ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59968/0 (socket says 172.21.15.152:59968) 2023-10-16T20:07:22.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84d4b9c700 1 -- 172.21.15.152:0/1909098113 learned_addr learned my addr 172.21.15.152:0/1909098113 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:22.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cf7fe700 1 --2- 172.21.15.152:0/1909098113 >> v2:172.21.15.163:3300/0 conn(0x7f84d00caf20 0x7f84d006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 -- 172.21.15.152:0/1909098113 >> v2:172.21.15.163:3300/0 conn(0x7f84d00caf20 msgr2=0x7f84d006b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:22.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 --2- 172.21.15.152:0/1909098113 >> v2:172.21.15.163:3300/0 conn(0x7f84d00caf20 0x7f84d006b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 -- 172.21.15.152:0/1909098113 >> v1:172.21.15.152:6789/0 conn(0x7f84d006bd70 legacy=0x7f84d0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 -- 172.21.15.152:0/1909098113 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d00cb7f0 con 0x7f84d015d630 2023-10-16T20:07:22.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84ceffd700 1 -- 172.21.15.152:0/1909098113 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987553949 0 0) 0x7f84d006c1a0 con 0x7f84d006bd70 2023-10-16T20:07:22.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84cffff700 1 --2- 172.21.15.152:0/1909098113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d015d630 0x7f84d00ca9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f84d0074000 tx=0x7f84c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e375af0cf89bfc36 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84ceffd700 1 -- 172.21.15.152:0/1909098113 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011830 con 0x7f84d015d630 2023-10-16T20:07:22.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84ceffd700 1 -- 172.21.15.152:0/1909098113 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c0011990 con 0x7f84d015d630 2023-10-16T20:07:22.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.014+0000 7f84ceffd700 1 -- 172.21.15.152:0/1909098113 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011d20 con 0x7f84d015d630 2023-10-16T20:07:22.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 -- 172.21.15.152:0/1909098113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d015d630 msgr2=0x7f84d00ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 --2- 172.21.15.152:0/1909098113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d015d630 0x7f84d00ca9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f84d0074000 tx=0x7f84c0009b20 comp rx=0 tx=0).stop 2023-10-16T20:07:22.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 -- 172.21.15.152:0/1909098113 shutdown_connections 2023-10-16T20:07:22.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 --2- 172.21.15.152:0/1909098113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d015d630 0x7f84d00ca9e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 --2- 172.21.15.152:0/1909098113 >> v2:172.21.15.163:3300/0 conn(0x7f84d00caf20 0x7f84d006b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 -- 172.21.15.152:0/1909098113 >> 172.21.15.152:0/1909098113 conn(0x7f84d0070f30 msgr2=0x7f84d0071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:22.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 -- 172.21.15.152:0/1909098113 shutdown_connections 2023-10-16T20:07:22.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.015+0000 7f84d539d700 1 -- 172.21.15.152:0/1909098113 wait complete. 2023-10-16T20:07:22.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.016+0000 7f84d539d700 1 Processor -- start 2023-10-16T20:07:22.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.016+0000 7f84d539d700 1 -- start start 2023-10-16T20:07:22.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d539d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 0x7f84d01510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d539d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84d00caf20 0x7f84d00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d539d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84d015d630 0x7f84d015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d539d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01515f0 con 0x7f84d006bd70 2023-10-16T20:07:22.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d539d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00b3a20 con 0x7f84d00caf20 2023-10-16T20:07:22.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d539d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d00b2e10 con 0x7f84d015d630 2023-10-16T20:07:22.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 0x7f84d01510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 0x7f84d01510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59974/0 (socket says 172.21.15.152:59974) 2023-10-16T20:07:22.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 -- 172.21.15.152:0/42283159 learned_addr learned my addr 172.21.15.152:0/42283159 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:22.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cf7fe700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84d00caf20 0x7f84d00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84d4b9c700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84d015d630 0x7f84d015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 -- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84d015d630 msgr2=0x7f84d015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84d015d630 0x7f84d015bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 -- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84d00caf20 msgr2=0x7f84d00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84d00caf20 0x7f84d00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 -- 172.21.15.152:0/42283159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00094a0 con 0x7f84d006bd70 2023-10-16T20:07:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cf7fe700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84d00caf20 0x7f84d00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.017+0000 7f84cffff700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 0x7f84d01510b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f84c0014040 tx=0x7f84c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.018+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00038a0 con 0x7f84d006bd70 2023-10-16T20:07:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.018+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c001e070 con 0x7f84d006bd70 2023-10-16T20:07:22.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.018+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0003c20 con 0x7f84d006bd70 2023-10-16T20:07:22.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.018+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d00b30f0 con 0x7f84d006bd70 2023-10-16T20:07:22.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.018+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d00b36b0 con 0x7f84d006bd70 2023-10-16T20:07:22.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.019+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d00b3840 con 0x7f84d006bd70 2023-10-16T20:07:22.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.019+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f84c002d450 con 0x7f84d006bd70 2023-10-16T20:07:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.019+0000 7f84ccff9700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f84bc06af00 0x7f84bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.020+0000 7f84cf7fe700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f84bc06af00 0x7f84bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.020+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f84c008a9d0 con 0x7f84d006bd70 2023-10-16T20:07:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.020+0000 7f84cf7fe700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f84bc06af00 0x7f84bc06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84d015a7b0 tx=0x7f84c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.024+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84c0055750 con 0x7f84d006bd70 2023-10-16T20:07:22.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.212+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f84d00743d0 con 0x7f84d006bd70 2023-10-16T20:07:22.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.213+0000 7f84ccff9700 1 -- 172.21.15.152:0/42283159 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f84c00200a0 con 0x7f84d006bd70 2023-10-16T20:07:22.216 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:22.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f84bc06af00 msgr2=0x7f84bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f84bc06af00 0x7f84bc06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84d015a7b0 tx=0x7f84c4008040 comp rx=0 tx=0).stop 2023-10-16T20:07:22.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 msgr2=0x7f84d01510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 0x7f84d01510b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f84c0014040 tx=0x7f84c0004750 comp rx=0 tx=0).stop 2023-10-16T20:07:22.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 shutdown_connections 2023-10-16T20:07:22.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f84bc06af00 0x7f84bc06d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f84d015d630 0x7f84d015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d006bd70 0x7f84d01510b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 --2- 172.21.15.152:0/42283159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f84d00caf20 0x7f84d00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 >> 172.21.15.152:0/42283159 conn(0x7f84d0070f30 msgr2=0x7f84d006e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:22.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 shutdown_connections 2023-10-16T20:07:22.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.215+0000 7f84d539d700 1 -- 172.21.15.152:0/42283159 wait complete. 2023-10-16T20:07:22.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:07:22.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 Processor -- start 2023-10-16T20:07:22.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 -- start start 2023-10-16T20:07:22.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1d9406a820 0x7f1d940ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d940cc310 0x7f1d9406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940726b0 con 0x7f1d940cdd50 2023-10-16T20:07:22.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940cc7a0 con 0x7f1d9406a820 2023-10-16T20:07:22.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.350+0000 7f1d99f1a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9415ca20 con 0x7f1d940cc310 2023-10-16T20:07:22.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1d9406a820 0x7f1d940ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1d9406a820 0x7f1d940ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59982/0 (socket says 172.21.15.152:59982) 2023-10-16T20:07:22.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 -- 172.21.15.152:0/901820553 learned_addr learned my addr 172.21.15.152:0/901820553 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:22.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d92ffd700 1 --2- 172.21.15.152:0/901820553 >> v2:172.21.15.163:3300/0 conn(0x7f1d940cc310 0x7f1d9406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 -- 172.21.15.152:0/901820553 >> v2:172.21.15.163:3300/0 conn(0x7f1d940cc310 msgr2=0x7f1d9406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:22.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 --2- 172.21.15.152:0/901820553 >> v2:172.21.15.163:3300/0 conn(0x7f1d940cc310 0x7f1d9406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 -- 172.21.15.152:0/901820553 >> v1:172.21.15.163:6789/0 conn(0x7f1d940cdd50 legacy=0x7f1d940ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 -- 172.21.15.152:0/901820553 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9406b140 con 0x7f1d9406a820 2023-10-16T20:07:22.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d937fe700 1 --2- 172.21.15.152:0/901820553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d9406a820 0x7f1d940ca7d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1d940afbb0 tx=0x7f1d84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fccd1b2a084b005 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d927fc700 1 -- 172.21.15.152:0/901820553 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400b870 con 0x7f1d9406a820 2023-10-16T20:07:22.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d927fc700 1 -- 172.21.15.152:0/901820553 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400b9d0 con 0x7f1d9406a820 2023-10-16T20:07:22.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.351+0000 7f1d927fc700 1 -- 172.21.15.152:0/901820553 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400bd60 con 0x7f1d9406a820 2023-10-16T20:07:22.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 -- 172.21.15.152:0/901820553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d9406a820 msgr2=0x7f1d940ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/901820553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d9406a820 0x7f1d940ca7d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1d940afbb0 tx=0x7f1d84009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 -- 172.21.15.152:0/901820553 shutdown_connections 2023-10-16T20:07:22.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/901820553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d9406a820 0x7f1d940ca7d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/901820553 >> v2:172.21.15.163:3300/0 conn(0x7f1d940cc310 0x7f1d9406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 -- 172.21.15.152:0/901820553 >> 172.21.15.152:0/901820553 conn(0x7f1d940d0180 msgr2=0x7f1d940d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:22.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 -- 172.21.15.152:0/901820553 shutdown_connections 2023-10-16T20:07:22.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.352+0000 7f1d99f1a700 1 -- 172.21.15.152:0/901820553 wait complete. 2023-10-16T20:07:22.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.353+0000 7f1d99f1a700 1 Processor -- start 2023-10-16T20:07:22.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.353+0000 7f1d99f1a700 1 -- start start 2023-10-16T20:07:22.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d99f1a700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d9406a820 0x7f1d9415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d99f1a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d940cc310 0x7f1d94157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d99f1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 0x7f1d940c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d99f1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9406e5f0 con 0x7f1d940cdd50 2023-10-16T20:07:22.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d99f1a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9406e8d0 con 0x7f1d940cc310 2023-10-16T20:07:22.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d99f1a700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9406ebb0 con 0x7f1d9406a820 2023-10-16T20:07:22.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 0x7f1d940c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 0x7f1d940c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59992/0 (socket says 172.21.15.152:59992) 2023-10-16T20:07:22.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 -- 172.21.15.152:0/2673299479 learned_addr learned my addr 172.21.15.152:0/2673299479 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:22.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d937fe700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d9406a820 0x7f1d9415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d92ffd700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d940cc310 0x7f1d94157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 -- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d9406a820 msgr2=0x7f1d9415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d9406a820 0x7f1d9415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 -- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d940cc310 msgr2=0x7f1d94157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d940cc310 0x7f1d94157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 -- 172.21.15.152:0/2673299479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d84009550 con 0x7f1d940cdd50 2023-10-16T20:07:22.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.354+0000 7f1d93fff700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 0x7f1d940c4750 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00caf0 tx=0x7f1d8c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.355+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c003c50 con 0x7f1d940cdd50 2023-10-16T20:07:22.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.355+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c003dd0 con 0x7f1d940cdd50 2023-10-16T20:07:22.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.355+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9415b4c0 con 0x7f1d940cdd50 2023-10-16T20:07:22.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.355+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00aa20 con 0x7f1d940cdd50 2023-10-16T20:07:22.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.355+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d94157ff0 con 0x7f1d940cdd50 2023-10-16T20:07:22.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.356+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9415b9e0 con 0x7f1d940cdd50 2023-10-16T20:07:22.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.356+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d8c00ab80 con 0x7f1d940cdd50 2023-10-16T20:07:22.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.356+0000 7f1d8bfff700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d7406af00 0x7f1d7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.356+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d8c089820 con 0x7f1d940cdd50 2023-10-16T20:07:22.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.356+0000 7f1d937fe700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d7406af00 0x7f1d7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.357+0000 7f1d937fe700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d7406af00 0x7f1d7406d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000c00 tx=0x7f1d84008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.361+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d9415b9e0 con 0x7f1d940cdd50 2023-10-16T20:07:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.566+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1d9415b9e0 con 0x7f1d940cdd50 2023-10-16T20:07:22.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.567+0000 7f1d8bfff700 1 -- 172.21.15.152:0/2673299479 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1d9415b9e0 con 0x7f1d940cdd50 2023-10-16T20:07:22.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d7406af00 msgr2=0x7f1d7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d7406af00 0x7f1d7406d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000c00 tx=0x7f1d84008030 comp rx=0 tx=0).stop 2023-10-16T20:07:22.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 msgr2=0x7f1d940c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 0x7f1d940c4750 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00caf0 tx=0x7f1d8c00ce00 comp rx=0 tx=0).stop 2023-10-16T20:07:22.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 shutdown_connections 2023-10-16T20:07:22.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d7406af00 0x7f1d7406d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d9406a820 0x7f1d9415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d940cdd50 0x7f1d940c4750 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.573 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 --2- 172.21.15.152:0/2673299479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d940cc310 0x7f1d94157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 >> 172.21.15.152:0/2673299479 conn(0x7f1d940d0180 msgr2=0x7f1d940b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:22.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 shutdown_connections 2023-10-16T20:07:22.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.569+0000 7f1d99f1a700 1 -- 172.21.15.152:0/2673299479 wait complete. 2023-10-16T20:07:22.574 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2023-10-16T20:07:22.584 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-16T20:07:22.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:22.584 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-16T20:07:22.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:07:22.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:22.631 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T20:07:22.648 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:22.649 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:22.670 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:22.671 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:22.731 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:22.732 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:22.791 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:22.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.910+0000 7f948c6cf700 1 Processor -- start 2023-10-16T20:07:22.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.910+0000 7f948c6cf700 1 -- start start 2023-10-16T20:07:22.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948c6cf700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f948415b630 0x7f9484071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948c6cf700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9484072a10 0x7f948406a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948c6cf700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94840b2fc0 con 0x7f948415b250 2023-10-16T20:07:22.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948c6cf700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94840c3b40 con 0x7f9484072a10 2023-10-16T20:07:22.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948c6cf700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840cc900 con 0x7f948415b630 2023-10-16T20:07:22.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948a46b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f948415b250 0x7f94840717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40194/0 (socket says 172.21.15.152:40194) 2023-10-16T20:07:22.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948a46b700 1 -- 172.21.15.152:0/2965196791 learned_addr learned my addr 172.21.15.152:0/2965196791 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:22.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.911+0000 7f948ac6c700 1 --2- 172.21.15.152:0/2965196791 >> v2:172.21.15.152:3300/0 conn(0x7f9484072a10 0x7f948406a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489469700 1 -- 172.21.15.152:0/2965196791 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391362613 0 0) 0x7f94840b2fc0 con 0x7f948415b250 2023-10-16T20:07:22.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489469700 1 -- 172.21.15.152:0/2965196791 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94700035b0 con 0x7f948415b250 2023-10-16T20:07:22.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f948ac6c700 1 -- 172.21.15.152:0/2965196791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f948415b630 msgr2=0x7f9484071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:22.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489c6a700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f948415b630 0x7f9484071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f948ac6c700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f948415b630 0x7f9484071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f948ac6c700 1 -- 172.21.15.152:0/2965196791 >> v1:172.21.15.152:6789/0 conn(0x7f948415b250 legacy=0x7f94840717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f948ac6c700 1 -- 172.21.15.152:0/2965196791 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948415f920 con 0x7f9484072a10 2023-10-16T20:07:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489c6a700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f948415b630 0x7f9484071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f948ac6c700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484072a10 0x7f948406a820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f947c009d90 tx=0x7f947c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6bd1f5a39f682b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489469700 1 -- 172.21.15.152:0/2965196791 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00e070 con 0x7f9484072a10 2023-10-16T20:07:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489469700 1 -- 172.21.15.152:0/2965196791 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00bb20 con 0x7f9484072a10 2023-10-16T20:07:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.912+0000 7f9489469700 1 -- 172.21.15.152:0/2965196791 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c012430 con 0x7f9484072a10 2023-10-16T20:07:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 -- 172.21.15.152:0/2965196791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484072a10 msgr2=0x7f948406a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484072a10 0x7f948406a820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f947c009d90 tx=0x7f947c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:22.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 -- 172.21.15.152:0/2965196791 shutdown_connections 2023-10-16T20:07:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9484072a10 0x7f948406a820 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 --2- 172.21.15.152:0/2965196791 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f948415b630 0x7f9484071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 -- 172.21.15.152:0/2965196791 >> 172.21.15.152:0/2965196791 conn(0x7f94840b1c60 msgr2=0x7f94840b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 -- 172.21.15.152:0/2965196791 shutdown_connections 2023-10-16T20:07:22.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.913+0000 7f948c6cf700 1 -- 172.21.15.152:0/2965196791 wait complete. 2023-10-16T20:07:22.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.914+0000 7f948c6cf700 1 Processor -- start 2023-10-16T20:07:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.914+0000 7f948c6cf700 1 -- start start 2023-10-16T20:07:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9484072a10 0x7f94841f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f948415b250 0x7f9484159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 0x7f9484159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c52e0 con 0x7f948415b630 2023-10-16T20:07:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c46d0 con 0x7f948415b250 2023-10-16T20:07:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c49b0 con 0x7f9484072a10 2023-10-16T20:07:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 0x7f9484159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 0x7f9484159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60006/0 (socket says 172.21.15.152:60006) 2023-10-16T20:07:22.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 -- 172.21.15.152:0/1316004423 learned_addr learned my addr 172.21.15.152:0/1316004423 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 -- 172.21.15.152:0/1316004423 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9484072a10 msgr2=0x7f94841f0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9484072a10 0x7f94841f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 -- 172.21.15.152:0/1316004423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f948415b250 msgr2=0x7f9484159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f948415b250 0x7f9484159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 -- 172.21.15.152:0/1316004423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009a70 con 0x7f948415b630 2023-10-16T20:07:22.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948ac6c700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 0x7f9484159760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f947c014040 tx=0x7f947c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c012430 con 0x7f948415b630 2023-10-16T20:07:22.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c020070 con 0x7f948415b630 2023-10-16T20:07:22.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94840c4c90 con 0x7f948415b630 2023-10-16T20:07:22.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c004280 con 0x7f948415b630 2023-10-16T20:07:22.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.915+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94841f0a50 con 0x7f948415b630 2023-10-16T20:07:22.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.916+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94840b60c0 con 0x7f948415b630 2023-10-16T20:07:22.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.917+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f947c0043e0 con 0x7f948415b630 2023-10-16T20:07:22.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.917+0000 7f947affd700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f946806af00 0x7f946806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:22.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.917+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f947c022070 con 0x7f948415b630 2023-10-16T20:07:22.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.917+0000 7f948a46b700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f946806af00 0x7f946806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.917+0000 7f948a46b700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f946806af00 0x7f946806d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9480007fd0 tx=0x7f9480007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:22.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:22.921+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f947c0568e0 con 0x7f948415b630 2023-10-16T20:07:23.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.112+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f948404ebb0 con 0x7f948415b630 2023-10-16T20:07:23.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.114+0000 7f947affd700 1 -- 172.21.15.152:0/1316004423 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f947c059f00 con 0x7f948415b630 2023-10-16T20:07:23.117 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:23.117 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:23.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f946806af00 msgr2=0x7f946806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f946806af00 0x7f946806d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9480007fd0 tx=0x7f9480007980 comp rx=0 tx=0).stop 2023-10-16T20:07:23.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 msgr2=0x7f9484159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 0x7f9484159760 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f947c014040 tx=0x7f947c004ad0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 shutdown_connections 2023-10-16T20:07:23.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f946806af00 0x7f946806d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9484072a10 0x7f94841f0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f948415b630 0x7f9484159760 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 --2- 172.21.15.152:0/1316004423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f948415b250 0x7f9484159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 >> 172.21.15.152:0/1316004423 conn(0x7f94840b1c60 msgr2=0x7f94840ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:23.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 shutdown_connections 2023-10-16T20:07:23.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.116+0000 7f948c6cf700 1 -- 172.21.15.152:0/1316004423 wait complete. 2023-10-16T20:07:23.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:23.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.253+0000 7ff3257c5700 1 Processor -- start 2023-10-16T20:07:23.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.253+0000 7ff3257c5700 1 -- start start 2023-10-16T20:07:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff3257c5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff32015d760 0x7ff3200b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff3257c5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff32006b7e0 0x7ff32006bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff3257c5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3200cf420 con 0x7ff3200ce0a0 2023-10-16T20:07:23.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff3257c5700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200b95a0 con 0x7ff32015d760 2023-10-16T20:07:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff3257c5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32006c190 con 0x7ff32006b7e0 2023-10-16T20:07:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff32015d760 0x7ff3200b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff32015d760 0x7ff3200b9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60010/0 (socket says 172.21.15.152:60010) 2023-10-16T20:07:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 -- 172.21.15.152:0/2777272262 learned_addr learned my addr 172.21.15.152:0/2777272262 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:23.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31f7fe700 1 --2- 172.21.15.152:0/2777272262 >> v2:172.21.15.163:3300/0 conn(0x7ff32006b7e0 0x7ff32006bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 -- 172.21.15.152:0/2777272262 >> v2:172.21.15.163:3300/0 conn(0x7ff32006b7e0 msgr2=0x7ff32006bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 --2- 172.21.15.152:0/2777272262 >> v2:172.21.15.163:3300/0 conn(0x7ff32006b7e0 0x7ff32006bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 -- 172.21.15.152:0/2777272262 >> v1:172.21.15.163:6789/0 conn(0x7ff3200ce0a0 legacy=0x7ff3200cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.254+0000 7ff31effd700 1 -- 172.21.15.152:0/2777272262 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200ce810 con 0x7ff32015d760 2023-10-16T20:07:23.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff31effd700 1 --2- 172.21.15.152:0/2777272262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff32015d760 0x7ff3200b9060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b6430 tx=0x7ff314009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4cd19829776547 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff31dffb700 1 -- 172.21.15.152:0/2777272262 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400b860 con 0x7ff32015d760 2023-10-16T20:07:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff31dffb700 1 -- 172.21.15.152:0/2777272262 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400b9c0 con 0x7ff32015d760 2023-10-16T20:07:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff31dffb700 1 -- 172.21.15.152:0/2777272262 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400bd50 con 0x7ff32015d760 2023-10-16T20:07:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 -- 172.21.15.152:0/2777272262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff32015d760 msgr2=0x7ff3200b9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2777272262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff32015d760 0x7ff3200b9060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b6430 tx=0x7ff314009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 -- 172.21.15.152:0/2777272262 shutdown_connections 2023-10-16T20:07:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2777272262 >> v2:172.21.15.163:3300/0 conn(0x7ff32006b7e0 0x7ff32006bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2777272262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff32015d760 0x7ff3200b9060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 -- 172.21.15.152:0/2777272262 >> 172.21.15.152:0/2777272262 conn(0x7ff320072340 msgr2=0x7ff320072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:23.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 -- 172.21.15.152:0/2777272262 shutdown_connections 2023-10-16T20:07:23.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.255+0000 7ff3257c5700 1 -- 172.21.15.152:0/2777272262 wait complete. 2023-10-16T20:07:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 Processor -- start 2023-10-16T20:07:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 -- start start 2023-10-16T20:07:23.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32006b7e0 0x7ff32015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 0x7ff320160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff32015d760 0x7ff320150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320160240 con 0x7ff3200ce0a0 2023-10-16T20:07:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32015f600 con 0x7ff32006b7e0 2023-10-16T20:07:23.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.257+0000 7ff3257c5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32015f8a0 con 0x7ff32015d760 2023-10-16T20:07:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 0x7ff320160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 0x7ff320160660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60018/0 (socket says 172.21.15.152:60018) 2023-10-16T20:07:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 -- 172.21.15.152:0/2185620607 learned_addr learned my addr 172.21.15.152:0/2185620607 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31effd700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32006b7e0 0x7ff32015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31f7fe700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff32015d760 0x7ff320150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 -- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff32015d760 msgr2=0x7ff320150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff32015d760 0x7ff320150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 -- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32006b7e0 msgr2=0x7ff32015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32006b7e0 0x7ff32015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 -- 172.21.15.152:0/2185620607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314009550 con 0x7ff3200ce0a0 2023-10-16T20:07:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff31e7fc700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 0x7ff320160660 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c4e0 tx=0x7ff31000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100052d0 con 0x7ff3200ce0a0 2023-10-16T20:07:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310005430 con 0x7ff3200ce0a0 2023-10-16T20:07:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32015fb80 con 0x7ff3200ce0a0 2023-10-16T20:07:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100038c0 con 0x7ff3200ce0a0 2023-10-16T20:07:23.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.258+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff320150d40 con 0x7ff3200ce0a0 2023-10-16T20:07:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.259+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff320160380 con 0x7ff3200ce0a0 2023-10-16T20:07:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.260+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff310003a20 con 0x7ff3200ce0a0 2023-10-16T20:07:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.260+0000 7ff3077fe700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff30c06af00 0x7ff30c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.260+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff310088de0 con 0x7ff3200ce0a0 2023-10-16T20:07:23.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.260+0000 7ff31effd700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff30c06af00 0x7ff30c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.260+0000 7ff31effd700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff30c06af00 0x7ff30c06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff314009c40 tx=0x7ff314008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.264+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff320160380 con 0x7ff3200ce0a0 2023-10-16T20:07:23.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.454+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff320160380 con 0x7ff3200ce0a0 2023-10-16T20:07:23.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.454+0000 7ff3077fe700 1 -- 172.21.15.152:0/2185620607 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff320160380 con 0x7ff3200ce0a0 2023-10-16T20:07:23.458 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:23.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff30c06af00 msgr2=0x7ff30c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff30c06af00 0x7ff30c06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff314009c40 tx=0x7ff314008030 comp rx=0 tx=0).stop 2023-10-16T20:07:23.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 msgr2=0x7ff320160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 0x7ff320160660 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c4e0 tx=0x7ff31000c8a0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 shutdown_connections 2023-10-16T20:07:23.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff30c06af00 0x7ff30c06d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff32015d760 0x7ff320150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff32006b7e0 0x7ff32015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 --2- 172.21.15.152:0/2185620607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200ce0a0 0x7ff320160660 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 >> 172.21.15.152:0/2185620607 conn(0x7ff320072340 msgr2=0x7ff3200c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 shutdown_connections 2023-10-16T20:07:23.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.456+0000 7ff3257c5700 1 -- 172.21.15.152:0/2185620607 wait complete. 2023-10-16T20:07:23.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.592+0000 7f76f796f700 1 Processor -- start 2023-10-16T20:07:23.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.592+0000 7f76f796f700 1 -- start start 2023-10-16T20:07:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f796f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f76f00ce440 0x7f76f015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f796f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f0161360 con 0x7f76f006a820 2023-10-16T20:07:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f796f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f006b750 con 0x7f76f006b370 2023-10-16T20:07:23.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f796f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f006dcc0 con 0x7f76f00ce440 2023-10-16T20:07:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f4f0a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76f006a820 0x7f76f00cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40224/0 (socket says 172.21.15.152:40224) 2023-10-16T20:07:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f4f0a700 1 -- 172.21.15.152:0/431831132 learned_addr learned my addr 172.21.15.152:0/431831132 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886984801 0 0) 0x7f76f0161360 con 0x7f76f006a820 2023-10-16T20:07:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76dc0035b0 con 0x7f76f006a820 2023-10-16T20:07:23.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f5f0c700 1 --2- 172.21.15.152:0/431831132 >> v2:172.21.15.163:3300/0 conn(0x7f76f00ce440 0x7f76f015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103641815 0 0) 0x7f76dc0035b0 con 0x7f76f006a820 2023-10-16T20:07:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 >> v2:172.21.15.163:3300/0 conn(0x7f76f00ce440 msgr2=0x7f76f015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 --2- 172.21.15.152:0/431831132 >> v2:172.21.15.163:3300/0 conn(0x7f76f00ce440 0x7f76f015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 >> v1:172.21.15.163:6789/0 conn(0x7f76f006b370 legacy=0x7f76f006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f015e300 con 0x7f76f006a820 2023-10-16T20:07:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f76e0001670 con 0x7f76f006a820 2023-10-16T20:07:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76f5f0c700 1 --2- 172.21.15.152:0/431831132 >> v2:172.21.15.163:3300/0 conn(0x7f76f00ce440 0x7f76f015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 >> v1:172.21.15.152:6789/0 conn(0x7f76f006a820 legacy=0x7f76f00cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.593+0000 7f76e7fff700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc003a30 0x7f76dc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc004850 0x7f76dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76dc005260 0x7f76dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f006dcc0 con 0x7f76dc003a30 2023-10-16T20:07:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc00c190 con 0x7f76dc004850 2023-10-16T20:07:23.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc00c350 con 0x7f76dc005260 2023-10-16T20:07:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc003a30 0x7f76dc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f4f0a700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc004850 0x7f76dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f5f0c700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76dc005260 0x7f76dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 -- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76dc005260 msgr2=0x7f76dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76dc005260 0x7f76dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 -- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc004850 msgr2=0x7f76dc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc004850 0x7f76dc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f5f0c700 1 -- 172.21.15.152:0/431831132 reap_dead start 2023-10-16T20:07:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 -- 172.21.15.152:0/431831132 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0035b0 con 0x7f76dc003a30 2023-10-16T20:07:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76f570b700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc003a30 0x7f76dc003e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007fd0 tx=0x7f76dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84b66b67b5e7232 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0052d0 con 0x7f76dc003a30 2023-10-16T20:07:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec005430 con 0x7f76dc003a30 2023-10-16T20:07:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.594+0000 7f76e7fff700 1 -- 172.21.15.152:0/431831132 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0038c0 con 0x7f76dc003a30 2023-10-16T20:07:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 -- 172.21.15.152:0/431831132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc003a30 msgr2=0x7f76dc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc003a30 0x7f76dc003e50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007fd0 tx=0x7f76dc005880 comp rx=0 tx=0).stop 2023-10-16T20:07:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 -- 172.21.15.152:0/431831132 shutdown_connections 2023-10-16T20:07:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 --2- 172.21.15.152:0/431831132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc003a30 0x7f76dc003e50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 -- 172.21.15.152:0/431831132 >> 172.21.15.152:0/431831132 conn(0x7f76f00ccbe0 msgr2=0x7f76f00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 -- 172.21.15.152:0/431831132 shutdown_connections 2023-10-16T20:07:23.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.595+0000 7f76f796f700 1 -- 172.21.15.152:0/431831132 wait complete. 2023-10-16T20:07:23.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.596+0000 7f76f796f700 1 Processor -- start 2023-10-16T20:07:23.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.596+0000 7f76f796f700 1 -- start start 2023-10-16T20:07:23.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc003a30 0x7f76f00c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 0x7f76f0158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76f01590b0 0x7f76f0159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0159a80 con 0x7f76f014a9d0 2023-10-16T20:07:23.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f014a540 con 0x7f76dc003a30 2023-10-16T20:07:23.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0149930 con 0x7f76f01590b0 2023-10-16T20:07:23.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 0x7f76f0158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 0x7f76f0158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60038/0 (socket says 172.21.15.152:60038) 2023-10-16T20:07:23.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 -- 172.21.15.152:0/1730521217 learned_addr learned my addr 172.21.15.152:0/1730521217 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:23.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f570b700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc003a30 0x7f76f00c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f5f0c700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76f01590b0 0x7f76f0159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 -- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76f01590b0 msgr2=0x7f76f0159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76f01590b0 0x7f76f0159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 -- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc003a30 msgr2=0x7f76f00c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc003a30 0x7f76f00c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 -- 172.21.15.152:0/1730521217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0149c10 con 0x7f76f014a9d0 2023-10-16T20:07:23.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f4f0a700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 0x7f76f0158370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f76e00072f0 tx=0x7f76e0007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0011580 con 0x7f76f014a9d0 2023-10-16T20:07:23.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0011700 con 0x7f76f014a9d0 2023-10-16T20:07:23.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0149ef0 con 0x7f76f014a9d0 2023-10-16T20:07:23.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.597+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0011ab0 con 0x7f76f014a9d0 2023-10-16T20:07:23.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.598+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f00c69c0 con 0x7f76f014a9d0 2023-10-16T20:07:23.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.599+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f0072d10 con 0x7f76f014a9d0 2023-10-16T20:07:23.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.599+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f76e0011c10 con 0x7f76f014a9d0 2023-10-16T20:07:23.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.599+0000 7f76e5ffb700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76d406af00 0x7f76d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.599+0000 7f76f570b700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76d406af00 0x7f76d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.599+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76e0089860 con 0x7f76f014a9d0 2023-10-16T20:07:23.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.600+0000 7f76f570b700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76d406af00 0x7f76d406d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.604+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76e0054550 con 0x7f76f014a9d0 2023-10-16T20:07:23.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.792+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76f004ebb0 con 0x7f76f014a9d0 2023-10-16T20:07:23.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.792+0000 7f76e5ffb700 1 -- 172.21.15.152:0/1730521217 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76e0057b70 con 0x7f76f014a9d0 2023-10-16T20:07:23.796 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:23.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76d406af00 msgr2=0x7f76d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76d406af00 0x7f76d406d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec009030 comp rx=0 tx=0).stop 2023-10-16T20:07:23.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 msgr2=0x7f76f0158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 0x7f76f0158370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f76e00072f0 tx=0x7f76e0007600 comp rx=0 tx=0).stop 2023-10-16T20:07:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 shutdown_connections 2023-10-16T20:07:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76d406af00 0x7f76d406d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76f01590b0 0x7f76f0159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76dc003a30 0x7f76f00c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 --2- 172.21.15.152:0/1730521217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76f014a9d0 0x7f76f0158370 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 >> 172.21.15.152:0/1730521217 conn(0x7f76f00ccbe0 msgr2=0x7f76f015d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 shutdown_connections 2023-10-16T20:07:23.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.795+0000 7f76f796f700 1 -- 172.21.15.152:0/1730521217 wait complete. 2023-10-16T20:07:23.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:23.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.931+0000 7f75b1972700 1 Processor -- start 2023-10-16T20:07:23.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.931+0000 7f75b1972700 1 -- start start 2023-10-16T20:07:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75b1972700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f75ac15a250 0x7f75ac0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75b1972700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 0x7f75ac0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75b1972700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0cba90 con 0x7f75ac15dec0 2023-10-16T20:07:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75b1972700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0cb510 con 0x7f75ac15a250 2023-10-16T20:07:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75b1972700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac15ee40 con 0x7f75ac06dcc0 2023-10-16T20:07:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75aa7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f75ac15dec0 0x7f75ac06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40244/0 (socket says 172.21.15.152:40244) 2023-10-16T20:07:23.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75aa7fc700 1 -- 172.21.15.152:0/4150648316 learned_addr learned my addr 172.21.15.152:0/4150648316 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682545482 0 0) 0x7f75ac0cba90 con 0x7f75ac15dec0 2023-10-16T20:07:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75ab7fe700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 0x7f75ac0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75aaffd700 1 --2- 172.21.15.152:0/4150648316 >> v2:172.21.15.163:3300/0 conn(0x7f75ac15a250 0x7f75ac0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.932+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75940035b0 con 0x7f75ac15dec0 2023-10-16T20:07:23.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658230076 0 0) 0x7f75940035b0 con 0x7f75ac15dec0 2023-10-16T20:07:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 msgr2=0x7f75ac0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 0x7f75ac0cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 >> v2:172.21.15.163:3300/0 conn(0x7f75ac15a250 msgr2=0x7f75ac0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 --2- 172.21.15.152:0/4150648316 >> v2:172.21.15.163:3300/0 conn(0x7f75ac15a250 0x7f75ac0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac15e880 con 0x7f75ac15dec0 2023-10-16T20:07:23.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f759c001670 con 0x7f75ac15dec0 2023-10-16T20:07:23.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 >> v1:172.21.15.152:6789/0 conn(0x7f75ac15dec0 legacy=0x7f75ac06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7594003a00 0x7f7594003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 0x7f7594004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f7594005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0cb510 con 0x7f7594004d90 2023-10-16T20:07:23.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac15ee40 con 0x7f7594003a00 2023-10-16T20:07:23.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759400ba10 con 0x7f75ac06dcc0 2023-10-16T20:07:23.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f7594005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75aaffd700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7594003a00 0x7f7594003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75aa7fc700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 0x7f7594004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 -- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 msgr2=0x7f7594004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac06dcc0 0x7f7594004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 -- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7594003a00 msgr2=0x7f7594003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:23.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7594003a00 0x7f7594003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 -- 172.21.15.152:0/4150648316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940035b0 con 0x7f7594004d90 2023-10-16T20:07:23.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.933+0000 7f75ab7fe700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f7594005210 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009fc0 tx=0x7f7594005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3b76fb8115d615 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400ec30 con 0x7f7594004d90 2023-10-16T20:07:23.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400f040 con 0x7f7594004d90 2023-10-16T20:07:23.945 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75a9ffb700 1 -- 172.21.15.152:0/4150648316 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4014480 con 0x7f7594004d90 2023-10-16T20:07:23.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75b1972700 1 -- 172.21.15.152:0/4150648316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 msgr2=0x7f7594005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75b1972700 1 --2- 172.21.15.152:0/4150648316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f7594005210 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009fc0 tx=0x7f7594005880 comp rx=0 tx=0).stop 2023-10-16T20:07:23.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75ab7fe700 1 -- 172.21.15.152:0/4150648316 reap_dead start 2023-10-16T20:07:23.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75b1972700 1 -- 172.21.15.152:0/4150648316 shutdown_connections 2023-10-16T20:07:23.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75b1972700 1 -- 172.21.15.152:0/4150648316 >> 172.21.15.152:0/4150648316 conn(0x7f75ac0ccbe0 msgr2=0x7f75ac0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:23.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75b1972700 1 -- 172.21.15.152:0/4150648316 shutdown_connections 2023-10-16T20:07:23.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.934+0000 7f75b1972700 1 -- 172.21.15.152:0/4150648316 wait complete. 2023-10-16T20:07:23.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.935+0000 7f75b1972700 1 Processor -- start 2023-10-16T20:07:23.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.935+0000 7f75b1972700 1 -- start start 2023-10-16T20:07:23.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75b1972700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f75ac0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75b1972700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac157500 0x7f75ac14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75b1972700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75ac0ad240 0x7f75ac0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75b1972700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0adbe0 con 0x7f7594004d90 2023-10-16T20:07:23.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75b1972700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1f60f0 con 0x7f75ac0ad240 2023-10-16T20:07:23.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75b1972700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1f63d0 con 0x7f75ac157500 2023-10-16T20:07:23.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75aaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f75ac0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75aaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f75ac0af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60056/0 (socket says 172.21.15.152:60056) 2023-10-16T20:07:23.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.936+0000 7f75aaffd700 1 -- 172.21.15.152:0/229846896 learned_addr learned my addr 172.21.15.152:0/229846896 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:23.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aa7fc700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac157500 0x7f75ac14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aaffd700 1 -- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac157500 msgr2=0x7f75ac14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aaffd700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac157500 0x7f75ac14f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aaffd700 1 -- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75ac0ad240 msgr2=0x7f75ac0ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:23.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aaffd700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75ac0ad240 0x7f75ac0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:23.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aaffd700 1 -- 172.21.15.152:0/229846896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac1f66b0 con 0x7f7594004d90 2023-10-16T20:07:23.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75aaffd700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f75ac0af0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f75a0011aa0 tx=0x7f75a0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000f900 con 0x7f7594004d90 2023-10-16T20:07:23.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a000fa80 con 0x7f7594004d90 2023-10-16T20:07:23.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac1f6990 con 0x7f7594004d90 2023-10-16T20:07:23.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000fe30 con 0x7f7594004d90 2023-10-16T20:07:23.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.937+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0af610 con 0x7f7594004d90 2023-10-16T20:07:23.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.938+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac1f6510 con 0x7f7594004d90 2023-10-16T20:07:23.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.938+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75a0014440 con 0x7f7594004d90 2023-10-16T20:07:23.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.939+0000 7f7593fff700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f759806af00 0x7f759806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:23.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.939+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f75a008a100 con 0x7f7594004d90 2023-10-16T20:07:23.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.939+0000 7f75aa7fc700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f759806af00 0x7f759806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:23.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.939+0000 7f75aa7fc700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f759806af00 0x7f759806d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f759c000c00 tx=0x7f759c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:23.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:23.943+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75ac1f6510 con 0x7f7594004d90 2023-10-16T20:07:24.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.131+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75ac1f6510 con 0x7f7594004d90 2023-10-16T20:07:24.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.132+0000 7f7593fff700 1 -- 172.21.15.152:0/229846896 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75ac1f6510 con 0x7f7594004d90 2023-10-16T20:07:24.135 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:24.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f759806af00 msgr2=0x7f759806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f759806af00 0x7f759806d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f759c000c00 tx=0x7f759c009040 comp rx=0 tx=0).stop 2023-10-16T20:07:24.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 msgr2=0x7f75ac0af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f75ac0af0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f75a0011aa0 tx=0x7f75a0011e60 comp rx=0 tx=0).stop 2023-10-16T20:07:24.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 shutdown_connections 2023-10-16T20:07:24.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f759806af00 0x7f759806d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75ac0ad240 0x7f75ac0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7594004d90 0x7f75ac0af0d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 --2- 172.21.15.152:0/229846896 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f75ac157500 0x7f75ac14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 >> 172.21.15.152:0/229846896 conn(0x7f75ac0ccbe0 msgr2=0x7f75ac06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:24.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 shutdown_connections 2023-10-16T20:07:24.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.134+0000 7f75b1972700 1 -- 172.21.15.152:0/229846896 wait complete. 2023-10-16T20:07:24.149 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.270+0000 7fa706ba8700 1 Processor -- start 2023-10-16T20:07:24.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.270+0000 7fa706ba8700 1 -- start start 2023-10-16T20:07:24.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa706ba8700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa70006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa706ba8700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa700070620 con 0x7fa7000b33f0 2023-10-16T20:07:24.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa706ba8700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa700070900 con 0x7fa7000cd770 2023-10-16T20:07:24.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa706ba8700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa700070be0 con 0x7fa70015b4e0 2023-10-16T20:07:24.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa705145700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa7000b33f0 0x7fa7000b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40266/0 (socket says 172.21.15.152:40266) 2023-10-16T20:07:24.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa705145700 1 -- 172.21.15.152:0/1308311745 learned_addr learned my addr 172.21.15.152:0/1308311745 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:24.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa704944700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa70006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389272376 0 0) 0x7fa700070620 con 0x7fa7000b33f0 2023-10-16T20:07:24.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f00035b0 con 0x7fa7000b33f0 2023-10-16T20:07:24.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802600918 0 0) 0x7fa700070900 con 0x7fa7000cd770 2023-10-16T20:07:24.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa700070620 con 0x7fa7000cd770 2023-10-16T20:07:24.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709476621 0 0) 0x7fa6f00035b0 con 0x7fa7000b33f0 2023-10-16T20:07:24.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 msgr2=0x7fa70006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:24.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa70006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 >> v1:172.21.15.163:6789/0 conn(0x7fa7000cd770 legacy=0x7fa7000b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700070ec0 con 0x7fa7000b33f0 2023-10-16T20:07:24.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fa6f80019f0 con 0x7fa7000b33f0 2023-10-16T20:07:24.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 >> v1:172.21.15.152:6789/0 conn(0x7fa7000b33f0 legacy=0x7fa7000b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6f0003bc0 0x7fa6f0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f0004850 0x7fa6f0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa6f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa700070be0 con 0x7fa6f0004850 2023-10-16T20:07:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f000bac0 con 0x7fa6f0003bc0 2023-10-16T20:07:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.271+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f000bc50 con 0x7fa70015b4e0 2023-10-16T20:07:24.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f0004850 0x7fa6f0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa704944700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6f0003bc0 0x7fa6f0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa705145700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa6f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 -- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 msgr2=0x7fa6f0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa6f0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 -- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6f0003bc0 msgr2=0x7fa6f0003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:24.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6f0003bc0 0x7fa6f0003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 -- 172.21.15.152:0/1308311745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00035b0 con 0x7fa6f0004850 2023-10-16T20:07:24.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa705145700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa70015b4e0 0x7fa6f0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:24.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6fffff700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f0004850 0x7fa6f0004cd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001940 tx=0x7fa6f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661e52cf8925cf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:24.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec001430 con 0x7fa6f0004850 2023-10-16T20:07:24.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec001d70 con 0x7fa6f0004850 2023-10-16T20:07:24.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.272+0000 7fa6ff7fe700 1 -- 172.21.15.152:0/1308311745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec005510 con 0x7fa6f0004850 2023-10-16T20:07:24.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa706ba8700 1 -- 172.21.15.152:0/1308311745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f0004850 msgr2=0x7fa6f0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1308311745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6f0004850 0x7fa6f0004cd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001940 tx=0x7fa6f0005880 comp rx=0 tx=0).stop 2023-10-16T20:07:24.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa705145700 1 -- 172.21.15.152:0/1308311745 reap_dead start 2023-10-16T20:07:24.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa706ba8700 1 -- 172.21.15.152:0/1308311745 shutdown_connections 2023-10-16T20:07:24.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa706ba8700 1 -- 172.21.15.152:0/1308311745 >> 172.21.15.152:0/1308311745 conn(0x7fa7000cdce0 msgr2=0x7fa7000ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:24.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa706ba8700 1 -- 172.21.15.152:0/1308311745 shutdown_connections 2023-10-16T20:07:24.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.273+0000 7fa706ba8700 1 -- 172.21.15.152:0/1308311745 wait complete. 2023-10-16T20:07:24.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.274+0000 7fa706ba8700 1 Processor -- start 2023-10-16T20:07:24.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.274+0000 7fa706ba8700 1 -- start start 2023-10-16T20:07:24.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6f0004850 0x7fa700153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7000acf30 0x7fa7000cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 0x7fa7000aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000d0250 con 0x7fa7000cfdd0 2023-10-16T20:07:24.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa700154340 con 0x7fa7000acf30 2023-10-16T20:07:24.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000a8550 con 0x7fa6f0004850 2023-10-16T20:07:24.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 0x7fa7000aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 0x7fa7000aabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60080/0 (socket says 172.21.15.152:60080) 2023-10-16T20:07:24.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 -- 172.21.15.152:0/1743377161 learned_addr learned my addr 172.21.15.152:0/1743377161 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:24.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa6fffff700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7000acf30 0x7fa7000cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa704944700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6f0004850 0x7fa700153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 -- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6f0004850 msgr2=0x7fa700153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6f0004850 0x7fa700153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 -- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7000acf30 msgr2=0x7fa7000cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7000acf30 0x7fa7000cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 -- 172.21.15.152:0/1743377161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000a8830 con 0x7fa7000cfdd0 2023-10-16T20:07:24.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa704944700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6f0004850 0x7fa700153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:24.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa705145700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 0x7fa7000aabe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8000f80 tx=0x7fa6f800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:24.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800edb0 con 0x7fa7000cfdd0 2023-10-16T20:07:24.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8013420 con 0x7fa7000cfdd0 2023-10-16T20:07:24.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7000a8b10 con 0x7fa7000cfdd0 2023-10-16T20:07:24.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.275+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f80137d0 con 0x7fa7000cfdd0 2023-10-16T20:07:24.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.276+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7000ab910 con 0x7fa7000cfdd0 2023-10-16T20:07:24.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.276+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7000a9030 con 0x7fa7000cfdd0 2023-10-16T20:07:24.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.277+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6f8013930 con 0x7fa7000cfdd0 2023-10-16T20:07:24.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.277+0000 7fa6fd7fa700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa6e406af00 0x7fa6e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.277+0000 7fa704944700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa6e406af00 0x7fa6e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.277+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6f8089f60 con 0x7fa7000cfdd0 2023-10-16T20:07:24.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.278+0000 7fa704944700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa6e406af00 0x7fa6e406d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa700154790 tx=0x7fa6f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:24.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.282+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7000a9030 con 0x7fa7000cfdd0 2023-10-16T20:07:24.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.472+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa70004ebb0 con 0x7fa7000cfdd0 2023-10-16T20:07:24.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.472+0000 7fa6fd7fa700 1 -- 172.21.15.152:0/1743377161 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa6f8054ce0 con 0x7fa7000cfdd0 2023-10-16T20:07:24.475 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:24.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa6e406af00 msgr2=0x7fa6e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa6e406af00 0x7fa6e406d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa700154790 tx=0x7fa6f4008040 comp rx=0 tx=0).stop 2023-10-16T20:07:24.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 msgr2=0x7fa7000aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 0x7fa7000aabe0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8000f80 tx=0x7fa6f800e440 comp rx=0 tx=0).stop 2023-10-16T20:07:24.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 shutdown_connections 2023-10-16T20:07:24.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa6e406af00 0x7fa6e406d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6f0004850 0x7fa700153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7000cfdd0 0x7fa7000aabe0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 --2- 172.21.15.152:0/1743377161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7000acf30 0x7fa7000cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 >> 172.21.15.152:0/1743377161 conn(0x7fa7000cdce0 msgr2=0x7fa7000ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:24.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 shutdown_connections 2023-10-16T20:07:24.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.474+0000 7fa706ba8700 1 -- 172.21.15.152:0/1743377161 wait complete. 2023-10-16T20:07:24.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:07:24.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.608+0000 7f6f989fb700 1 Processor -- start 2023-10-16T20:07:24.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.608+0000 7f6f989fb700 1 -- start start 2023-10-16T20:07:24.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.609+0000 7f6f989fb700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6f9415daa0 0x7f6f940af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.609+0000 7f6f989fb700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f940af560 0x7f6f94071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.609+0000 7f6f989fb700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9415ed10 con 0x7f6f94071d90 2023-10-16T20:07:24.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.609+0000 7f6f989fb700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f94072200 con 0x7f6f9415daa0 2023-10-16T20:07:24.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.609+0000 7f6f989fb700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9415de80 con 0x7f6f940af560 2023-10-16T20:07:24.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9259c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6f9415daa0 0x7f6f940af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f91d9b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f940af560 0x7f6f94071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f92d9d700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f6f94071d90 0x7f6f940ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:55466/0 (socket says 172.21.15.152:55466) 2023-10-16T20:07:24.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f92d9d700 1 -- 172.21.15.152:0/1302645289 learned_addr learned my addr 172.21.15.152:0/1302645289 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:24.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9259c700 1 -- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f940af560 msgr2=0x7f6f94071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:24.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9259c700 1 --2- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f940af560 0x7f6f94071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9259c700 1 -- 172.21.15.152:0/1302645289 >> v1:172.21.15.163:6789/0 conn(0x7f6f94071d90 legacy=0x7f6f940ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9259c700 1 -- 172.21.15.152:0/1302645289 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9415e100 con 0x7f6f9415daa0 2023-10-16T20:07:24.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9159a700 1 -- 172.21.15.152:0/1302645289 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005887971 0 0) 0x7f6f9415ed10 con 0x7f6f94071d90 2023-10-16T20:07:24.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f91d9b700 1 --2- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f940af560 0x7f6f94071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:24.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9259c700 1 --2- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f9415daa0 0x7f6f940af020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009840 tx=0x7f6f7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567162da025d8048 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:24.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9159a700 1 -- 172.21.15.152:0/1302645289 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011830 con 0x7f6f9415daa0 2023-10-16T20:07:24.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9159a700 1 -- 172.21.15.152:0/1302645289 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c011990 con 0x7f6f9415daa0 2023-10-16T20:07:24.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.610+0000 7f6f9159a700 1 -- 172.21.15.152:0/1302645289 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011d20 con 0x7f6f9415daa0 2023-10-16T20:07:24.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 -- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f9415daa0 msgr2=0x7f6f940af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 --2- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f9415daa0 0x7f6f940af020 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009840 tx=0x7f6f7c009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:24.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 -- 172.21.15.152:0/1302645289 shutdown_connections 2023-10-16T20:07:24.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 --2- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f9415daa0 0x7f6f940af020 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 --2- 172.21.15.152:0/1302645289 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f940af560 0x7f6f94071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 -- 172.21.15.152:0/1302645289 >> 172.21.15.152:0/1302645289 conn(0x7f6f940d0180 msgr2=0x7f6f940d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:24.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 -- 172.21.15.152:0/1302645289 shutdown_connections 2023-10-16T20:07:24.619 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.611+0000 7f6f989fb700 1 -- 172.21.15.152:0/1302645289 wait complete. 2023-10-16T20:07:24.621 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.612+0000 7f6f989fb700 1 Processor -- start 2023-10-16T20:07:24.622 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.612+0000 7f6f989fb700 1 -- start start 2023-10-16T20:07:24.622 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f989fb700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f94071d90 0x7f6f941593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.622 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f989fb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f940af560 0x7f6f941f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.623 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f989fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 0x7f6f940ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.623 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f989fb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940c89e0 con 0x7f6f9415daa0 2023-10-16T20:07:24.623 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f989fb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941f2910 con 0x7f6f940af560 2023-10-16T20:07:24.623 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f989fb700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941f2b70 con 0x7f6f94071d90 2023-10-16T20:07:24.623 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f92d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 0x7f6f940ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f92d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 0x7f6f940ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60094/0 (socket says 172.21.15.152:60094) 2023-10-16T20:07:24.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f9259c700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f94071d90 0x7f6f941593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f92d9d700 1 -- 172.21.15.152:0/3698423531 learned_addr learned my addr 172.21.15.152:0/3698423531 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:24.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.613+0000 7f6f91d9b700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f940af560 0x7f6f941f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f92d9d700 1 -- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f94071d90 msgr2=0x7f6f941593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f92d9d700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f94071d90 0x7f6f941593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f92d9d700 1 -- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f940af560 msgr2=0x7f6f941f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f92d9d700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f940af560 0x7f6f941f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f92d9d700 1 -- 172.21.15.152:0/3698423531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840094a0 con 0x7f6f9415daa0 2023-10-16T20:07:24.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f92d9d700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 0x7f6f940ad010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00cb40 tx=0x7f6f8c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:24.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00a9e0 con 0x7f6f9415daa0 2023-10-16T20:07:24.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00ab40 con 0x7f6f9415daa0 2023-10-16T20:07:24.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c0094a0 con 0x7f6f9415daa0 2023-10-16T20:07:24.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0070d0 con 0x7f6f9415daa0 2023-10-16T20:07:24.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.614+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f941f3130 con 0x7f6f9415daa0 2023-10-16T20:07:24.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.615+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9404ebb0 con 0x7f6f9415daa0 2023-10-16T20:07:24.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.615+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f8c007230 con 0x7f6f9415daa0 2023-10-16T20:07:24.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.616+0000 7f6f8affd700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6f7406af00 0x7f6f7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:24.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.616+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f8c089240 con 0x7f6f9415daa0 2023-10-16T20:07:24.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.616+0000 7f6f9259c700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6f7406af00 0x7f6f7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:24.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.616+0000 7f6f9259c700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6f7406af00 0x7f6f7406d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0090b0 tx=0x7f6f7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:24.628 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.620+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f8c053f40 con 0x7f6f9415daa0 2023-10-16T20:07:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.825+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f940ca060 con 0x7f6f9415daa0 2023-10-16T20:07:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.825+0000 7f6f8affd700 1 -- 172.21.15.152:0/3698423531 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f8c057560 con 0x7f6f9415daa0 2023-10-16T20:07:24.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.827+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6f7406af00 msgr2=0x7f6f7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.827+0000 7f6f989fb700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6f7406af00 0x7f6f7406d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0090b0 tx=0x7f6f7c008030 comp rx=0 tx=0).stop 2023-10-16T20:07:24.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.827+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 msgr2=0x7f6f940ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:24.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.827+0000 7f6f989fb700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 0x7f6f940ad010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00cb40 tx=0x7f6f8c00ce50 comp rx=0 tx=0).stop 2023-10-16T20:07:24.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 shutdown_connections 2023-10-16T20:07:24.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6f7406af00 0x7f6f7406d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6f94071d90 0x7f6f941593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f9415daa0 0x7f6f940ad010 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 --2- 172.21.15.152:0/3698423531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6f940af560 0x7f6f941f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:24.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 >> 172.21.15.152:0/3698423531 conn(0x7f6f940d0180 msgr2=0x7f6f9415cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:24.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 shutdown_connections 2023-10-16T20:07:24.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:24.828+0000 7f6f989fb700 1 -- 172.21.15.152:0/3698423531 wait complete. 2023-10-16T20:07:24.833 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2023-10-16T20:07:24.842 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-16T20:07:24.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:24.843 DEBUG:teuthology.orchestra.run.smithi163:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-16T20:07:24.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:07:24.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:24.890 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T20:07:24.919 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:24.920 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:24.938 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:24.938 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:24.995 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:07:24.995 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:25.051 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:25.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.209+0000 7efe6b1be700 1 Processor -- start 2023-10-16T20:07:25.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.209+0000 7efe6b1be700 1 -- start start 2023-10-16T20:07:25.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe6b1be700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe64152470 0x7efe640cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe6b1be700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe64070d70 con 0x7efe640cb8d0 2023-10-16T20:07:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe6b1be700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6415c990 con 0x7efe640b3410 2023-10-16T20:07:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe6b1be700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe64071200 con 0x7efe64152470 2023-10-16T20:07:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe63fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efe640cb8d0 0x7efe640b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40300/0 (socket says 172.21.15.152:40300) 2023-10-16T20:07:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe68f5a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe64152470 0x7efe640cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe63fff700 1 -- 172.21.15.152:0/2702944016 learned_addr learned my addr 172.21.15.152:0/2702944016 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe68f5a700 1 -- 172.21.15.152:0/2702944016 >> v1:172.21.15.163:6789/0 conn(0x7efe640b3410 legacy=0x7efe640b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe68f5a700 1 -- 172.21.15.152:0/2702944016 >> v1:172.21.15.152:6789/0 conn(0x7efe640cb8d0 legacy=0x7efe640b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe637fe700 1 -- 172.21.15.152:0/2702944016 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318914704 0 0) 0x7efe64070d70 con 0x7efe640cb8d0 2023-10-16T20:07:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.210+0000 7efe68f5a700 1 -- 172.21.15.152:0/2702944016 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640cbd80 con 0x7efe64152470 2023-10-16T20:07:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe68f5a700 1 --2- 172.21.15.152:0/2702944016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe64152470 0x7efe640cd570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe58009840 tx=0x7efe58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4632c8e24afc90 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe637fe700 1 -- 172.21.15.152:0/2702944016 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58004230 con 0x7efe64152470 2023-10-16T20:07:25.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe637fe700 1 -- 172.21.15.152:0/2702944016 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58004390 con 0x7efe64152470 2023-10-16T20:07:25.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe637fe700 1 -- 172.21.15.152:0/2702944016 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580036a0 con 0x7efe64152470 2023-10-16T20:07:25.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 -- 172.21.15.152:0/2702944016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe64152470 msgr2=0x7efe640cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 --2- 172.21.15.152:0/2702944016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe64152470 0x7efe640cd570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe58009840 tx=0x7efe58009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 -- 172.21.15.152:0/2702944016 shutdown_connections 2023-10-16T20:07:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 --2- 172.21.15.152:0/2702944016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe64152470 0x7efe640cd570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 -- 172.21.15.152:0/2702944016 >> 172.21.15.152:0/2702944016 conn(0x7efe640cdd00 msgr2=0x7efe640ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 -- 172.21.15.152:0/2702944016 shutdown_connections 2023-10-16T20:07:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.211+0000 7efe6b1be700 1 -- 172.21.15.152:0/2702944016 wait complete. 2023-10-16T20:07:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 Processor -- start 2023-10-16T20:07:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 -- start start 2023-10-16T20:07:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 0x7efe6414c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe640cb8d0 0x7efe640c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efe64152470 0x7efe640c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640c5790 con 0x7efe640b3410 2023-10-16T20:07:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640c5a70 con 0x7efe640cb8d0 2023-10-16T20:07:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.213+0000 7efe6b1be700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640c5d50 con 0x7efe64152470 2023-10-16T20:07:25.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 0x7efe6414c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 0x7efe6414c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60104/0 (socket says 172.21.15.152:60104) 2023-10-16T20:07:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 -- 172.21.15.152:0/1708494594 learned_addr learned my addr 172.21.15.152:0/1708494594 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 -- 172.21.15.152:0/1708494594 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efe64152470 msgr2=0x7efe640c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efe64152470 0x7efe640c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 -- 172.21.15.152:0/1708494594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe640cb8d0 msgr2=0x7efe640c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe640cb8d0 0x7efe640c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 -- 172.21.15.152:0/1708494594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580094a0 con 0x7efe640b3410 2023-10-16T20:07:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe68f5a700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 0x7efe6414c740 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efe58000c00 tx=0x7efe58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011630 con 0x7efe640b3410 2023-10-16T20:07:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5801e070 con 0x7efe640b3410 2023-10-16T20:07:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640c6030 con 0x7efe640b3410 2023-10-16T20:07:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580119f0 con 0x7efe640b3410 2023-10-16T20:07:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.214+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6414cc80 con 0x7efe640b3410 2023-10-16T20:07:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.215+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6404ebb0 con 0x7efe640b3410 2023-10-16T20:07:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.216+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efe58011b50 con 0x7efe640b3410 2023-10-16T20:07:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.216+0000 7efe617fa700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efe4806af00 0x7efe4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.216+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe5808acc0 con 0x7efe640b3410 2023-10-16T20:07:25.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.216+0000 7efe63fff700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efe4806af00 0x7efe4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.216+0000 7efe63fff700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efe4806af00 0x7efe4806d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efe50000c00 tx=0x7efe50007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.220+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe58055a40 con 0x7efe640b3410 2023-10-16T20:07:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.412+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6406f630 con 0x7efe640b3410 2023-10-16T20:07:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.414+0000 7efe617fa700 1 -- 172.21.15.152:0/1708494594 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7efe58020070 con 0x7efe640b3410 2023-10-16T20:07:25.417 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:25.417 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efe4806af00 msgr2=0x7efe4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efe4806af00 0x7efe4806d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efe50000c00 tx=0x7efe50007990 comp rx=0 tx=0).stop 2023-10-16T20:07:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 msgr2=0x7efe6414c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 0x7efe6414c740 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efe58000c00 tx=0x7efe58004750 comp rx=0 tx=0).stop 2023-10-16T20:07:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 shutdown_connections 2023-10-16T20:07:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efe4806af00 0x7efe4806d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efe64152470 0x7efe640c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640b3410 0x7efe6414c740 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 --2- 172.21.15.152:0/1708494594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe640cb8d0 0x7efe640c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 >> 172.21.15.152:0/1708494594 conn(0x7efe640cdd00 msgr2=0x7efe640b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 shutdown_connections 2023-10-16T20:07:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.416+0000 7efe6b1be700 1 -- 172.21.15.152:0/1708494594 wait complete. 2023-10-16T20:07:25.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:25.432 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.552+0000 7fb619ce5700 1 Processor -- start 2023-10-16T20:07:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.552+0000 7fb619ce5700 1 -- start start 2023-10-16T20:07:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb619ce5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb61415d860 0x7fb6140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb619ce5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb614161ec0 0x7fb6140ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb619ce5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61406b230 con 0x7fb6140c6e90 2023-10-16T20:07:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb619ce5700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61406b760 con 0x7fb614161ec0 2023-10-16T20:07:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb619ce5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61406b480 con 0x7fb61415d860 2023-10-16T20:07:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb613fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb614161ec0 0x7fb6140ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb613fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb614161ec0 0x7fb6140ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60116/0 (socket says 172.21.15.152:60116) 2023-10-16T20:07:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb613fff700 1 -- 172.21.15.152:0/3113325742 learned_addr learned my addr 172.21.15.152:0/3113325742 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb6137fe700 1 --2- 172.21.15.152:0/3113325742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb61415d860 0x7fb6140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.553+0000 7fb613fff700 1 -- 172.21.15.152:0/3113325742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb61415d860 msgr2=0x7fb6140cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb613fff700 1 --2- 172.21.15.152:0/3113325742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb61415d860 0x7fb6140cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb613fff700 1 -- 172.21.15.152:0/3113325742 >> v1:172.21.15.163:6789/0 conn(0x7fb6140c6e90 legacy=0x7fb614071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb613fff700 1 -- 172.21.15.152:0/3113325742 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6141613e0 con 0x7fb614161ec0 2023-10-16T20:07:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb613fff700 1 --2- 172.21.15.152:0/3113325742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb614161ec0 0x7fb6140ce320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009e50 tx=0x7fb60c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31db68cdb035e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb6127fc700 1 -- 172.21.15.152:0/3113325742 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00e070 con 0x7fb614161ec0 2023-10-16T20:07:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb6127fc700 1 -- 172.21.15.152:0/3113325742 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00b9c0 con 0x7fb614161ec0 2023-10-16T20:07:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb6127fc700 1 -- 172.21.15.152:0/3113325742 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00bd70 con 0x7fb614161ec0 2023-10-16T20:07:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 -- 172.21.15.152:0/3113325742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb614161ec0 msgr2=0x7fb6140ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 --2- 172.21.15.152:0/3113325742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb614161ec0 0x7fb6140ce320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009e50 tx=0x7fb60c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 -- 172.21.15.152:0/3113325742 shutdown_connections 2023-10-16T20:07:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 --2- 172.21.15.152:0/3113325742 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb61415d860 0x7fb6140cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 --2- 172.21.15.152:0/3113325742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb614161ec0 0x7fb6140ce320 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 -- 172.21.15.152:0/3113325742 >> 172.21.15.152:0/3113325742 conn(0x7fb6140ccc90 msgr2=0x7fb6140cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.554+0000 7fb619ce5700 1 -- 172.21.15.152:0/3113325742 shutdown_connections 2023-10-16T20:07:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.555+0000 7fb619ce5700 1 -- 172.21.15.152:0/3113325742 wait complete. 2023-10-16T20:07:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.556+0000 7fb619ce5700 1 Processor -- start 2023-10-16T20:07:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.556+0000 7fb619ce5700 1 -- start start 2023-10-16T20:07:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb619ce5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 0x7fb6140af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb619ce5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61415d860 0x7fb614154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb619ce5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb614161ec0 0x7fb614155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb619ce5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140b3600 con 0x7fb6140c6e90 2023-10-16T20:07:25.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb619ce5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140ae840 con 0x7fb61415d860 2023-10-16T20:07:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb619ce5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb614154870 con 0x7fb614161ec0 2023-10-16T20:07:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb6137fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 0x7fb6140af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb6137fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 0x7fb6140af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60118/0 (socket says 172.21.15.152:60118) 2023-10-16T20:07:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb6137fe700 1 -- 172.21.15.152:0/627743268 learned_addr learned my addr 172.21.15.152:0/627743268 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:25.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb612ffd700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61415d860 0x7fb614154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb613fff700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb614161ec0 0x7fb614155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb6137fe700 1 -- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb614161ec0 msgr2=0x7fb614155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb6137fe700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb614161ec0 0x7fb614155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.557+0000 7fb6137fe700 1 -- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61415d860 msgr2=0x7fb614154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb6137fe700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61415d860 0x7fb614154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb6137fe700 1 -- 172.21.15.152:0/627743268 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009b30 con 0x7fb6140c6e90 2023-10-16T20:07:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb612ffd700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61415d860 0x7fb614154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb6137fe700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 0x7fb6140af380 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e840 tx=0x7fb60800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608013610 con 0x7fb6140c6e90 2023-10-16T20:07:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb608013770 con 0x7fb6140c6e90 2023-10-16T20:07:25.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6140ae560 con 0x7fb6140c6e90 2023-10-16T20:07:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608013b20 con 0x7fb6140c6e90 2023-10-16T20:07:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.558+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6140b3220 con 0x7fb6140c6e90 2023-10-16T20:07:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.559+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61404ebb0 con 0x7fb6140c6e90 2023-10-16T20:07:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.559+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb608013c80 con 0x7fb6140c6e90 2023-10-16T20:07:25.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.560+0000 7fb5fbfff700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb60006af00 0x7fb60006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.560+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb6080895b0 con 0x7fb6140c6e90 2023-10-16T20:07:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.560+0000 7fb612ffd700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb60006af00 0x7fb60006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.560+0000 7fb612ffd700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb60006af00 0x7fb60006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb6140af8c0 tx=0x7fb604009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.564+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb608054330 con 0x7fb6140c6e90 2023-10-16T20:07:25.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.753+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6140700a0 con 0x7fb6140c6e90 2023-10-16T20:07:25.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.753+0000 7fb5fbfff700 1 -- 172.21.15.152:0/627743268 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb608057950 con 0x7fb6140c6e90 2023-10-16T20:07:25.757 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:25.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb60006af00 msgr2=0x7fb60006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb60006af00 0x7fb60006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb6140af8c0 tx=0x7fb604009040 comp rx=0 tx=0).stop 2023-10-16T20:07:25.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 msgr2=0x7fb6140af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 0x7fb6140af380 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e840 tx=0x7fb60800ec00 comp rx=0 tx=0).stop 2023-10-16T20:07:25.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 shutdown_connections 2023-10-16T20:07:25.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb60006af00 0x7fb60006d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb614161ec0 0x7fb614155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6140c6e90 0x7fb6140af380 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 --2- 172.21.15.152:0/627743268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61415d860 0x7fb614154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 >> 172.21.15.152:0/627743268 conn(0x7fb6140ccc90 msgr2=0x7fb6140717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:25.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 shutdown_connections 2023-10-16T20:07:25.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.756+0000 7fb619ce5700 1 -- 172.21.15.152:0/627743268 wait complete. 2023-10-16T20:07:25.771 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:25.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.891+0000 7fb635c81700 1 Processor -- start 2023-10-16T20:07:25.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.891+0000 7fb635c81700 1 -- start start 2023-10-16T20:07:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb635c81700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 0x7fb63015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb635c81700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb63006a820 0x7fb63006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb635c81700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb630161360 con 0x7fb6300cdd30 2023-10-16T20:07:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb635c81700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63006b750 con 0x7fb63006a820 2023-10-16T20:07:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb635c81700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63015e300 con 0x7fb63006b370 2023-10-16T20:07:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb6300cdd30 0x7fb6301617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40328/0 (socket says 172.21.15.152:40328) 2023-10-16T20:07:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62ffff700 1 -- 172.21.15.152:0/1138972914 learned_addr learned my addr 172.21.15.152:0/1138972914 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62f7fe700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 0x7fb63015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62effd700 1 --2- 172.21.15.152:0/1138972914 >> v2:172.21.15.163:3300/0 conn(0x7fb63006a820 0x7fb63006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085667989 0 0) 0x7fb630161360 con 0x7fb6300cdd30 2023-10-16T20:07:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb61c0035b0 con 0x7fb6300cdd30 2023-10-16T20:07:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2720569682 0 0) 0x7fb61c0035b0 con 0x7fb6300cdd30 2023-10-16T20:07:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 msgr2=0x7fb63015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 0x7fb63015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 >> v2:172.21.15.163:3300/0 conn(0x7fb63006a820 msgr2=0x7fb63006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.892+0000 7fb62e7fc700 1 --2- 172.21.15.152:0/1138972914 >> v2:172.21.15.163:3300/0 conn(0x7fb63006a820 0x7fb63006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63015e5e0 con 0x7fb6300cdd30 2023-10-16T20:07:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fb6280019f0 con 0x7fb6300cdd30 2023-10-16T20:07:25.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 >> v1:172.21.15.152:6789/0 conn(0x7fb6300cdd30 legacy=0x7fb6301617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61c003a00 0x7fb61c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 0x7fb61c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63006b750 con 0x7fb61c004d90 2023-10-16T20:07:25.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63015e300 con 0x7fb61c003a00 2023-10-16T20:07:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c00ba10 con 0x7fb63006b370 2023-10-16T20:07:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62f7fe700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61c003a00 0x7fb61c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62effd700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 0x7fb61c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 -- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 msgr2=0x7fb61c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb63006b370 0x7fb61c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 -- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61c003a00 msgr2=0x7fb61c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb61c003a00 0x7fb61c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 -- 172.21.15.152:0/1138972914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0035b0 con 0x7fb61c004d90 2023-10-16T20:07:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62ffff700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb62800a8d0 tx=0x7fb61c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f25728a2a8a020 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800a340 con 0x7fb61c004d90 2023-10-16T20:07:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628012600 con 0x7fb61c004d90 2023-10-16T20:07:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.893+0000 7fb62e7fc700 1 -- 172.21.15.152:0/1138972914 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280129b0 con 0x7fb61c004d90 2023-10-16T20:07:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb635c81700 1 -- 172.21.15.152:0/1138972914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb61c004d90 msgr2=0x7fb61c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb635c81700 1 --2- 172.21.15.152:0/1138972914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb61c004d90 0x7fb61c005210 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb62800a8d0 tx=0x7fb61c005880 comp rx=0 tx=0).stop 2023-10-16T20:07:25.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb62ffff700 1 -- 172.21.15.152:0/1138972914 reap_dead start 2023-10-16T20:07:25.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb635c81700 1 -- 172.21.15.152:0/1138972914 shutdown_connections 2023-10-16T20:07:25.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb635c81700 1 -- 172.21.15.152:0/1138972914 >> 172.21.15.152:0/1138972914 conn(0x7fb6300ccbe0 msgr2=0x7fb6300ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:25.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb635c81700 1 -- 172.21.15.152:0/1138972914 shutdown_connections 2023-10-16T20:07:25.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.894+0000 7fb635c81700 1 -- 172.21.15.152:0/1138972914 wait complete. 2023-10-16T20:07:25.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.895+0000 7fb635c81700 1 Processor -- start 2023-10-16T20:07:25.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.895+0000 7fb635c81700 1 -- start start 2023-10-16T20:07:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb635c81700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb630155200 0x7fb630158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb635c81700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb630155890 0x7fb630159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb635c81700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 0x7fb6301f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb635c81700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63015a5b0 con 0x7fb63015a100 2023-10-16T20:07:25.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb635c81700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630159680 con 0x7fb630155890 2023-10-16T20:07:25.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb635c81700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb630160cc0 con 0x7fb630155200 2023-10-16T20:07:25.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 0x7fb6301f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62f7fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb630155200 0x7fb630158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 0x7fb6301f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60142/0 (socket says 172.21.15.152:60142) 2023-10-16T20:07:25.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 -- 172.21.15.152:0/2310502054 learned_addr learned my addr 172.21.15.152:0/2310502054 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:25.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62effd700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb630155890 0x7fb630159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 -- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb630155200 msgr2=0x7fb630158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb630155200 0x7fb630158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 -- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb630155890 msgr2=0x7fb630159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb630155890 0x7fb630159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.896+0000 7fb62ffff700 1 -- 172.21.15.152:0/2310502054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630158a70 con 0x7fb63015a100 2023-10-16T20:07:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.897+0000 7fb62ffff700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 0x7fb6301f6460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0046e0 tx=0x7fb628001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.897+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800a340 con 0x7fb63015a100 2023-10-16T20:07:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.897+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6280019c0 con 0x7fb63015a100 2023-10-16T20:07:25.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.897+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628001e50 con 0x7fb63015a100 2023-10-16T20:07:25.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.897+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb630158d50 con 0x7fb63015a100 2023-10-16T20:07:25.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.897+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb630159310 con 0x7fb63015a100 2023-10-16T20:07:25.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.898+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6301594d0 con 0x7fb63015a100 2023-10-16T20:07:25.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.898+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb628019070 con 0x7fb63015a100 2023-10-16T20:07:25.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.899+0000 7fb627fff700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb61006af00 0x7fb61006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:25.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.899+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb62808ad10 con 0x7fb63015a100 2023-10-16T20:07:25.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.899+0000 7fb62f7fe700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb61006af00 0x7fb61006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:25.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.899+0000 7fb62f7fe700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb61006af00 0x7fb61006d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb618009be0 tx=0x7fb618009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:25.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:25.903+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb628055ab0 con 0x7fb63015a100 2023-10-16T20:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.093+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb630072d10 con 0x7fb63015a100 2023-10-16T20:07:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.093+0000 7fb627fff700 1 -- 172.21.15.152:0/2310502054 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6280590d0 con 0x7fb63015a100 2023-10-16T20:07:26.097 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb61006af00 msgr2=0x7fb61006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb61006af00 0x7fb61006d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb618009be0 tx=0x7fb618009210 comp rx=0 tx=0).stop 2023-10-16T20:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 msgr2=0x7fb6301f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 0x7fb6301f6460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0046e0 tx=0x7fb628001360 comp rx=0 tx=0).stop 2023-10-16T20:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 shutdown_connections 2023-10-16T20:07:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb61006af00 0x7fb61006d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb630155200 0x7fb630158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb63015a100 0x7fb6301f6460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 --2- 172.21.15.152:0/2310502054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb630155890 0x7fb630159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.095+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 >> 172.21.15.152:0/2310502054 conn(0x7fb6300ccbe0 msgr2=0x7fb63015edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.096+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 shutdown_connections 2023-10-16T20:07:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.096+0000 7fb635c81700 1 -- 172.21.15.152:0/2310502054 wait complete. 2023-10-16T20:07:26.111 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.231+0000 7f65d3e31700 1 Processor -- start 2023-10-16T20:07:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.231+0000 7f65d3e31700 1 -- start start 2023-10-16T20:07:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.232+0000 7f65d3e31700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f65cc06b370 0x7f65cc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.232+0000 7f65d3e31700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.232+0000 7f65d3e31700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc161360 con 0x7f65cc06a820 2023-10-16T20:07:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.232+0000 7f65d3e31700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0ce720 con 0x7f65cc06b370 2023-10-16T20:07:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.232+0000 7f65d3e31700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc06b750 con 0x7f65cc0cdd30 2023-10-16T20:07:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d23ce700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d1bcd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f65cc06b370 0x7f65cc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d13cc700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f65cc06a820 0x7f65cc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:55524/0 (socket says 172.21.15.152:55524) 2023-10-16T20:07:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d13cc700 1 -- 172.21.15.152:0/3971067066 learned_addr learned my addr 172.21.15.152:0/3971067066 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d23ce700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc0ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:48802/0 (socket says 172.21.15.152:48802) 2023-10-16T20:07:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d0bcb700 1 -- 172.21.15.152:0/3971067066 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910867873 0 0) 0x7f65cc161360 con 0x7f65cc06a820 2023-10-16T20:07:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d0bcb700 1 -- 172.21.15.152:0/3971067066 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b80035b0 con 0x7f65cc06a820 2023-10-16T20:07:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d1bcd700 1 -- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 msgr2=0x7f65cc0ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d1bcd700 1 --2- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc0ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d1bcd700 1 -- 172.21.15.152:0/3971067066 >> v1:172.21.15.163:6789/0 conn(0x7f65cc06a820 legacy=0x7f65cc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d1bcd700 1 -- 172.21.15.152:0/3971067066 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc06dcc0 con 0x7f65cc06b370 2023-10-16T20:07:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d23ce700 1 --2- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc0ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d1bcd700 1 --2- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc15dcb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009840 tx=0x7f65bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d301332c9b8bf94a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d0bcb700 1 -- 172.21.15.152:0/3971067066 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc011830 con 0x7f65cc06b370 2023-10-16T20:07:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d0bcb700 1 -- 172.21.15.152:0/3971067066 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc011990 con 0x7f65cc06b370 2023-10-16T20:07:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.233+0000 7f65d0bcb700 1 -- 172.21.15.152:0/3971067066 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc011d20 con 0x7f65cc06b370 2023-10-16T20:07:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 -- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 msgr2=0x7f65cc15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 --2- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc15dcb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009840 tx=0x7f65bc009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 -- 172.21.15.152:0/3971067066 shutdown_connections 2023-10-16T20:07:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 --2- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc0ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 --2- 172.21.15.152:0/3971067066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc15dcb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 -- 172.21.15.152:0/3971067066 >> 172.21.15.152:0/3971067066 conn(0x7f65cc0ccbe0 msgr2=0x7f65cc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 -- 172.21.15.152:0/3971067066 shutdown_connections 2023-10-16T20:07:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.234+0000 7f65d3e31700 1 -- 172.21.15.152:0/3971067066 wait complete. 2023-10-16T20:07:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.235+0000 7f65d3e31700 1 Processor -- start 2023-10-16T20:07:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.235+0000 7f65d3e31700 1 -- start start 2023-10-16T20:07:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d3e31700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 0x7f65cc1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d3e31700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d3e31700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d3e31700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc156710 con 0x7f65cc06a820 2023-10-16T20:07:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d3e31700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0b49a0 con 0x7f65cc06b370 2023-10-16T20:07:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d3e31700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0b4c80 con 0x7f65cc0cdd30 2023-10-16T20:07:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 0x7f65cc1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 0x7f65cc1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60152/0 (socket says 172.21.15.152:60152) 2023-10-16T20:07:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 -- 172.21.15.152:0/1805161850 learned_addr learned my addr 172.21.15.152:0/1805161850 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d23ce700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d13cc700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 -- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 msgr2=0x7f65cc071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 -- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 msgr2=0x7f65cc156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 -- 172.21.15.152:0/1805161850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4009a70 con 0x7f65cc06a820 2023-10-16T20:07:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.236+0000 7f65d1bcd700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 0x7f65cc1561d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0090b0 tx=0x7f65bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.237+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc004550 con 0x7f65cc06a820 2023-10-16T20:07:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.237+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc01f070 con 0x7f65cc06a820 2023-10-16T20:07:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.237+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc0094a0 con 0x7f65cc06a820 2023-10-16T20:07:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.237+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0038e0 con 0x7f65cc06a820 2023-10-16T20:07:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.237+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc0acc40 con 0x7f65cc06a820 2023-10-16T20:07:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.238+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc072d10 con 0x7f65cc06a820 2023-10-16T20:07:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.238+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f65bc003a40 con 0x7f65cc06a820 2023-10-16T20:07:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.238+0000 7f65c27fc700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65b006af00 0x7f65b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.238+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f65bc021070 con 0x7f65cc06a820 2023-10-16T20:07:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.239+0000 7f65d13cc700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65b006af00 0x7f65b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.239+0000 7f65d13cc700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65b006af00 0x7f65b006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0c6d90 tx=0x7f65c8007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.243+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65bc055d30 con 0x7f65cc06a820 2023-10-16T20:07:26.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.435+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65cc04ebb0 con 0x7f65cc06a820 2023-10-16T20:07:26.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.436+0000 7f65c27fc700 1 -- 172.21.15.152:0/1805161850 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65bc059350 con 0x7f65cc06a820 2023-10-16T20:07:26.439 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:26.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65b006af00 msgr2=0x7f65b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65b006af00 0x7f65b006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0c6d90 tx=0x7f65c8007dc0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 msgr2=0x7f65cc1561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 0x7f65cc1561d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0090b0 tx=0x7f65bc004750 comp rx=0 tx=0).stop 2023-10-16T20:07:26.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 shutdown_connections 2023-10-16T20:07:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65b006af00 0x7f65b006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65cc0cdd30 0x7f65cc071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65cc06a820 0x7f65cc1561d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 --2- 172.21.15.152:0/1805161850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65cc06b370 0x7f65cc156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 >> 172.21.15.152:0/1805161850 conn(0x7f65cc0ccbe0 msgr2=0x7f65cc15d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:26.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 shutdown_connections 2023-10-16T20:07:26.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.438+0000 7f65d3e31700 1 -- 172.21.15.152:0/1805161850 wait complete. 2023-10-16T20:07:26.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:26.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.573+0000 7fcb71195700 1 Processor -- start 2023-10-16T20:07:26.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.573+0000 7fcb71195700 1 -- start start 2023-10-16T20:07:26.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb71195700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c15c770 0x7fcb6c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb71195700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb6c0d06d0 0x7fcb6c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb71195700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0d1070 con 0x7fcb6c0cdbc0 2023-10-16T20:07:26.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb71195700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c15f1b0 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb71195700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c15f490 con 0x7fcb6c15c770 2023-10-16T20:07:26.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb6a59c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb6c0d06d0 0x7fcb6c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb6ad9d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c15c770 0x7fcb6c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb6b59e700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fcb6c0cdbc0 0x7fcb6c0ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:55542/0 (socket says 172.21.15.152:55542) 2023-10-16T20:07:26.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.574+0000 7fcb6b59e700 1 -- 172.21.15.152:0/225308345 learned_addr learned my addr 172.21.15.152:0/225308345 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:26.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb6a59c700 1 -- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c15c770 msgr2=0x7fcb6c15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:26.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb6a59c700 1 --2- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c15c770 0x7fcb6c15ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb6a59c700 1 -- 172.21.15.152:0/225308345 >> v1:172.21.15.163:6789/0 conn(0x7fcb6c0cdbc0 legacy=0x7fcb6c0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb6a59c700 1 -- 172.21.15.152:0/225308345 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c15f770 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb69d9b700 1 -- 172.21.15.152:0/225308345 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071391422 0 0) 0x7fcb6c0d1070 con 0x7fcb6c0cdbc0 2023-10-16T20:07:26.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb6a59c700 1 --2- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009840 tx=0x7fcb5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fabccbe996ef82f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb69d9b700 1 -- 172.21.15.152:0/225308345 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c011830 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb69d9b700 1 -- 172.21.15.152:0/225308345 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c011990 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.575+0000 7fcb69d9b700 1 -- 172.21.15.152:0/225308345 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c011d20 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 -- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c0d06d0 msgr2=0x7fcb6c0d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 --2- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009840 tx=0x7fcb5c009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:26.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 -- 172.21.15.152:0/225308345 shutdown_connections 2023-10-16T20:07:26.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 --2- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c15c770 0x7fcb6c15ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 --2- 172.21.15.152:0/225308345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0b30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 -- 172.21.15.152:0/225308345 >> 172.21.15.152:0/225308345 conn(0x7fcb6c06a820 msgr2=0x7fcb6c06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:26.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 -- 172.21.15.152:0/225308345 shutdown_connections 2023-10-16T20:07:26.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.576+0000 7fcb71195700 1 -- 172.21.15.152:0/225308345 wait complete. 2023-10-16T20:07:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.577+0000 7fcb71195700 1 Processor -- start 2023-10-16T20:07:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.577+0000 7fcb71195700 1 -- start start 2023-10-16T20:07:26.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb71195700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c0cdbc0 0x7fcb6c143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb71195700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb71195700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c15c770 0x7fcb6c1f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb71195700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c157d70 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb71195700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c157a90 con 0x7fcb6c15c770 2023-10-16T20:07:26.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb71195700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c144030 con 0x7fcb6c0cdbc0 2023-10-16T20:07:26.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60168/0 (socket says 172.21.15.152:60168) 2023-10-16T20:07:26.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 -- 172.21.15.152:0/437840907 learned_addr learned my addr 172.21.15.152:0/437840907 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:26.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6ad9d700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c0cdbc0 0x7fcb6c143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6b59e700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c15c770 0x7fcb6c1f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 -- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c0cdbc0 msgr2=0x7fcb6c143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c0cdbc0 0x7fcb6c143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 -- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c15c770 msgr2=0x7fcb6c1f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c15c770 0x7fcb6c1f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 -- 172.21.15.152:0/437840907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0094a0 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6ad9d700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c0cdbc0 0x7fcb6c143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.578+0000 7fcb6a59c700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0d40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0090b0 tx=0x7fcb5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.579+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0038a0 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.579+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c01f070 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.579+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c157160 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.579+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c003c00 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.579+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c157720 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.580+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c0b6fe0 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.580+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcb5c01a430 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.580+0000 7fcb537fe700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcb5806af00 0x7fcb5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.580+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb5c021070 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.580+0000 7fcb6ad9d700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcb5806af00 0x7fcb5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.581+0000 7fcb6ad9d700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcb5806af00 0x7fcb5806d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009b90 tx=0x7fcb60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.585+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcb5c056030 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.773+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcb6c04ebb0 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.774+0000 7fcb537fe700 1 -- 172.21.15.152:0/437840907 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcb5c059650 con 0x7fcb6c0d06d0 2023-10-16T20:07:26.777 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcb5806af00 msgr2=0x7fcb5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcb5806af00 0x7fcb5806d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009b90 tx=0x7fcb60008040 comp rx=0 tx=0).stop 2023-10-16T20:07:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 msgr2=0x7fcb6c0d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0d40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0090b0 tx=0x7fcb5c004750 comp rx=0 tx=0).stop 2023-10-16T20:07:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 shutdown_connections 2023-10-16T20:07:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcb5806af00 0x7fcb5806d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcb6c0cdbc0 0x7fcb6c143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb6c15c770 0x7fcb6c1f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 --2- 172.21.15.152:0/437840907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb6c0d06d0 0x7fcb6c0d0d40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 >> 172.21.15.152:0/437840907 conn(0x7fcb6c06a820 msgr2=0x7fcb6c0cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 shutdown_connections 2023-10-16T20:07:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.776+0000 7fcb71195700 1 -- 172.21.15.152:0/437840907 wait complete. 2023-10-16T20:07:26.791 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:07:26.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.911+0000 7f00efd36700 1 Processor -- start 2023-10-16T20:07:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.912+0000 7f00efd36700 1 -- start start 2023-10-16T20:07:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.912+0000 7f00efd36700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f00e80cdbc0 0x7f00e806cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.912+0000 7f00efd36700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e806e290 0x7f00e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00efd36700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e8161350 con 0x7f00e80ae1c0 2023-10-16T20:07:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00efd36700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e81615f0 con 0x7f00e80cdbc0 2023-10-16T20:07:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00efd36700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e81618d0 con 0x7f00e806e290 2023-10-16T20:07:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00edad2700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f00e80ae1c0 0x7f00e80cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40372/0 (socket says 172.21.15.152:40372) 2023-10-16T20:07:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00edad2700 1 -- 172.21.15.152:0/3005102166 learned_addr learned my addr 172.21.15.152:0/3005102166 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ed2d1700 1 --2- 172.21.15.152:0/3005102166 >> v2:172.21.15.163:3300/0 conn(0x7f00e80cdbc0 0x7f00e806cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ee2d3700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e806e290 0x7f00e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ecad0700 1 -- 172.21.15.152:0/3005102166 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330205861 0 0) 0x7f00e8161350 con 0x7f00e80ae1c0 2023-10-16T20:07:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ecad0700 1 -- 172.21.15.152:0/3005102166 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d40035b0 con 0x7f00e80ae1c0 2023-10-16T20:07:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ed2d1700 1 -- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e806e290 msgr2=0x7f00e806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ed2d1700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e806e290 0x7f00e806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ed2d1700 1 -- 172.21.15.152:0/3005102166 >> v1:172.21.15.152:6789/0 conn(0x7f00e80ae1c0 legacy=0x7f00e80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ed2d1700 1 -- 172.21.15.152:0/3005102166 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8161bb0 con 0x7f00e80cdbc0 2023-10-16T20:07:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ee2d3700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e806e290 0x7f00e806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.913+0000 7f00ed2d1700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e806cc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009840 tx=0x7f00e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deaf7875a960a905 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00ecad0700 1 -- 172.21.15.152:0/3005102166 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4011830 con 0x7f00e80cdbc0 2023-10-16T20:07:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00ecad0700 1 -- 172.21.15.152:0/3005102166 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4011990 con 0x7f00e80cdbc0 2023-10-16T20:07:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00ecad0700 1 -- 172.21.15.152:0/3005102166 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4011d20 con 0x7f00e80cdbc0 2023-10-16T20:07:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 -- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 msgr2=0x7f00e806cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e806cc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009840 tx=0x7f00e4009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 -- 172.21.15.152:0/3005102166 shutdown_connections 2023-10-16T20:07:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e806e290 0x7f00e806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 --2- 172.21.15.152:0/3005102166 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e806cc60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 -- 172.21.15.152:0/3005102166 >> 172.21.15.152:0/3005102166 conn(0x7f00e80cfcd0 msgr2=0x7f00e80d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 -- 172.21.15.152:0/3005102166 shutdown_connections 2023-10-16T20:07:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.914+0000 7f00efd36700 1 -- 172.21.15.152:0/3005102166 wait complete. 2023-10-16T20:07:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 Processor -- start 2023-10-16T20:07:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 -- start start 2023-10-16T20:07:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 0x7f00e8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e80ae1c0 0x7f00e8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e80cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c6b70 con 0x7f00e806e290 2023-10-16T20:07:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c6e50 con 0x7f00e80cdbc0 2023-10-16T20:07:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00efd36700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c7130 con 0x7f00e80ae1c0 2023-10-16T20:07:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00edad2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 0x7f00e8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00edad2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 0x7f00e8156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60180/0 (socket says 172.21.15.152:60180) 2023-10-16T20:07:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.916+0000 7f00edad2700 1 -- 172.21.15.152:0/2223380871 learned_addr learned my addr 172.21.15.152:0/2223380871 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00ed2d1700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e80ae1c0 0x7f00e8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00ee2d3700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e80cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00edad2700 1 -- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e80ae1c0 msgr2=0x7f00e8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00edad2700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e80ae1c0 0x7f00e8154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00edad2700 1 -- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 msgr2=0x7f00e80cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00edad2700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e80cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00edad2700 1 -- 172.21.15.152:0/2223380871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0009a70 con 0x7f00e806e290 2023-10-16T20:07:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.917+0000 7f00edad2700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 0x7f00e8156790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c700 tx=0x7f00d800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.919+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8005d70 con 0x7f00e806e290 2023-10-16T20:07:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.919+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e40094a0 con 0x7f00e806e290 2023-10-16T20:07:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.919+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d80070d0 con 0x7f00e806e290 2023-10-16T20:07:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.919+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8007460 con 0x7f00e806e290 2023-10-16T20:07:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.919+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e80c76f0 con 0x7f00e806e290 2023-10-16T20:07:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.920+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e804ebb0 con 0x7f00e806e290 2023-10-16T20:07:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.921+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f00d80075c0 con 0x7f00e806e290 2023-10-16T20:07:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.921+0000 7f00de7fc700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f00cc06af00 0x7f00cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.921+0000 7f00ed2d1700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f00cc06af00 0x7f00cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.921+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00d8089000 con 0x7f00e806e290 2023-10-16T20:07:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.921+0000 7f00ed2d1700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f00cc06af00 0x7f00cc06d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009840 tx=0x7f00e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:26.925+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00d8053d00 con 0x7f00e806e290 2023-10-16T20:07:27.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.130+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00e806bda0 con 0x7f00e806e290 2023-10-16T20:07:27.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.131+0000 7f00de7fc700 1 -- 172.21.15.152:0/2223380871 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f00d8057320 con 0x7f00e806e290 2023-10-16T20:07:27.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f00cc06af00 msgr2=0x7f00cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f00cc06af00 0x7f00cc06d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009840 tx=0x7f00e4008030 comp rx=0 tx=0).stop 2023-10-16T20:07:27.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 msgr2=0x7f00e8156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 0x7f00e8156790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c700 tx=0x7f00d800cac0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 shutdown_connections 2023-10-16T20:07:27.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f00cc06af00 0x7f00cc06d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00e80cdbc0 0x7f00e80cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00e806e290 0x7f00e8156790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 --2- 172.21.15.152:0/2223380871 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f00e80ae1c0 0x7f00e8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 >> 172.21.15.152:0/2223380871 conn(0x7f00e80cfcd0 msgr2=0x7f00e806e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:27.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 shutdown_connections 2023-10-16T20:07:27.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.133+0000 7f00efd36700 1 -- 172.21.15.152:0/2223380871 wait complete. 2023-10-16T20:07:27.138 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2023-10-16T20:07:27.147 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-16T20:07:27.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:27.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-16T20:07:27.187 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:07:27.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:27.188 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T20:07:27.244 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:27.245 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:27.266 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:27.266 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:27.326 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:07:27.326 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:07:27.386 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:27.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.503+0000 7f7ea1060700 1 Processor -- start 2023-10-16T20:07:27.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7ea1060700 1 -- start start 2023-10-16T20:07:27.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7ea1060700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 0x7f7e9c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7ea1060700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c15ca20 con 0x7f7e9c15f000 2023-10-16T20:07:27.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7ea1060700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9c0726b0 con 0x7f7e9c0cc310 2023-10-16T20:07:27.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7ea1060700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0cc790 con 0x7f7e9c06a820 2023-10-16T20:07:27.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7e9b59e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7e9c15f000 0x7f7e9c15f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40390/0 (socket says 172.21.15.152:40390) 2023-10-16T20:07:27.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.504+0000 7f7e9b59e700 1 -- 172.21.15.152:0/1036081088 learned_addr learned my addr 172.21.15.152:0/1036081088 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:27.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9ad9d700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 0x7f7e9c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973467118 0 0) 0x7f7e9c15ca20 con 0x7f7e9c15f000 2023-10-16T20:07:27.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e840035b0 con 0x7f7e9c15f000 2023-10-16T20:07:27.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1960861378 0 0) 0x7f7e840035b0 con 0x7f7e9c15f000 2023-10-16T20:07:27.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 msgr2=0x7f7e9c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:27.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 0x7f7e9c0ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 >> v1:172.21.15.163:6789/0 conn(0x7f7e9c0cc310 legacy=0x7f7e9c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0718f0 con 0x7f7e9c15f000 2023-10-16T20:07:27.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f7e94001a40 con 0x7f7e9c15f000 2023-10-16T20:07:27.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 >> v1:172.21.15.152:6789/0 conn(0x7f7e9c15f000 legacy=0x7f7e9c15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e84003a30 0x7f7e84003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e84004850 0x7f7e84004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 0x7f7e84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0cc790 con 0x7f7e84004850 2023-10-16T20:07:27.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8400bac0 con 0x7f7e84003a30 2023-10-16T20:07:27.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8400bc80 con 0x7f7e9c06a820 2023-10-16T20:07:27.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9a59c700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e84004850 0x7f7e84004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9ad9d700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e84003a30 0x7f7e84003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9b59e700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 0x7f7e84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9a59c700 1 -- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 msgr2=0x7f7e84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:27.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9a59c700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e9c06a820 0x7f7e84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9a59c700 1 -- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e84003a30 msgr2=0x7f7e84003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:27.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9a59c700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e84003a30 0x7f7e84003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.505+0000 7f7e9a59c700 1 -- 172.21.15.152:0/1036081088 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840035b0 con 0x7f7e84004850 2023-10-16T20:07:27.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7e9ad9d700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e84003a30 0x7f7e84003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:27.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7e9a59c700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e84004850 0x7f7e84004cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c007fd0 tx=0x7f7e84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74a9093038bbc48 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:27.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0012f0 con 0x7f7e84004850 2023-10-16T20:07:27.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0052f0 con 0x7f7e84004850 2023-10-16T20:07:27.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7e99d9b700 1 -- 172.21.15.152:0/1036081088 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c006860 con 0x7f7e84004850 2023-10-16T20:07:27.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7ea1060700 1 -- 172.21.15.152:0/1036081088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e84004850 msgr2=0x7f7e84004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1036081088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e84004850 0x7f7e84004cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c007fd0 tx=0x7f7e84005880 comp rx=0 tx=0).stop 2023-10-16T20:07:27.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7e9b59e700 1 -- 172.21.15.152:0/1036081088 reap_dead start 2023-10-16T20:07:27.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7ea1060700 1 -- 172.21.15.152:0/1036081088 shutdown_connections 2023-10-16T20:07:27.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7ea1060700 1 -- 172.21.15.152:0/1036081088 >> 172.21.15.152:0/1036081088 conn(0x7f7e9c0d0180 msgr2=0x7f7e9c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7ea1060700 1 -- 172.21.15.152:0/1036081088 shutdown_connections 2023-10-16T20:07:27.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.506+0000 7f7ea1060700 1 -- 172.21.15.152:0/1036081088 wait complete. 2023-10-16T20:07:27.521 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.508+0000 7f7ea1060700 1 Processor -- start 2023-10-16T20:07:27.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.508+0000 7f7ea1060700 1 -- start start 2023-10-16T20:07:27.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7ea1060700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e84004850 0x7f7e9c09d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7ea1060700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e9c156c70 0x7f7e9c1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7ea1060700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 0x7f7e9c0c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7ea1060700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1f53c0 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7ea1060700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c154670 con 0x7f7e9c156c70 2023-10-16T20:07:27.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7ea1060700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0c56f0 con 0x7f7e84004850 2023-10-16T20:07:27.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7e9b59e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 0x7f7e9c0c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7e9b59e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 0x7f7e9c0c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60204/0 (socket says 172.21.15.152:60204) 2023-10-16T20:07:27.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7e9b59e700 1 -- 172.21.15.152:0/1637171425 learned_addr learned my addr 172.21.15.152:0/1637171425 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:27.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7e9ad9d700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e84004850 0x7f7e9c09d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.509+0000 7f7e9a59c700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e9c156c70 0x7f7e9c1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e9b59e700 1 -- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e84004850 msgr2=0x7f7e9c09d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e9b59e700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e84004850 0x7f7e9c09d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e9b59e700 1 -- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e9c156c70 msgr2=0x7f7e9c1f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e9b59e700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e9c156c70 0x7f7e9c1f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e9b59e700 1 -- 172.21.15.152:0/1637171425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0c7250 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e9b59e700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 0x7f7e9c0c51b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7e94001420 tx=0x7f7e94007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:27.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94017070 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9400e860 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400e9f0 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c1548a0 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.510+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0c7780 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.511+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c072170 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.511+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e94007d50 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.512+0000 7f7e837fe700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7e8806af00 0x7f7e8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.512+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e94088f10 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.512+0000 7f7e9ad9d700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7e8806af00 0x7f7e8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.512+0000 7f7e9ad9d700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7e8806af00 0x7f7e8806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009be0 tx=0x7f7e90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:27.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.516+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e9c072170 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.705+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9c072170 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.707+0000 7f7e837fe700 1 -- 172.21.15.152:0/1637171425 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f7e9c072170 con 0x7f7e9c0c4d30 2023-10-16T20:07:27.710 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:27.710 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:27.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7e8806af00 msgr2=0x7f7e8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7e8806af00 0x7f7e8806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009be0 tx=0x7f7e90008040 comp rx=0 tx=0).stop 2023-10-16T20:07:27.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 msgr2=0x7f7e9c0c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 0x7f7e9c0c51b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7e94001420 tx=0x7f7e94007c40 comp rx=0 tx=0).stop 2023-10-16T20:07:27.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 shutdown_connections 2023-10-16T20:07:27.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7e8806af00 0x7f7e8806d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7e84004850 0x7f7e9c09d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e9c0c4d30 0x7f7e9c0c51b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 --2- 172.21.15.152:0/1637171425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e9c156c70 0x7f7e9c1f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 >> 172.21.15.152:0/1637171425 conn(0x7f7e9c0d0180 msgr2=0x7f7e9c0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:27.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 shutdown_connections 2023-10-16T20:07:27.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.709+0000 7f7ea1060700 1 -- 172.21.15.152:0/1637171425 wait complete. 2023-10-16T20:07:27.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:27.725 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:27.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.848+0000 7f0d706ef700 1 Processor -- start 2023-10-16T20:07:27.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.848+0000 7f0d706ef700 1 -- start start 2023-10-16T20:07:27.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d706ef700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d6815b4e0 0x7f0d6806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d706ef700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0d680b33f0 0x7f0d680b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d706ef700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d68070620 con 0x7f0d680cd770 2023-10-16T20:07:27.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d706ef700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d68070900 con 0x7f0d6815b4e0 2023-10-16T20:07:27.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d706ef700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d68070be0 con 0x7f0d680b33f0 2023-10-16T20:07:27.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d6815b4e0 0x7f0d6806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d6815b4e0 0x7f0d6806f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60208/0 (socket says 172.21.15.152:60208) 2023-10-16T20:07:27.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 -- 172.21.15.152:0/4175300821 learned_addr learned my addr 172.21.15.152:0/4175300821 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:27.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6ec8c700 1 --2- 172.21.15.152:0/4175300821 >> v2:172.21.15.163:3300/0 conn(0x7f0d680b33f0 0x7f0d680b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 -- 172.21.15.152:0/4175300821 >> v2:172.21.15.163:3300/0 conn(0x7f0d680b33f0 msgr2=0x7f0d680b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:27.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 --2- 172.21.15.152:0/4175300821 >> v2:172.21.15.163:3300/0 conn(0x7f0d680b33f0 0x7f0d680b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 -- 172.21.15.152:0/4175300821 >> v1:172.21.15.163:6789/0 conn(0x7f0d680cd770 legacy=0x7f0d680b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:27.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 -- 172.21.15.152:0/4175300821 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68070ec0 con 0x7f0d6815b4e0 2023-10-16T20:07:27.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6ec8c700 1 --2- 172.21.15.152:0/4175300821 >> v2:172.21.15.163:3300/0 conn(0x7f0d680b33f0 0x7f0d680b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:27.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6e48b700 1 --2- 172.21.15.152:0/4175300821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d6806f280 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0d680cce60 tx=0x7f0d64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb46f4f772098cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:27.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.849+0000 7f0d6d489700 1 -- 172.21.15.152:0/4175300821 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64004230 con 0x7f0d6815b4e0 2023-10-16T20:07:27.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d6d489700 1 -- 172.21.15.152:0/4175300821 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64004390 con 0x7f0d6815b4e0 2023-10-16T20:07:27.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d6d489700 1 -- 172.21.15.152:0/4175300821 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640036a0 con 0x7f0d6815b4e0 2023-10-16T20:07:27.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 -- 172.21.15.152:0/4175300821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 msgr2=0x7f0d6806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 --2- 172.21.15.152:0/4175300821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d6806f280 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0d680cce60 tx=0x7f0d64009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 -- 172.21.15.152:0/4175300821 shutdown_connections 2023-10-16T20:07:27.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 --2- 172.21.15.152:0/4175300821 >> v2:172.21.15.163:3300/0 conn(0x7f0d680b33f0 0x7f0d680b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 --2- 172.21.15.152:0/4175300821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d6806f280 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 -- 172.21.15.152:0/4175300821 >> 172.21.15.152:0/4175300821 conn(0x7f0d680cdce0 msgr2=0x7f0d680ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:27.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 -- 172.21.15.152:0/4175300821 shutdown_connections 2023-10-16T20:07:27.858 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.850+0000 7f0d706ef700 1 -- 172.21.15.152:0/4175300821 wait complete. 2023-10-16T20:07:27.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.851+0000 7f0d706ef700 1 Processor -- start 2023-10-16T20:07:27.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.851+0000 7f0d706ef700 1 -- start start 2023-10-16T20:07:27.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d706ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d680b33f0 0x7f0d681e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d706ef700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d680cd770 0x7f0d680c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d706ef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d68159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d706ef700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68155d00 con 0x7f0d6815b4e0 2023-10-16T20:07:27.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d706ef700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6806bd50 con 0x7f0d680b33f0 2023-10-16T20:07:27.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d706ef700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6806c030 con 0x7f0d680cd770 2023-10-16T20:07:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d68159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d68159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60218/0 (socket says 172.21.15.152:60218) 2023-10-16T20:07:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 -- 172.21.15.152:0/2341767505 learned_addr learned my addr 172.21.15.152:0/2341767505 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6e48b700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d680b33f0 0x7f0d681e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6dc8a700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d680cd770 0x7f0d680c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 -- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d680cd770 msgr2=0x7f0d680c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d680cd770 0x7f0d680c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 -- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d680b33f0 msgr2=0x7f0d681e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d680b33f0 0x7f0d681e6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6ec8c700 1 -- 172.21.15.152:0/2341767505 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64009550 con 0x7f0d6815b4e0 2023-10-16T20:07:27.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.852+0000 7f0d6e48b700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d680b33f0 0x7f0d681e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.853+0000 7f0d6ec8c700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d68159a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000cea0 tx=0x7f0d6000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.853+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000ae50 con 0x7f0d6815b4e0 2023-10-16T20:07:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.853+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60003a20 con 0x7f0d6815b4e0 2023-10-16T20:07:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.853+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6806c310 con 0x7f0d6815b4e0 2023-10-16T20:07:27.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.853+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60003dd0 con 0x7f0d6815b4e0 2023-10-16T20:07:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.853+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d681e6f60 con 0x7f0d6815b4e0 2023-10-16T20:07:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.854+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d681e7120 con 0x7f0d6815b4e0 2023-10-16T20:07:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.854+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d60003f30 con 0x7f0d6815b4e0 2023-10-16T20:07:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.854+0000 7f0d5effd700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d4c06af00 0x7f0d4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:27.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.855+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d60089d50 con 0x7f0d6815b4e0 2023-10-16T20:07:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.855+0000 7f0d6e48b700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d4c06af00 0x7f0d4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.855+0000 7f0d6e48b700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d4c06af00 0x7f0d4c06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009130 tx=0x7f0d64008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:27.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:27.859+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d681e7120 con 0x7f0d6815b4e0 2023-10-16T20:07:28.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.050+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d681e7120 con 0x7f0d6815b4e0 2023-10-16T20:07:28.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.050+0000 7f0d5effd700 1 -- 172.21.15.152:0/2341767505 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d681e7120 con 0x7f0d6815b4e0 2023-10-16T20:07:28.054 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:28.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d4c06af00 msgr2=0x7f0d4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d4c06af00 0x7f0d4c06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009130 tx=0x7f0d64008030 comp rx=0 tx=0).stop 2023-10-16T20:07:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 msgr2=0x7f0d68159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d68159a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000cea0 tx=0x7f0d6000cf80 comp rx=0 tx=0).stop 2023-10-16T20:07:28.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 shutdown_connections 2023-10-16T20:07:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0d4c06af00 0x7f0d4c06d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d6815b4e0 0x7f0d68159a10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d680b33f0 0x7f0d681e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 --2- 172.21.15.152:0/2341767505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0d680cd770 0x7f0d680c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 >> 172.21.15.152:0/2341767505 conn(0x7f0d680cdce0 msgr2=0x7f0d680c44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 shutdown_connections 2023-10-16T20:07:28.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.052+0000 7f0d706ef700 1 -- 172.21.15.152:0/2341767505 wait complete. 2023-10-16T20:07:28.067 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:28.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.188+0000 7f5fa06dd700 1 Processor -- start 2023-10-16T20:07:28.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.188+0000 7f5fa06dd700 1 -- start start 2023-10-16T20:07:28.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.189+0000 7f5fa06dd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.189+0000 7f5fa06dd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980ce610 con 0x7f5f980ce1b0 2023-10-16T20:07:28.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.189+0000 7f5fa06dd700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f980d1200 con 0x7f5f980cd2d0 2023-10-16T20:07:28.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.189+0000 7f5fa06dd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980d1e80 con 0x7f5f980d0d60 2023-10-16T20:07:28.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9ec7a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5f980ce1b0 0x7f5f980cb8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40424/0 (socket says 172.21.15.152:40424) 2023-10-16T20:07:28.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9ec7a700 1 -- 172.21.15.152:0/3767240772 learned_addr learned my addr 172.21.15.152:0/3767240772 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:28.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9dc78700 1 --2- 172.21.15.152:0/3767240772 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583049531 0 0) 0x7f5f980ce610 con 0x7f5f980ce1b0 2023-10-16T20:07:28.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f840035b0 con 0x7f5f980ce1b0 2023-10-16T20:07:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213602828 0 0) 0x7f5f980d1200 con 0x7f5f980cd2d0 2023-10-16T20:07:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f980ce610 con 0x7f5f980cd2d0 2023-10-16T20:07:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9dc78700 1 -- 172.21.15.152:0/3767240772 >> v1:172.21.15.163:6789/0 conn(0x7f5f980cd2d0 legacy=0x7f5f9815e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9dc78700 1 -- 172.21.15.152:0/3767240772 >> v1:172.21.15.152:6789/0 conn(0x7f5f980ce1b0 legacy=0x7f5f980cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9dc78700 1 -- 172.21.15.152:0/3767240772 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980d14e0 con 0x7f5f980d0d60 2023-10-16T20:07:28.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9dc78700 1 --2- 172.21.15.152:0/3767240772 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980cdc70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009870 tx=0x7f5f94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=589539d2f7bb1174 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94011830 con 0x7f5f980d0d60 2023-10-16T20:07:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f94011990 con 0x7f5f980d0d60 2023-10-16T20:07:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.190+0000 7f5f9d477700 1 -- 172.21.15.152:0/3767240772 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94011d00 con 0x7f5f980d0d60 2023-10-16T20:07:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3767240772 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 msgr2=0x7f5f980cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3767240772 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980cdc70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009870 tx=0x7f5f94009b80 comp rx=0 tx=0).stop 2023-10-16T20:07:28.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3767240772 shutdown_connections 2023-10-16T20:07:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3767240772 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980cdc70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3767240772 >> 172.21.15.152:0/3767240772 conn(0x7f5f9806a820 msgr2=0x7f5f9806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3767240772 shutdown_connections 2023-10-16T20:07:28.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.191+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3767240772 wait complete. 2023-10-16T20:07:28.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.193+0000 7f5fa06dd700 1 Processor -- start 2023-10-16T20:07:28.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.193+0000 7f5fa06dd700 1 -- start start 2023-10-16T20:07:28.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 0x7f5f980c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f980ce1b0 0x7f5f980b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980ac960 con 0x7f5f980cd2d0 2023-10-16T20:07:28.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980c7410 con 0x7f5f980ce1b0 2023-10-16T20:07:28.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980c76f0 con 0x7f5f980d0d60 2023-10-16T20:07:28.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 0x7f5f980c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 0x7f5f980c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60228/0 (socket says 172.21.15.152:60228) 2023-10-16T20:07:28.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 -- 172.21.15.152:0/3725564593 learned_addr learned my addr 172.21.15.152:0/3725564593 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:28.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9ec7a700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9dc78700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f980ce1b0 0x7f5f980b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 -- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 msgr2=0x7f5f980b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 -- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f980ce1b0 msgr2=0x7f5f980b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f980ce1b0 0x7f5f980b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 -- 172.21.15.152:0/3725564593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940094a0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f9e479700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 0x7f5f980c6b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c500 tx=0x7f5f8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880052d0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88005430 con 0x7f5f980cd2d0 2023-10-16T20:07:28.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f980c79d0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880038c0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.194+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f980c70c0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.195+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9804ebb0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.196+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f88003a20 con 0x7f5f980cd2d0 2023-10-16T20:07:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.196+0000 7f5f8effd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f7c06af00 0x7f5f7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.196+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f88089000 con 0x7f5f980cd2d0 2023-10-16T20:07:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.196+0000 7f5f9dc78700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f7c06af00 0x7f5f7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.197+0000 7f5f9dc78700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f7c06af00 0x7f5f7c06d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f940090b0 tx=0x7f5f94008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.201+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f88053be0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.390+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f980b36e0 con 0x7f5f980cd2d0 2023-10-16T20:07:28.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.390+0000 7f5f8effd700 1 -- 172.21.15.152:0/3725564593 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f88057200 con 0x7f5f980cd2d0 2023-10-16T20:07:28.394 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:28.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f7c06af00 msgr2=0x7f5f7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f7c06af00 0x7f5f7c06d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f940090b0 tx=0x7f5f94008030 comp rx=0 tx=0).stop 2023-10-16T20:07:28.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 msgr2=0x7f5f980c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 0x7f5f980c6b80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c500 tx=0x7f5f8800c8c0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 shutdown_connections 2023-10-16T20:07:28.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5f7c06af00 0x7f5f7c06d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5f980d0d60 0x7f5f980b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f980cd2d0 0x7f5f980c6b80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 --2- 172.21.15.152:0/3725564593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f980ce1b0 0x7f5f980b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 >> 172.21.15.152:0/3725564593 conn(0x7f5f9806a820 msgr2=0x7f5f9806d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:28.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 shutdown_connections 2023-10-16T20:07:28.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.393+0000 7f5fa06dd700 1 -- 172.21.15.152:0/3725564593 wait complete. 2023-10-16T20:07:28.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:28.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.528+0000 7fcec3daa700 1 Processor -- start 2023-10-16T20:07:28.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.528+0000 7fcec3daa700 1 -- start start 2023-10-16T20:07:28.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec3daa700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcebc06b370 0x7fcebc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec3daa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 0x7fcebc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec3daa700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc161360 con 0x7fcebc0cdd30 2023-10-16T20:07:28.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec3daa700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc06b750 con 0x7fcebc06b370 2023-10-16T20:07:28.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec3daa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15e300 con 0x7fcebc06a820 2023-10-16T20:07:28.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec2347700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcebc0cdd30 0x7fcebc1617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40438/0 (socket says 172.21.15.152:40438) 2023-10-16T20:07:28.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.529+0000 7fcec2347700 1 -- 172.21.15.152:0/1560082134 learned_addr learned my addr 172.21.15.152:0/1560082134 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1b46700 1 --2- 172.21.15.152:0/1560082134 >> v2:172.21.15.163:3300/0 conn(0x7fcebc06b370 0x7fcebc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 0x7fcebc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760800953 0 0) 0x7fcebc161360 con 0x7fcebc0cdd30 2023-10-16T20:07:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea80035b0 con 0x7fcebc0cdd30 2023-10-16T20:07:28.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400728782 0 0) 0x7fcea80035b0 con 0x7fcebc0cdd30 2023-10-16T20:07:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 msgr2=0x7fcebc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 0x7fcebc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 >> v2:172.21.15.163:3300/0 conn(0x7fcebc06b370 msgr2=0x7fcebc15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 --2- 172.21.15.152:0/1560082134 >> v2:172.21.15.163:3300/0 conn(0x7fcebc06b370 0x7fcebc15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc15e5e0 con 0x7fcebc0cdd30 2023-10-16T20:07:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fceb40019f0 con 0x7fcebc0cdd30 2023-10-16T20:07:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 >> v1:172.21.15.152:6789/0 conn(0x7fcebc0cdd30 legacy=0x7fcebc1617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea8003a00 0x7fcea8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcea8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 0x7fcea8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc06b750 con 0x7fcea8004850 2023-10-16T20:07:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15e300 con 0x7fcea8003a00 2023-10-16T20:07:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea800ba10 con 0x7fcebc06a820 2023-10-16T20:07:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcea8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1b46700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea8003a00 0x7fcea8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec2347700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 0x7fcea8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 -- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 msgr2=0x7fcea8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:28.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc06a820 0x7fcea8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 -- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea8003a00 msgr2=0x7fcea8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:28.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcea8003a00 0x7fcea8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.530+0000 7fcec1345700 1 -- 172.21.15.152:0/1560082134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80035b0 con 0x7fcea8004850 2023-10-16T20:07:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec1345700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcea8004cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009b30 tx=0x7fcea8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea4e5c6fd410aac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb800e6c0 con 0x7fcea8004850 2023-10-16T20:07:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb800e820 con 0x7fcea8004850 2023-10-16T20:07:28.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec0b44700 1 -- 172.21.15.152:0/1560082134 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb800eb90 con 0x7fcea8004850 2023-10-16T20:07:28.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec3daa700 1 -- 172.21.15.152:0/1560082134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 msgr2=0x7fcea8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec3daa700 1 --2- 172.21.15.152:0/1560082134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcea8004cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009b30 tx=0x7fcea8005880 comp rx=0 tx=0).stop 2023-10-16T20:07:28.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec2347700 1 -- 172.21.15.152:0/1560082134 reap_dead start 2023-10-16T20:07:28.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec3daa700 1 -- 172.21.15.152:0/1560082134 shutdown_connections 2023-10-16T20:07:28.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec3daa700 1 -- 172.21.15.152:0/1560082134 >> 172.21.15.152:0/1560082134 conn(0x7fcebc0ccbe0 msgr2=0x7fcebc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:28.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec3daa700 1 -- 172.21.15.152:0/1560082134 shutdown_connections 2023-10-16T20:07:28.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.531+0000 7fcec3daa700 1 -- 172.21.15.152:0/1560082134 wait complete. 2023-10-16T20:07:28.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.532+0000 7fcec3daa700 1 Processor -- start 2023-10-16T20:07:28.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 -- start start 2023-10-16T20:07:28.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcebc1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcebc0acba0 0x7fcebc0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc159650 0x7fcebc159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15a010 con 0x7fcea8004850 2023-10-16T20:07:28.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc15c050 con 0x7fcebc0acba0 2023-10-16T20:07:28.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec3daa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc0cc4b0 con 0x7fcebc159650 2023-10-16T20:07:28.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec1b46700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcebc1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec1b46700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcebc1556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60248/0 (socket says 172.21.15.152:60248) 2023-10-16T20:07:28.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.533+0000 7fcec1b46700 1 -- 172.21.15.152:0/2004269023 learned_addr learned my addr 172.21.15.152:0/2004269023 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:28.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec1b46700 1 -- 172.21.15.152:0/2004269023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc159650 msgr2=0x7fcebc159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec1b46700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc159650 0x7fcebc159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec1b46700 1 -- 172.21.15.152:0/2004269023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcebc0acba0 msgr2=0x7fcebc0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec1b46700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcebc0acba0 0x7fcebc0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec1b46700 1 -- 172.21.15.152:0/2004269023 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc159470 con 0x7fcea8004850 2023-10-16T20:07:28.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec1b46700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcebc1556c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fceac011aa0 tx=0x7fceac011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00f9e0 con 0x7fcea8004850 2023-10-16T20:07:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00fb40 con 0x7fcea8004850 2023-10-16T20:07:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc159190 con 0x7fcea8004850 2023-10-16T20:07:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac014440 con 0x7fcea8004850 2023-10-16T20:07:28.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.534+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc15bce0 con 0x7fcea8004850 2023-10-16T20:07:28.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.535+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc15c330 con 0x7fcea8004850 2023-10-16T20:07:28.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.535+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fceac0145a0 con 0x7fcea8004850 2023-10-16T20:07:28.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.536+0000 7fceb27fc700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcea006af00 0x7fcea006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.536+0000 7fcec1345700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcea006af00 0x7fcea006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.536+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fceac08a170 con 0x7fcea8004850 2023-10-16T20:07:28.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.536+0000 7fcec1345700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcea006af00 0x7fcea006d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ca710 tx=0x7fceb8013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.540+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fceac054ef0 con 0x7fcea8004850 2023-10-16T20:07:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.728+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcebc072d10 con 0x7fcea8004850 2023-10-16T20:07:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.729+0000 7fceb27fc700 1 -- 172.21.15.152:0/2004269023 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fceac058510 con 0x7fcea8004850 2023-10-16T20:07:28.732 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:28.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcea006af00 msgr2=0x7fcea006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcea006af00 0x7fcea006d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ca710 tx=0x7fceb8013000 comp rx=0 tx=0).stop 2023-10-16T20:07:28.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 msgr2=0x7fcebc1556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcebc1556c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fceac011aa0 tx=0x7fceac011e60 comp rx=0 tx=0).stop 2023-10-16T20:07:28.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 shutdown_connections 2023-10-16T20:07:28.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcea006af00 0x7fcea006d3c0 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ca710 tx=0x7fceb8013000 comp rx=0 tx=0).stop 2023-10-16T20:07:28.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcebc159650 0x7fcebc159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8004850 0x7fcebc1556c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 --2- 172.21.15.152:0/2004269023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcebc0acba0 0x7fcebc0cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 >> 172.21.15.152:0/2004269023 conn(0x7fcebc0ccbe0 msgr2=0x7fcebc15f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:28.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 shutdown_connections 2023-10-16T20:07:28.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.731+0000 7fcec3daa700 1 -- 172.21.15.152:0/2004269023 wait complete. 2023-10-16T20:07:28.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:28.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.868+0000 7fda927ea700 1 Processor -- start 2023-10-16T20:07:28.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 -- start start 2023-10-16T20:07:28.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fda8c15d760 0x7fda8c0b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda8c0ce0a0 0x7fda8c0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c0b95a0 con 0x7fda8c0ce0a0 2023-10-16T20:07:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8c06c1b0 con 0x7fda8c15d760 2023-10-16T20:07:28.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda927ea700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c0cf420 con 0x7fda8c06b7e0 2023-10-16T20:07:28.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda8b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda8c0ce0a0 0x7fda8c0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda8b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda8c0ce0a0 0x7fda8c0cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60258/0 (socket says 172.21.15.152:60258) 2023-10-16T20:07:28.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.869+0000 7fda8b7fe700 1 -- 172.21.15.152:0/2934517842 learned_addr learned my addr 172.21.15.152:0/2934517842 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:28.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8bfff700 1 --2- 172.21.15.152:0/2934517842 >> v2:172.21.15.163:3300/0 conn(0x7fda8c15d760 0x7fda8c0b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda90d87700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8b7fe700 1 -- 172.21.15.152:0/2934517842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 msgr2=0x7fda8c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:28.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8b7fe700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c06bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8b7fe700 1 -- 172.21.15.152:0/2934517842 >> v2:172.21.15.163:3300/0 conn(0x7fda8c15d760 msgr2=0x7fda8c0b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:28.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8b7fe700 1 --2- 172.21.15.152:0/2934517842 >> v2:172.21.15.163:3300/0 conn(0x7fda8c15d760 0x7fda8c0b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8b7fe700 1 -- 172.21.15.152:0/2934517842 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0cfdf0 con 0x7fda8c0ce0a0 2023-10-16T20:07:28.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda90d87700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:28.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8bfff700 1 --2- 172.21.15.152:0/2934517842 >> v2:172.21.15.163:3300/0 conn(0x7fda8c15d760 0x7fda8c0b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:28.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8b7fe700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0cf8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fda8c06c380 tx=0x7fda7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f35a297d7d10ce server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8affd700 1 -- 172.21.15.152:0/2934517842 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00b870 con 0x7fda8c0ce0a0 2023-10-16T20:07:28.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8affd700 1 -- 172.21.15.152:0/2934517842 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c00b9d0 con 0x7fda8c0ce0a0 2023-10-16T20:07:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.870+0000 7fda8affd700 1 -- 172.21.15.152:0/2934517842 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00bd60 con 0x7fda8c0ce0a0 2023-10-16T20:07:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 -- 172.21.15.152:0/2934517842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c0ce0a0 msgr2=0x7fda8c0cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0cf8b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fda8c06c380 tx=0x7fda7c009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 -- 172.21.15.152:0/2934517842 shutdown_connections 2023-10-16T20:07:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 --2- 172.21.15.152:0/2934517842 >> v2:172.21.15.163:3300/0 conn(0x7fda8c15d760 0x7fda8c0b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 --2- 172.21.15.152:0/2934517842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0cf8b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 -- 172.21.15.152:0/2934517842 >> 172.21.15.152:0/2934517842 conn(0x7fda8c072340 msgr2=0x7fda8c072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:28.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 -- 172.21.15.152:0/2934517842 shutdown_connections 2023-10-16T20:07:28.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.871+0000 7fda927ea700 1 -- 172.21.15.152:0/2934517842 wait complete. 2023-10-16T20:07:28.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.872+0000 7fda927ea700 1 Processor -- start 2023-10-16T20:07:28.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.872+0000 7fda927ea700 1 -- start start 2023-10-16T20:07:28.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 0x7fda8c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c15f650 con 0x7fda8c15d760 2023-10-16T20:07:28.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1e5a60 con 0x7fda8c0ce0a0 2023-10-16T20:07:28.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c15e9d0 con 0x7fda8c06b7e0 2023-10-16T20:07:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 0x7fda8c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 0x7fda8c15a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60266/0 (socket says 172.21.15.152:60266) 2023-10-16T20:07:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 -- 172.21.15.152:0/3154787315 learned_addr learned my addr 172.21.15.152:0/3154787315 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda8bfff700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda8b7fe700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 -- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 msgr2=0x7fda8c1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 -- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda8c0ce0a0 msgr2=0x7fda8c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 -- 172.21.15.152:0/3154787315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009550 con 0x7fda8c15d760 2023-10-16T20:07:28.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda8bfff700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:28.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda90d87700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 0x7fda8c15a200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fda84007ef0 tx=0x7fda8400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8400de30 con 0x7fda8c15d760 2023-10-16T20:07:28.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8400f040 con 0x7fda8c15d760 2023-10-16T20:07:28.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c15ecb0 con 0x7fda8c15d760 2023-10-16T20:07:28.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.873+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84003c60 con 0x7fda8c15d760 2023-10-16T20:07:28.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.874+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c15f270 con 0x7fda8c15d760 2023-10-16T20:07:28.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.875+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c15f790 con 0x7fda8c15d760 2023-10-16T20:07:28.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.875+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda84004030 con 0x7fda8c15d760 2023-10-16T20:07:28.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.875+0000 7fda88ff9700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fda7806af00 0x7fda7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:28.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.875+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda84089a00 con 0x7fda8c15d760 2023-10-16T20:07:28.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.875+0000 7fda8bfff700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fda7806af00 0x7fda7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:28.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.876+0000 7fda8bfff700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fda7806af00 0x7fda7806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fda80009930 tx=0x7fda80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:28.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:28.880+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda84054780 con 0x7fda8c15d760 2023-10-16T20:07:29.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.071+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fda8c04ebb0 con 0x7fda8c15d760 2023-10-16T20:07:29.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.071+0000 7fda88ff9700 1 -- 172.21.15.152:0/3154787315 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fda8401a020 con 0x7fda8c15d760 2023-10-16T20:07:29.075 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:29.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fda7806af00 msgr2=0x7fda7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fda7806af00 0x7fda7806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fda80009930 tx=0x7fda80008040 comp rx=0 tx=0).stop 2023-10-16T20:07:29.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 msgr2=0x7fda8c15a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 0x7fda8c15a200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fda84007ef0 tx=0x7fda8400d3b0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 shutdown_connections 2023-10-16T20:07:29.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fda7806af00 0x7fda7806d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fda8c06b7e0 0x7fda8c1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda8c15d760 0x7fda8c15a200 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 --2- 172.21.15.152:0/3154787315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda8c0ce0a0 0x7fda8c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 >> 172.21.15.152:0/3154787315 conn(0x7fda8c072340 msgr2=0x7fda8c0d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:29.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 shutdown_connections 2023-10-16T20:07:29.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.074+0000 7fda927ea700 1 -- 172.21.15.152:0/3154787315 wait complete. 2023-10-16T20:07:29.089 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T20:07:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.208+0000 7fdd84c2b700 1 Processor -- start 2023-10-16T20:07:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.208+0000 7fdd84c2b700 1 -- start start 2023-10-16T20:07:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd84c2b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdd800b5700 0x7fdd800cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd84c2b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdd800b9000 0x7fdd800ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd84c2b700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800d0010 con 0x7fdd80160b50 2023-10-16T20:07:29.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd84c2b700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd800d02f0 con 0x7fdd800b5700 2023-10-16T20:07:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd84c2b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd800d05d0 con 0x7fdd800b9000 2023-10-16T20:07:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd7dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdd800b5700 0x7fdd800cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd7e59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdd80160b50 0x7fdd800b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40468/0 (socket says 172.21.15.152:40468) 2023-10-16T20:07:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd7dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdd800b5700 0x7fdd800cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60270/0 (socket says 172.21.15.152:60270) 2023-10-16T20:07:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd7e59c700 1 -- 172.21.15.152:0/3719768622 learned_addr learned my addr 172.21.15.152:0/3719768622 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.209+0000 7fdd7ed9d700 1 --2- 172.21.15.152:0/3719768622 >> v2:172.21.15.163:3300/0 conn(0x7fdd800b9000 0x7fdd800ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/3719768622 >> v2:172.21.15.163:3300/0 conn(0x7fdd800b9000 msgr2=0x7fdd800ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7dd9b700 1 --2- 172.21.15.152:0/3719768622 >> v2:172.21.15.163:3300/0 conn(0x7fdd800b9000 0x7fdd800ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/3719768622 >> v1:172.21.15.152:6789/0 conn(0x7fdd80160b50 legacy=0x7fdd800b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/3719768622 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd800ce160 con 0x7fdd800b5700 2023-10-16T20:07:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7d59a700 1 -- 172.21.15.152:0/3719768622 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448330057 0 0) 0x7fdd800d0010 con 0x7fdd80160b50 2023-10-16T20:07:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7ed9d700 1 --2- 172.21.15.152:0/3719768622 >> v2:172.21.15.163:3300/0 conn(0x7fdd800b9000 0x7fdd800ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7dd9b700 1 --2- 172.21.15.152:0/3719768622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b5700 0x7fdd800cf980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd800d43d0 tx=0x7fdd70009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b687ce0e42f9a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7d59a700 1 -- 172.21.15.152:0/3719768622 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70011830 con 0x7fdd800b5700 2023-10-16T20:07:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7d59a700 1 -- 172.21.15.152:0/3719768622 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70011990 con 0x7fdd800b5700 2023-10-16T20:07:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd7d59a700 1 -- 172.21.15.152:0/3719768622 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70011d20 con 0x7fdd800b5700 2023-10-16T20:07:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd84c2b700 1 -- 172.21.15.152:0/3719768622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b5700 msgr2=0x7fdd800cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/3719768622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b5700 0x7fdd800cf980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd800d43d0 tx=0x7fdd70009b20 comp rx=0 tx=0).stop 2023-10-16T20:07:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd84c2b700 1 -- 172.21.15.152:0/3719768622 shutdown_connections 2023-10-16T20:07:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/3719768622 >> v2:172.21.15.163:3300/0 conn(0x7fdd800b9000 0x7fdd800ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/3719768622 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b5700 0x7fdd800cf980 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.210+0000 7fdd84c2b700 1 -- 172.21.15.152:0/3719768622 >> 172.21.15.152:0/3719768622 conn(0x7fdd8006bc70 msgr2=0x7fdd8006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:29.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.211+0000 7fdd84c2b700 1 -- 172.21.15.152:0/3719768622 shutdown_connections 2023-10-16T20:07:29.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.211+0000 7fdd84c2b700 1 -- 172.21.15.152:0/3719768622 wait complete. 2023-10-16T20:07:29.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.212+0000 7fdd84c2b700 1 Processor -- start 2023-10-16T20:07:29.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.212+0000 7fdd84c2b700 1 -- start start 2023-10-16T20:07:29.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd800b5700 0x7fdd80145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 0x7fdd8014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd80160b50 0x7fdd8014b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801465b0 con 0x7fdd800b9000 2023-10-16T20:07:29.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd80146890 con 0x7fdd80160b50 2023-10-16T20:07:29.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd80146b70 con 0x7fdd800b5700 2023-10-16T20:07:29.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 0x7fdd8014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 0x7fdd8014b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60278/0 (socket says 172.21.15.152:60278) 2023-10-16T20:07:29.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/1826367838 learned_addr learned my addr 172.21.15.152:0/1826367838 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:29.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7ed9d700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd80160b50 0x7fdd8014b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7e59c700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd800b5700 0x7fdd80145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd800b5700 msgr2=0x7fdd80145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd800b5700 0x7fdd80145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd80160b50 msgr2=0x7fdd8014b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd80160b50 0x7fdd8014b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 -- 172.21.15.152:0/1826367838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700094a0 con 0x7fdd800b9000 2023-10-16T20:07:29.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd7dd9b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 0x7fdd8014b000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdd70014040 tx=0x7fdd70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:29.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd700038a0 con 0x7fdd800b9000 2023-10-16T20:07:29.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7001e070 con 0x7fdd800b9000 2023-10-16T20:07:29.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd80146e50 con 0x7fdd800b9000 2023-10-16T20:07:29.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70003c40 con 0x7fdd800b9000 2023-10-16T20:07:29.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.213+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd80146270 con 0x7fdd800b9000 2023-10-16T20:07:29.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.214+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd80148840 con 0x7fdd800b9000 2023-10-16T20:07:29.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.215+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd7002d450 con 0x7fdd800b9000 2023-10-16T20:07:29.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.216+0000 7fdd6effd700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdd6006af00 0x7fdd6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.216+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd7008ad90 con 0x7fdd800b9000 2023-10-16T20:07:29.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.216+0000 7fdd7e59c700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdd6006af00 0x7fdd6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.216+0000 7fdd7e59c700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdd6006af00 0x7fdd6006d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000f60 tx=0x7fdd74007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:29.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.219+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd70055b60 con 0x7fdd800b9000 2023-10-16T20:07:29.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.424+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdd80148840 con 0x7fdd800b9000 2023-10-16T20:07:29.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.424+0000 7fdd6effd700 1 -- 172.21.15.152:0/1826367838 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd80148840 con 0x7fdd800b9000 2023-10-16T20:07:29.429 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdd6006af00 msgr2=0x7fdd6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdd6006af00 0x7fdd6006d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000f60 tx=0x7fdd74007c00 comp rx=0 tx=0).stop 2023-10-16T20:07:29.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 msgr2=0x7fdd8014b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 0x7fdd8014b000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdd70014040 tx=0x7fdd70004750 comp rx=0 tx=0).stop 2023-10-16T20:07:29.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 shutdown_connections 2023-10-16T20:07:29.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdd6006af00 0x7fdd6006d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdd800b5700 0x7fdd80145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdd80160b50 0x7fdd8014b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 --2- 172.21.15.152:0/1826367838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd800b9000 0x7fdd8014b000 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 >> 172.21.15.152:0/1826367838 conn(0x7fdd8006bc70 msgr2=0x7fdd8015c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:29.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 shutdown_connections 2023-10-16T20:07:29.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.426+0000 7fdd84c2b700 1 -- 172.21.15.152:0/1826367838 wait complete. 2023-10-16T20:07:29.432 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2023-10-16T20:07:29.442 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-16T20:07:29.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:29.442 DEBUG:teuthology.orchestra.run.smithi163:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-16T20:07:29.496 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:07:29.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:07:29.497 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T20:07:29.517 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T20:07:29.517 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:29.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.635+0000 7f2646b62700 1 Processor -- start 2023-10-16T20:07:29.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.635+0000 7f2646b62700 1 -- start start 2023-10-16T20:07:29.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f2646b62700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 0x7f264015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f2646b62700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264015ecf0 con 0x7f264006a820 2023-10-16T20:07:29.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f2646b62700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2640162270 con 0x7f26400cdc90 2023-10-16T20:07:29.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f2646b62700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264015e320 con 0x7f2640161780 2023-10-16T20:07:29.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f26450ff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f264006a820 0x7f26400716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40484/0 (socket says 172.21.15.152:40484) 2023-10-16T20:07:29.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f26450ff700 1 -- 172.21.15.152:0/25503053 learned_addr learned my addr 172.21.15.152:0/25503053 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:29.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f26448fe700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 0x7f264015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094440616 0 0) 0x7f2638001490 con 0x7f264006a820 2023-10-16T20:07:29.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.636+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26300035b0 con 0x7f264006a820 2023-10-16T20:07:29.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260287040 0 0) 0x7f262c001110 con 0x7f26400cdc90 2023-10-16T20:07:29.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2638001490 con 0x7f26400cdc90 2023-10-16T20:07:29.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866877793 0 0) 0x7f26300035b0 con 0x7f264006a820 2023-10-16T20:07:29.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 msgr2=0x7f264015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:29.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 0x7f264015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 >> v1:172.21.15.163:6789/0 conn(0x7f26400cdc90 legacy=0x7f2640161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400c3a20 con 0x7f264006a820 2023-10-16T20:07:29.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f2638001b80 con 0x7f264006a820 2023-10-16T20:07:29.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 >> v1:172.21.15.152:6789/0 conn(0x7f264006a820 legacy=0x7f26400716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2630003bc0 0x7f2630003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 0x7f2630004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2630004d90 0x7f2630005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264015e320 con 0x7f2630004d90 2023-10-16T20:07:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263000bba0 con 0x7f2630003bc0 2023-10-16T20:07:29.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263000bd30 con 0x7f2640161780 2023-10-16T20:07:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2630004d90 0x7f2630005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26448fe700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2630003bc0 0x7f2630003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263ffff700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 0x7f2630004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 -- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 msgr2=0x7f2630004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2640161780 0x7f2630004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 -- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2630003bc0 msgr2=0x7f2630003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2630003bc0 0x7f2630003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 -- 172.21.15.152:0/25503053 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300035b0 con 0x7f2630004d90 2023-10-16T20:07:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f26450ff700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2630004d90 0x7f2630005210 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f263800a720 tx=0x7f2630005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33517ec1896c605f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800a350 con 0x7f2630004d90 2023-10-16T20:07:29.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380072d0 con 0x7f2630004d90 2023-10-16T20:07:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.637+0000 7f263f7fe700 1 -- 172.21.15.152:0/25503053 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638007680 con 0x7f2630004d90 2023-10-16T20:07:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f2646b62700 1 -- 172.21.15.152:0/25503053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2630004d90 msgr2=0x7f2630005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f2646b62700 1 --2- 172.21.15.152:0/25503053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2630004d90 0x7f2630005210 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f263800a720 tx=0x7f2630005880 comp rx=0 tx=0).stop 2023-10-16T20:07:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f26450ff700 1 -- 172.21.15.152:0/25503053 reap_dead start 2023-10-16T20:07:29.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f2646b62700 1 -- 172.21.15.152:0/25503053 shutdown_connections 2023-10-16T20:07:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f2646b62700 1 -- 172.21.15.152:0/25503053 >> 172.21.15.152:0/25503053 conn(0x7f264006bd50 msgr2=0x7f264006c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f2646b62700 1 -- 172.21.15.152:0/25503053 shutdown_connections 2023-10-16T20:07:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.638+0000 7f2646b62700 1 -- 172.21.15.152:0/25503053 wait complete. 2023-10-16T20:07:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.639+0000 7f2646b62700 1 Processor -- start 2023-10-16T20:07:29.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.639+0000 7f2646b62700 1 -- start start 2023-10-16T20:07:29.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f2646b62700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2630004d90 0x7f26400c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f2646b62700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26400cab30 0x7f26400c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f2646b62700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 0x7f26400c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f2646b62700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400cc000 con 0x7f26400cafb0 2023-10-16T20:07:29.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f2646b62700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400cb480 con 0x7f26400cab30 2023-10-16T20:07:29.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f2646b62700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400cb760 con 0x7f2630004d90 2023-10-16T20:07:29.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f26450ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 0x7f26400c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f26450ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 0x7f26400c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60298/0 (socket says 172.21.15.152:60298) 2023-10-16T20:07:29.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f26450ff700 1 -- 172.21.15.152:0/2196808752 learned_addr learned my addr 172.21.15.152:0/2196808752 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:29.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.640+0000 7f26448fe700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2630004d90 0x7f26400c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f263ffff700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26400cab30 0x7f26400c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f26450ff700 1 -- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2630004d90 msgr2=0x7f26400c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f26450ff700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2630004d90 0x7f26400c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f26450ff700 1 -- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26400cab30 msgr2=0x7f26400c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f26450ff700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26400cab30 0x7f26400c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f26450ff700 1 -- 172.21.15.152:0/2196808752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400cba40 con 0x7f26400cafb0 2023-10-16T20:07:29.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f26450ff700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 0x7f26400c7500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2638000f80 tx=0x7f2638001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:29.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638025070 con 0x7f26400cafb0 2023-10-16T20:07:29.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2638007650 con 0x7f26400cafb0 2023-10-16T20:07:29.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26400cbd20 con 0x7f26400cafb0 2023-10-16T20:07:29.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638007a00 con 0x7f26400cafb0 2023-10-16T20:07:29.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.641+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26400c94d0 con 0x7f26400cafb0 2023-10-16T20:07:29.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.642+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26400c7220 con 0x7f26400cafb0 2023-10-16T20:07:29.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.642+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f263801a070 con 0x7f26400cafb0 2023-10-16T20:07:29.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.643+0000 7f263d7fa700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f262406af00 0x7f262406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:29.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.643+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f263808ad70 con 0x7f26400cafb0 2023-10-16T20:07:29.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.643+0000 7f26448fe700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f262406af00 0x7f262406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:29.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.643+0000 7f26448fe700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f262406af00 0x7f262406d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2634009ba0 tx=0x7f2634008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:29.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.647+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26400c7220 con 0x7f26400cafb0 2023-10-16T20:07:29.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.879+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264015ecf0 con 0x7f26400cafb0 2023-10-16T20:07:29.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.879+0000 7f263d7fa700 1 -- 172.21.15.152:0/2196808752 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f264015ecf0 con 0x7f26400cafb0 2023-10-16T20:07:29.882 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:29.883 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:07:29.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f262406af00 msgr2=0x7f262406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f262406af00 0x7f262406d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2634009ba0 tx=0x7f2634008040 comp rx=0 tx=0).stop 2023-10-16T20:07:29.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 msgr2=0x7f26400c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:29.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 0x7f26400c7500 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2638000f80 tx=0x7f2638001e40 comp rx=0 tx=0).stop 2023-10-16T20:07:29.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 shutdown_connections 2023-10-16T20:07:29.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f262406af00 0x7f262406d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f2630004d90 0x7f26400c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26400cafb0 0x7f26400c7500 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 --2- 172.21.15.152:0/2196808752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26400cab30 0x7f26400c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:29.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 >> 172.21.15.152:0/2196808752 conn(0x7f264006bd50 msgr2=0x7f2640072350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:29.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 shutdown_connections 2023-10-16T20:07:29.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:29.881+0000 7f2646b62700 1 -- 172.21.15.152:0/2196808752 wait complete. 2023-10-16T20:07:29.887 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:07:29.897 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:30.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.015+0000 7ff792602700 1 Processor -- start 2023-10-16T20:07:30.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.015+0000 7ff792602700 1 -- start start 2023-10-16T20:07:30.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff792602700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff78c0cd570 0x7ff78c0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff792602700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0cbe10 con 0x7ff78c0b3410 2023-10-16T20:07:30.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff792602700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c070d70 con 0x7ff78c152470 2023-10-16T20:07:30.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff792602700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c071200 con 0x7ff78c0cd570 2023-10-16T20:07:30.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff78b7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff78c0b3410 0x7ff78c0b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40500/0 (socket says 172.21.15.152:40500) 2023-10-16T20:07:30.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff790b9f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff78c0cd570 0x7ff78c0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff78b7fe700 1 -- 172.21.15.152:0/2165619230 learned_addr learned my addr 172.21.15.152:0/2165619230 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff790b9f700 1 -- 172.21.15.152:0/2165619230 >> v1:172.21.15.163:6789/0 conn(0x7ff78c152470 legacy=0x7ff78c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff790b9f700 1 -- 172.21.15.152:0/2165619230 >> v1:172.21.15.152:6789/0 conn(0x7ff78c0b3410 legacy=0x7ff78c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.016+0000 7ff78affd700 1 -- 172.21.15.152:0/2165619230 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039870884 0 0) 0x7ff78c0cbe10 con 0x7ff78c0b3410 2023-10-16T20:07:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff790b9f700 1 -- 172.21.15.152:0/2165619230 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c15c990 con 0x7ff78c0cd570 2023-10-16T20:07:30.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff790b9f700 1 --2- 172.21.15.152:0/2165619230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c0cd570 0x7ff78c0cb8d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff784009d90 tx=0x7ff78400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3199f1e09d468292 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff78affd700 1 -- 172.21.15.152:0/2165619230 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78400e070 con 0x7ff78c0cd570 2023-10-16T20:07:30.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff78affd700 1 -- 172.21.15.152:0/2165619230 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78400bbd0 con 0x7ff78c0cd570 2023-10-16T20:07:30.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff78affd700 1 -- 172.21.15.152:0/2165619230 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784012430 con 0x7ff78c0cd570 2023-10-16T20:07:30.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 -- 172.21.15.152:0/2165619230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c0cd570 msgr2=0x7ff78c0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 --2- 172.21.15.152:0/2165619230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c0cd570 0x7ff78c0cb8d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff784009d90 tx=0x7ff78400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:30.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 -- 172.21.15.152:0/2165619230 shutdown_connections 2023-10-16T20:07:30.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 --2- 172.21.15.152:0/2165619230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c0cd570 0x7ff78c0cb8d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 -- 172.21.15.152:0/2165619230 >> 172.21.15.152:0/2165619230 conn(0x7ff78c0cdd00 msgr2=0x7ff78c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:30.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 -- 172.21.15.152:0/2165619230 shutdown_connections 2023-10-16T20:07:30.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.017+0000 7ff792602700 1 -- 172.21.15.152:0/2165619230 wait complete. 2023-10-16T20:07:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.018+0000 7ff792602700 1 Processor -- start 2023-10-16T20:07:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 -- start start 2023-10-16T20:07:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff78c0b3410 0x7ff78c1f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff78c0cd570 0x7ff78c0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 0x7ff78c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1f6ee0 con 0x7ff78c152470 2023-10-16T20:07:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1f62f0 con 0x7ff78c0cd570 2023-10-16T20:07:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.019+0000 7ff792602700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1f6540 con 0x7ff78c0b3410 2023-10-16T20:07:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 0x7ff78c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 0x7ff78c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60312/0 (socket says 172.21.15.152:60312) 2023-10-16T20:07:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 -- 172.21.15.152:0/3274266436 learned_addr learned my addr 172.21.15.152:0/3274266436 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff78b7fe700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff78c0cd570 0x7ff78c0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff78bfff700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff78c0b3410 0x7ff78c1f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 -- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff78c0b3410 msgr2=0x7ff78c1f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff78c0b3410 0x7ff78c1f2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 -- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff78c0cd570 msgr2=0x7ff78c0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff78c0cd570 0x7ff78c0ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 -- 172.21.15.152:0/3274266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009a70 con 0x7ff78c152470 2023-10-16T20:07:30.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff790b9f700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 0x7ff78c15a1a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff784014040 tx=0x7ff784004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784012430 con 0x7ff78c152470 2023-10-16T20:07:30.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff784020070 con 0x7ff78c152470 2023-10-16T20:07:30.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784012e20 con 0x7ff78c152470 2023-10-16T20:07:30.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c1f6820 con 0x7ff78c152470 2023-10-16T20:07:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.020+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c1f2b50 con 0x7ff78c152470 2023-10-16T20:07:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.021+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c1f7020 con 0x7ff78c152470 2023-10-16T20:07:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.022+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff784026400 con 0x7ff78c152470 2023-10-16T20:07:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.022+0000 7ff788ff9700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.022+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff78408b840 con 0x7ff78c152470 2023-10-16T20:07:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.022+0000 7ff78bfff700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.022+0000 7ff78bfff700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff77806af00 0x7ff77806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000f60 tx=0x7ff77c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.026+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff78c1f7020 con 0x7ff78c152470 2023-10-16T20:07:30.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.218+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff78c1f7200 con 0x7ff78c152470 2023-10-16T20:07:30.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.219+0000 7ff788ff9700 1 -- 172.21.15.152:0/3274266436 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7ff78c1f7200 con 0x7ff78c152470 2023-10-16T20:07:30.222 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:30.223 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:30.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.221+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff77806af00 msgr2=0x7ff77806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.221+0000 7ff792602700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff77806af00 0x7ff77806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000f60 tx=0x7ff77c009040 comp rx=0 tx=0).stop 2023-10-16T20:07:30.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.221+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 msgr2=0x7ff78c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.221+0000 7ff792602700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 0x7ff78c15a1a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff784014040 tx=0x7ff784004ad0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 shutdown_connections 2023-10-16T20:07:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff78c0b3410 0x7ff78c1f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff78c152470 0x7ff78c15a1a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 --2- 172.21.15.152:0/3274266436 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff78c0cd570 0x7ff78c0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 >> 172.21.15.152:0/3274266436 conn(0x7ff78c0cdd00 msgr2=0x7ff78c0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:30.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 shutdown_connections 2023-10-16T20:07:30.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.222+0000 7ff792602700 1 -- 172.21.15.152:0/3274266436 wait complete. 2023-10-16T20:07:30.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T20:06:30.043710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T20:06:31.139769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T20:06:34.880492+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T20:07:30.238 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:30.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.358+0000 7fa694d41700 1 Processor -- start 2023-10-16T20:07:30.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.358+0000 7fa694d41700 1 -- start start 2023-10-16T20:07:30.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa694d41700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa69015b4e0 0x7fa69006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa694d41700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6900b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa694d41700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa6900b3220 0x7fa6900cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa694d41700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6900b36b0 con 0x7fa69015b4e0 2023-10-16T20:07:30.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa694d41700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa690070620 con 0x7fa6900b3220 2023-10-16T20:07:30.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa694d41700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa690070900 con 0x7fa6900cd770 2023-10-16T20:07:30.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa68e59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa69015b4e0 0x7fa69006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa68e59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa69015b4e0 0x7fa69006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60316/0 (socket says 172.21.15.152:60316) 2023-10-16T20:07:30.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa68e59c700 1 -- 172.21.15.152:0/2930673407 learned_addr learned my addr 172.21.15.152:0/2930673407 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:30.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa68dd9b700 1 --2- 172.21.15.152:0/2930673407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6900b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.359+0000 7fa68ed9d700 1 --2- 172.21.15.152:0/2930673407 >> v2:172.21.15.163:3300/0 conn(0x7fa6900b3220 0x7fa6900cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68e59c700 1 -- 172.21.15.152:0/2930673407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 msgr2=0x7fa6900b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:30.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68e59c700 1 --2- 172.21.15.152:0/2930673407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6900b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68e59c700 1 -- 172.21.15.152:0/2930673407 >> v2:172.21.15.163:3300/0 conn(0x7fa6900b3220 msgr2=0x7fa6900cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:30.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68e59c700 1 --2- 172.21.15.152:0/2930673407 >> v2:172.21.15.163:3300/0 conn(0x7fa6900b3220 0x7fa6900cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68e59c700 1 -- 172.21.15.152:0/2930673407 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690070be0 con 0x7fa69015b4e0 2023-10-16T20:07:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68ed9d700 1 --2- 172.21.15.152:0/2930673407 >> v2:172.21.15.163:3300/0 conn(0x7fa6900b3220 0x7fa6900cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68e59c700 1 --2- 172.21.15.152:0/2930673407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa69006f280 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d0b80 tx=0x7fa684009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3461c35b2b3ac255 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68d59a700 1 -- 172.21.15.152:0/2930673407 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400b870 con 0x7fa69015b4e0 2023-10-16T20:07:30.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68d59a700 1 -- 172.21.15.152:0/2930673407 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400b9d0 con 0x7fa69015b4e0 2023-10-16T20:07:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa68d59a700 1 -- 172.21.15.152:0/2930673407 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400bd60 con 0x7fa69015b4e0 2023-10-16T20:07:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa694d41700 1 -- 172.21.15.152:0/2930673407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 msgr2=0x7fa69006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.360+0000 7fa694d41700 1 --2- 172.21.15.152:0/2930673407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa69006f280 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d0b80 tx=0x7fa684009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 -- 172.21.15.152:0/2930673407 shutdown_connections 2023-10-16T20:07:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 --2- 172.21.15.152:0/2930673407 >> v2:172.21.15.163:3300/0 conn(0x7fa6900b3220 0x7fa6900cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 --2- 172.21.15.152:0/2930673407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa69006f280 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 --2- 172.21.15.152:0/2930673407 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6900b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 -- 172.21.15.152:0/2930673407 >> 172.21.15.152:0/2930673407 conn(0x7fa6900cdce0 msgr2=0x7fa6900ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:30.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 -- 172.21.15.152:0/2930673407 shutdown_connections 2023-10-16T20:07:30.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.361+0000 7fa694d41700 1 -- 172.21.15.152:0/2930673407 wait complete. 2023-10-16T20:07:30.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.362+0000 7fa694d41700 1 Processor -- start 2023-10-16T20:07:30.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.362+0000 7fa694d41700 1 -- start start 2023-10-16T20:07:30.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6900b3220 0x7fa6900cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6901f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa690151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900cacf0 con 0x7fa69015b4e0 2023-10-16T20:07:30.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900c9e40 con 0x7fa6900b3220 2023-10-16T20:07:30.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900ca0e0 con 0x7fa6900cd770 2023-10-16T20:07:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa690151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa690151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60324/0 (socket says 172.21.15.152:60324) 2023-10-16T20:07:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 -- 172.21.15.152:0/2027783387 learned_addr learned my addr 172.21.15.152:0/2027783387 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:30.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 -- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 msgr2=0x7fa6901f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68e59c700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6900b3220 0x7fa6900cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68dd9b700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6901f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6901f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 -- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6900b3220 msgr2=0x7fa6900cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6900b3220 0x7fa6900cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 -- 172.21.15.152:0/2027783387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009550 con 0x7fa69015b4e0 2023-10-16T20:07:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa68ed9d700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa690151d60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa68800cef0 tx=0x7fa68800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800ae50 con 0x7fa69015b4e0 2023-10-16T20:07:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688015440 con 0x7fa69015b4e0 2023-10-16T20:07:30.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880157f0 con 0x7fa69015b4e0 2023-10-16T20:07:30.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6900ca3c0 con 0x7fa69015b4e0 2023-10-16T20:07:30.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.363+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6900ca980 con 0x7fa69015b4e0 2023-10-16T20:07:30.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.364+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6900cae60 con 0x7fa69015b4e0 2023-10-16T20:07:30.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.365+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa68800d430 con 0x7fa69015b4e0 2023-10-16T20:07:30.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.365+0000 7fa67effd700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa67006af00 0x7fa67006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.365+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa68808a000 con 0x7fa69015b4e0 2023-10-16T20:07:30.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.365+0000 7fa68e59c700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa67006af00 0x7fa67006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.366+0000 7fa68e59c700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa67006af00 0x7fa67006d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa684009c10 tx=0x7fa684008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.370+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa688054cf0 con 0x7fa69015b4e0 2023-10-16T20:07:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.558+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa69004ebb0 con 0x7fa69015b4e0 2023-10-16T20:07:30.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.558+0000 7fa67effd700 1 -- 172.21.15.152:0/2027783387 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa68801a0a0 con 0x7fa69015b4e0 2023-10-16T20:07:30.561 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:30.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa67006af00 msgr2=0x7fa67006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa67006af00 0x7fa67006d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa684009c10 tx=0x7fa684008030 comp rx=0 tx=0).stop 2023-10-16T20:07:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 msgr2=0x7fa690151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa690151d60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa68800cef0 tx=0x7fa68800a340 comp rx=0 tx=0).stop 2023-10-16T20:07:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 shutdown_connections 2023-10-16T20:07:30.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fa67006af00 0x7fa67006d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa69015b4e0 0x7fa690151d60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6900b3220 0x7fa6900cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 --2- 172.21.15.152:0/2027783387 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fa6900cd770 0x7fa6901f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 >> 172.21.15.152:0/2027783387 conn(0x7fa6900cdce0 msgr2=0x7fa690152850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:30.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 shutdown_connections 2023-10-16T20:07:30.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.560+0000 7fa694d41700 1 -- 172.21.15.152:0/2027783387 wait complete. 2023-10-16T20:07:30.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T20:07:30.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.696+0000 7ffa71325700 1 Processor -- start 2023-10-16T20:07:30.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.696+0000 7ffa71325700 1 -- start start 2023-10-16T20:07:30.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa71325700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 0x7ffa6c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa71325700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 0x7ffa6c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa71325700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0ce5e0 con 0x7ffa6c15d760 2023-10-16T20:07:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa71325700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c06c1b0 con 0x7ffa6c0b9060 2023-10-16T20:07:30.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa71325700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cf420 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 0x7ffa6c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6a7fc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 0x7ffa6c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6a7fc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 0x7ffa6c0ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:33098/0 (socket says 172.21.15.152:33098) 2023-10-16T20:07:30.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6affd700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ffa6c15d760 0x7ffa6c0cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:55706/0 (socket says 172.21.15.152:55706) 2023-10-16T20:07:30.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 0x7ffa6c06bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:48984/0 (socket says 172.21.15.152:48984) 2023-10-16T20:07:30.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6a7fc700 1 -- 172.21.15.152:0/374241025 learned_addr learned my addr 172.21.15.152:0/374241025 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 -- 172.21.15.152:0/374241025 >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 msgr2=0x7ffa6c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 --2- 172.21.15.152:0/374241025 >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 0x7ffa6c0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 -- 172.21.15.152:0/374241025 >> v1:172.21.15.163:6789/0 conn(0x7ffa6c15d760 legacy=0x7ffa6c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 -- 172.21.15.152:0/374241025 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0b94c0 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa69ffb700 1 -- 172.21.15.152:0/374241025 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352044629 0 0) 0x7ffa6c0ce5e0 con 0x7ffa6c15d760 2023-10-16T20:07:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6a7fc700 1 --2- 172.21.15.152:0/374241025 >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 0x7ffa6c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.697+0000 7ffa6b7fe700 1 --2- 172.21.15.152:0/374241025 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 0x7ffa6c06bc70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009d90 tx=0x7ffa6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e14d760dc3d458c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa69ffb700 1 -- 172.21.15.152:0/374241025 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400e070 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa69ffb700 1 -- 172.21.15.152:0/374241025 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400bb20 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa69ffb700 1 -- 172.21.15.152:0/374241025 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64012430 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 -- 172.21.15.152:0/374241025 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 msgr2=0x7ffa6c06bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 --2- 172.21.15.152:0/374241025 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 0x7ffa6c06bc70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009d90 tx=0x7ffa6400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 -- 172.21.15.152:0/374241025 shutdown_connections 2023-10-16T20:07:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 --2- 172.21.15.152:0/374241025 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c06b7e0 0x7ffa6c06bc70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 --2- 172.21.15.152:0/374241025 >> v2:172.21.15.163:3300/0 conn(0x7ffa6c0b9060 0x7ffa6c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 -- 172.21.15.152:0/374241025 >> 172.21.15.152:0/374241025 conn(0x7ffa6c072340 msgr2=0x7ffa6c072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 -- 172.21.15.152:0/374241025 shutdown_connections 2023-10-16T20:07:30.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.698+0000 7ffa71325700 1 -- 172.21.15.152:0/374241025 wait complete. 2023-10-16T20:07:30.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 Processor -- start 2023-10-16T20:07:30.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 -- start start 2023-10-16T20:07:30.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 0x7ffa6c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6c0b9060 0x7ffa6c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c15d760 0x7ffa6c15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c154bf0 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c155490 con 0x7ffa6c0b9060 2023-10-16T20:07:30.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa71325700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1530b0 con 0x7ffa6c15d760 2023-10-16T20:07:30.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa6affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 0x7ffa6c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa6affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 0x7ffa6c156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60334/0 (socket says 172.21.15.152:60334) 2023-10-16T20:07:30.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.700+0000 7ffa6affd700 1 -- 172.21.15.152:0/1589336663 learned_addr learned my addr 172.21.15.152:0/1589336663 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:30.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6b7fe700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c15d760 0x7ffa6c15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6a7fc700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6c0b9060 0x7ffa6c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6affd700 1 -- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c15d760 msgr2=0x7ffa6c15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6affd700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c15d760 0x7ffa6c15ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6affd700 1 -- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6c0b9060 msgr2=0x7ffa6c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6affd700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6c0b9060 0x7ffa6c152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6affd700 1 -- 172.21.15.152:0/1589336663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009550 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa6affd700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 0x7ffa6c156110 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c550 tx=0x7ffa6000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60004c80 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa60004e00 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa64009a70 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007310 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.701+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c154e40 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.702+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c04ebb0 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.703+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa60007470 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.703+0000 7ffa537fe700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa5806af00 0x7ffa5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:30.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.703+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa600895c0 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.703+0000 7ffa6a7fc700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa5806af00 0x7ffa5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:30.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.703+0000 7ffa6a7fc700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa5806af00 0x7ffa5806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c15c4b0 tx=0x7ffa5c0092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:30.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.707+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa600542b0 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:30.856 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:07:30.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.900+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa6c15b200 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.901+0000 7ffa537fe700 1 -- 172.21.15.152:0/1589336663 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa600578d0 con 0x7ffa6c06b7e0 2023-10-16T20:07:30.904 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:30.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa5806af00 msgr2=0x7ffa5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa5806af00 0x7ffa5806d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c15c4b0 tx=0x7ffa5c0092c0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 msgr2=0x7ffa6c156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:30.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 0x7ffa6c156110 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c550 tx=0x7ffa6000c860 comp rx=0 tx=0).stop 2023-10-16T20:07:30.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 shutdown_connections 2023-10-16T20:07:30.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ffa5806af00 0x7ffa5806d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ffa6c15d760 0x7ffa6c15ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa6c06b7e0 0x7ffa6c156110 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 --2- 172.21.15.152:0/1589336663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6c0b9060 0x7ffa6c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:30.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 >> 172.21.15.152:0/1589336663 conn(0x7ffa6c072340 msgr2=0x7ffa6c0b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:30.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 shutdown_connections 2023-10-16T20:07:30.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:30.903+0000 7ffa71325700 1 -- 172.21.15.152:0/1589336663 wait complete. 2023-10-16T20:07:30.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T20:07:31.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.079+0000 7f4248db5700 1 Processor -- start 2023-10-16T20:07:31.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.079+0000 7f4248db5700 1 -- start start 2023-10-16T20:07:31.084 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4248db5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f424406b370 0x7f424415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4248db5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f424406a820 0x7f424406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4248db5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42440cdd30 0x7f42440ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4248db5700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440ce6d0 con 0x7f42440cdd30 2023-10-16T20:07:31.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4248db5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4244161360 con 0x7f424406a820 2023-10-16T20:07:31.085 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4248db5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424406b750 con 0x7f424406b370 2023-10-16T20:07:31.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42440cdd30 0x7f42440ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42440cdd30 0x7f42440ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60346/0 (socket says 172.21.15.152:60346) 2023-10-16T20:07:31.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 -- 172.21.15.152:0/2768378272 learned_addr learned my addr 172.21.15.152:0/2768378272 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:31.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f424259c700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f424406b370 0x7f424415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4241d9b700 1 --2- 172.21.15.152:0/2768378272 >> v2:172.21.15.163:3300/0 conn(0x7f424406a820 0x7f424406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 -- 172.21.15.152:0/2768378272 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f424406b370 msgr2=0x7f424415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:31.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f424406b370 0x7f424415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 -- 172.21.15.152:0/2768378272 >> v2:172.21.15.163:3300/0 conn(0x7f424406a820 msgr2=0x7f424406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:31.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 --2- 172.21.15.152:0/2768378272 >> v2:172.21.15.163:3300/0 conn(0x7f424406a820 0x7f424406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 -- 172.21.15.152:0/2768378272 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424415e300 con 0x7f42440cdd30 2023-10-16T20:07:31.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f424259c700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f424406b370 0x7f424415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:31.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4241d9b700 1 --2- 172.21.15.152:0/2768378272 >> v2:172.21.15.163:3300/0 conn(0x7f424406a820 0x7f424406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:31.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f4242d9d700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42440cdd30 0x7f42440ce190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f424406d480 tx=0x7f423c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be3f885b8138c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.080+0000 7f424159a700 1 -- 172.21.15.152:0/2768378272 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00e070 con 0x7f42440cdd30 2023-10-16T20:07:31.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f424159a700 1 -- 172.21.15.152:0/2768378272 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00b9c0 con 0x7f42440cdd30 2023-10-16T20:07:31.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f424159a700 1 -- 172.21.15.152:0/2768378272 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00bd70 con 0x7f42440cdd30 2023-10-16T20:07:31.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 -- 172.21.15.152:0/2768378272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42440cdd30 msgr2=0x7f42440ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42440cdd30 0x7f42440ce190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f424406d480 tx=0x7f423c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:31.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 -- 172.21.15.152:0/2768378272 shutdown_connections 2023-10-16T20:07:31.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f424406b370 0x7f424415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 --2- 172.21.15.152:0/2768378272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42440cdd30 0x7f42440ce190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 --2- 172.21.15.152:0/2768378272 >> v2:172.21.15.163:3300/0 conn(0x7f424406a820 0x7f424406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 -- 172.21.15.152:0/2768378272 >> 172.21.15.152:0/2768378272 conn(0x7f42440ccbe0 msgr2=0x7f42440ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:31.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 -- 172.21.15.152:0/2768378272 shutdown_connections 2023-10-16T20:07:31.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.081+0000 7f4248db5700 1 -- 172.21.15.152:0/2768378272 wait complete. 2023-10-16T20:07:31.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 Processor -- start 2023-10-16T20:07:31.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 -- start start 2023-10-16T20:07:31.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424406a820 0x7f424415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 0x7f4244156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42440cdd30 0x7f42440cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424415c820 con 0x7f424406b370 2023-10-16T20:07:31.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c5220 con 0x7f424406a820 2023-10-16T20:07:31.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4248db5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c5500 con 0x7f42440cdd30 2023-10-16T20:07:31.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4241d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 0x7f4244156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4241d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 0x7f4244156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60350/0 (socket says 172.21.15.152:60350) 2023-10-16T20:07:31.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.083+0000 7f4241d9b700 1 -- 172.21.15.152:0/482915746 learned_addr learned my addr 172.21.15.152:0/482915746 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:31.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4241d9b700 1 -- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42440cdd30 msgr2=0x7f42440cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4241d9b700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42440cdd30 0x7f42440cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4241d9b700 1 -- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424406a820 msgr2=0x7f424415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f424259c700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424406a820 0x7f424415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4241d9b700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424406a820 0x7f424415c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4241d9b700 1 -- 172.21.15.152:0/482915746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009b30 con 0x7f424406b370 2023-10-16T20:07:31.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4241d9b700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 0x7f4244156430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f423800c7f0 tx=0x7f423800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238011800 con 0x7f424406b370 2023-10-16T20:07:31.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4238011960 con 0x7f424406b370 2023-10-16T20:07:31.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238011d10 con 0x7f424406b370 2023-10-16T20:07:31.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42440c57e0 con 0x7f424406b370 2023-10-16T20:07:31.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.084+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42440c5da0 con 0x7f424406b370 2023-10-16T20:07:31.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.085+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244072d10 con 0x7f424406b370 2023-10-16T20:07:31.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.085+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4238018360 con 0x7f424406b370 2023-10-16T20:07:31.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.086+0000 7f4232ffd700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f422406af00 0x7f422406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.086+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4238089980 con 0x7f424406b370 2023-10-16T20:07:31.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.086+0000 7f424259c700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f422406af00 0x7f422406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.086+0000 7f424259c700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f422406af00 0x7f422406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4234006fd0 tx=0x7f4234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.090+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42380545e0 con 0x7f424406b370 2023-10-16T20:07:31.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.278+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42440c5fc0 con 0x7f424406b370 2023-10-16T20:07:31.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.278+0000 7f4232ffd700 1 -- 172.21.15.152:0/482915746 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f423801f0a0 con 0x7f424406b370 2023-10-16T20:07:31.282 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2023-10-16T20:07:31.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.280+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f422406af00 msgr2=0x7f422406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.280+0000 7f4248db5700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f422406af00 0x7f422406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4234006fd0 tx=0x7f4234008040 comp rx=0 tx=0).stop 2023-10-16T20:07:31.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.280+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 msgr2=0x7f4244156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.280+0000 7f4248db5700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 0x7f4244156430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f423800c7f0 tx=0x7f423800cbb0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 shutdown_connections 2023-10-16T20:07:31.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f422406af00 0x7f422406d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f42440cdd30 0x7f42440cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424406a820 0x7f424415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 --2- 172.21.15.152:0/482915746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f424406b370 0x7f4244156430 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 >> 172.21.15.152:0/482915746 conn(0x7f42440ccbe0 msgr2=0x7f42441572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:31.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 shutdown_connections 2023-10-16T20:07:31.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.281+0000 7f4248db5700 1 -- 172.21.15.152:0/482915746 wait complete. 2023-10-16T20:07:31.296 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T20:07:31.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.417+0000 7fc44507e700 1 Processor -- start 2023-10-16T20:07:31.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.417+0000 7fc44507e700 1 -- start start 2023-10-16T20:07:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc44507e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc44006b370 0x7fc44015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc44507e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc44006a820 0x7fc44006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc44507e700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc440161360 con 0x7fc4400cdd30 2023-10-16T20:07:31.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc44507e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44006b750 con 0x7fc44006b370 2023-10-16T20:07:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc44507e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44015e300 con 0x7fc44006a820 2023-10-16T20:07:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43ed9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc44006b370 0x7fc44015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43f59e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc4400cdd30 0x7fc4401617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40558/0 (socket says 172.21.15.152:40558) 2023-10-16T20:07:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43f59e700 1 -- 172.21.15.152:0/983652617 learned_addr learned my addr 172.21.15.152:0/983652617 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:31.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43e59c700 1 --2- 172.21.15.152:0/983652617 >> v2:172.21.15.163:3300/0 conn(0x7fc44006a820 0x7fc44006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43ed9d700 1 -- 172.21.15.152:0/983652617 >> v2:172.21.15.163:3300/0 conn(0x7fc44006a820 msgr2=0x7fc44006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43ed9d700 1 --2- 172.21.15.152:0/983652617 >> v2:172.21.15.163:3300/0 conn(0x7fc44006a820 0x7fc44006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43ed9d700 1 -- 172.21.15.152:0/983652617 >> v1:172.21.15.152:6789/0 conn(0x7fc4400cdd30 legacy=0x7fc4401617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43ed9d700 1 -- 172.21.15.152:0/983652617 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44015e5e0 con 0x7fc44006b370 2023-10-16T20:07:31.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43dd9b700 1 -- 172.21.15.152:0/983652617 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260005135 0 0) 0x7fc440161360 con 0x7fc4400cdd30 2023-10-16T20:07:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.418+0000 7fc43ed9d700 1 --2- 172.21.15.152:0/983652617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc44015dcb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc440070360 tx=0x7fc434009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2efc77a6c722b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc43dd9b700 1 -- 172.21.15.152:0/983652617 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434011830 con 0x7fc44006b370 2023-10-16T20:07:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc43dd9b700 1 -- 172.21.15.152:0/983652617 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc434011990 con 0x7fc44006b370 2023-10-16T20:07:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc43dd9b700 1 -- 172.21.15.152:0/983652617 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc434011d20 con 0x7fc44006b370 2023-10-16T20:07:31.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 -- 172.21.15.152:0/983652617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 msgr2=0x7fc44015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 --2- 172.21.15.152:0/983652617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc44015dcb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc440070360 tx=0x7fc434009b20 comp rx=0 tx=0).stop 2023-10-16T20:07:31.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 -- 172.21.15.152:0/983652617 shutdown_connections 2023-10-16T20:07:31.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 --2- 172.21.15.152:0/983652617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc44015dcb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 --2- 172.21.15.152:0/983652617 >> v2:172.21.15.163:3300/0 conn(0x7fc44006a820 0x7fc44006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 -- 172.21.15.152:0/983652617 >> 172.21.15.152:0/983652617 conn(0x7fc4400ccbe0 msgr2=0x7fc4400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:31.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 -- 172.21.15.152:0/983652617 shutdown_connections 2023-10-16T20:07:31.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.419+0000 7fc44507e700 1 -- 172.21.15.152:0/983652617 wait complete. 2023-10-16T20:07:31.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 Processor -- start 2023-10-16T20:07:31.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 -- start start 2023-10-16T20:07:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc44006a820 0x7fc4400af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc440155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4400cdd30 0x7fc4400ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44015cb10 con 0x7fc44006b370 2023-10-16T20:07:31.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44015be90 con 0x7fc4400cdd30 2023-10-16T20:07:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc44507e700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44015c170 con 0x7fc44006a820 2023-10-16T20:07:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc43e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc440155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc43e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc440155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60364/0 (socket says 172.21.15.152:60364) 2023-10-16T20:07:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.421+0000 7fc43e59c700 1 -- 172.21.15.152:0/2330152860 learned_addr learned my addr 172.21.15.152:0/2330152860 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:31.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43ed9d700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc44006a820 0x7fc4400af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43f59e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4400cdd30 0x7fc4400ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43e59c700 1 -- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc44006a820 msgr2=0x7fc4400af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43e59c700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc44006a820 0x7fc4400af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43e59c700 1 -- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4400cdd30 msgr2=0x7fc4400ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43e59c700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4400cdd30 0x7fc4400ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43e59c700 1 -- 172.21.15.152:0/2330152860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340094a0 con 0x7fc44006b370 2023-10-16T20:07:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc43e59c700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc440155630 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d7d0 tx=0x7fc43000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300125f0 con 0x7fc44006b370 2023-10-16T20:07:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430012750 con 0x7fc44006b370 2023-10-16T20:07:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44015c450 con 0x7fc44006b370 2023-10-16T20:07:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430012ac0 con 0x7fc44006b370 2023-10-16T20:07:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.422+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4400af7f0 con 0x7fc44006b370 2023-10-16T20:07:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.423+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc440072d10 con 0x7fc44006b370 2023-10-16T20:07:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.423+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc430012c20 con 0x7fc44006b370 2023-10-16T20:07:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.424+0000 7fc4277fe700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc42c06af00 0x7fc42c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.424+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc430089d60 con 0x7fc44006b370 2023-10-16T20:07:31.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.424+0000 7fc43ed9d700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc42c06af00 0x7fc42c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.424+0000 7fc43ed9d700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc42c06af00 0x7fc42c06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc44015d610 tx=0x7fc434008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.428+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc430054a60 con 0x7fc44006b370 2023-10-16T20:07:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.619+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc44015cc50 con 0x7fc44006b370 2023-10-16T20:07:31.622 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.619+0000 7fc4277fe700 1 -- 172.21.15.152:0/2330152860 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc44015cc50 con 0x7fc44006b370 2023-10-16T20:07:31.623 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-10-16T20:07:31.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc42c06af00 msgr2=0x7fc42c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc42c06af00 0x7fc42c06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc44015d610 tx=0x7fc434008030 comp rx=0 tx=0).stop 2023-10-16T20:07:31.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 msgr2=0x7fc440155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc440155630 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d7d0 tx=0x7fc43000db90 comp rx=0 tx=0).stop 2023-10-16T20:07:31.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 shutdown_connections 2023-10-16T20:07:31.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc42c06af00 0x7fc42c06d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc44006a820 0x7fc4400af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4400cdd30 0x7fc4400ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 --2- 172.21.15.152:0/2330152860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc44006b370 0x7fc440155630 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 >> 172.21.15.152:0/2330152860 conn(0x7fc4400ccbe0 msgr2=0x7fc4401576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:31.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 shutdown_connections 2023-10-16T20:07:31.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.622+0000 7fc44507e700 1 -- 172.21.15.152:0/2330152860 wait complete. 2023-10-16T20:07:31.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:31.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.755+0000 7efdc3b4f700 1 Processor -- start 2023-10-16T20:07:31.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.755+0000 7efdc3b4f700 1 -- start start 2023-10-16T20:07:31.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.756+0000 7efdc3b4f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efdbc15daa0 0x7efdbc0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.756+0000 7efdc3b4f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc071f60 0x7efdbc06d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.756+0000 7efdc3b4f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc15ed10 con 0x7efdbc0af560 2023-10-16T20:07:31.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.756+0000 7efdc3b4f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc15de80 con 0x7efdbc15daa0 2023-10-16T20:07:31.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.756+0000 7efdc3b4f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc15e100 con 0x7efdbc071f60 2023-10-16T20:07:31.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc20ec700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc071f60 0x7efdbc06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc10ea700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7efdbc0af560 0x7efdbc071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:55750/0 (socket says 172.21.15.152:55750) 2023-10-16T20:07:31.762 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc10ea700 1 -- 172.21.15.152:0/2880304413 learned_addr learned my addr 172.21.15.152:0/2880304413 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:31.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc18eb700 1 --2- 172.21.15.152:0/2880304413 >> v2:172.21.15.163:3300/0 conn(0x7efdbc15daa0 0x7efdbc0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc20ec700 1 -- 172.21.15.152:0/2880304413 >> v2:172.21.15.163:3300/0 conn(0x7efdbc15daa0 msgr2=0x7efdbc0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:31.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc20ec700 1 --2- 172.21.15.152:0/2880304413 >> v2:172.21.15.163:3300/0 conn(0x7efdbc15daa0 0x7efdbc0af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc20ec700 1 -- 172.21.15.152:0/2880304413 >> v1:172.21.15.163:6789/0 conn(0x7efdbc0af560 legacy=0x7efdbc071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc20ec700 1 -- 172.21.15.152:0/2880304413 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc15e3e0 con 0x7efdbc071f60 2023-10-16T20:07:31.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc08e9700 1 -- 172.21.15.152:0/2880304413 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058431622 0 0) 0x7efdbc15ed10 con 0x7efdbc0af560 2023-10-16T20:07:31.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc18eb700 1 --2- 172.21.15.152:0/2880304413 >> v2:172.21.15.163:3300/0 conn(0x7efdbc15daa0 0x7efdbc0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:31.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc20ec700 1 --2- 172.21.15.152:0/2880304413 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc071f60 0x7efdbc06d100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009d90 tx=0x7efdb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40f5373042551d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc08e9700 1 -- 172.21.15.152:0/2880304413 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb400e070 con 0x7efdbc071f60 2023-10-16T20:07:31.764 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc08e9700 1 -- 172.21.15.152:0/2880304413 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb400bb20 con 0x7efdbc071f60 2023-10-16T20:07:31.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.757+0000 7efdc08e9700 1 -- 172.21.15.152:0/2880304413 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4012430 con 0x7efdbc071f60 2023-10-16T20:07:31.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 -- 172.21.15.152:0/2880304413 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc071f60 msgr2=0x7efdbc06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/2880304413 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc071f60 0x7efdbc06d100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009d90 tx=0x7efdb400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:31.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 -- 172.21.15.152:0/2880304413 shutdown_connections 2023-10-16T20:07:31.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/2880304413 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc071f60 0x7efdbc06d100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/2880304413 >> v2:172.21.15.163:3300/0 conn(0x7efdbc15daa0 0x7efdbc0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 -- 172.21.15.152:0/2880304413 >> 172.21.15.152:0/2880304413 conn(0x7efdbc0d0180 msgr2=0x7efdbc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:31.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 -- 172.21.15.152:0/2880304413 shutdown_connections 2023-10-16T20:07:31.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.758+0000 7efdc3b4f700 1 -- 172.21.15.152:0/2880304413 wait complete. 2023-10-16T20:07:31.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.759+0000 7efdc3b4f700 1 Processor -- start 2023-10-16T20:07:31.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.759+0000 7efdc3b4f700 1 -- start start 2023-10-16T20:07:31.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc3b4f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efdbc071f60 0x7efdbc1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc3b4f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 0x7efdbc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc3b4f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc15daa0 0x7efdbc0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc3b4f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c7380 con 0x7efdbc0af560 2023-10-16T20:07:31.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc3b4f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c7660 con 0x7efdbc071f60 2023-10-16T20:07:31.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc3b4f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c7940 con 0x7efdbc15daa0 2023-10-16T20:07:31.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 0x7efdbc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 0x7efdbc0b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60378/0 (socket says 172.21.15.152:60378) 2023-10-16T20:07:31.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 -- 172.21.15.152:0/1536317963 learned_addr learned my addr 172.21.15.152:0/1536317963 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:31.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc18eb700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efdbc071f60 0x7efdbc1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc20ec700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc15daa0 0x7efdbc0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 -- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc15daa0 msgr2=0x7efdbc0c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc15daa0 0x7efdbc0c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 -- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efdbc071f60 msgr2=0x7efdbc1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:31.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efdbc071f60 0x7efdbc1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:31.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 -- 172.21.15.152:0/1536317963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0094a0 con 0x7efdbc0af560 2023-10-16T20:07:31.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdc10ea700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 0x7efdbc0b2170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efdb80011e0 tx=0x7efdb800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.760+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8004c80 con 0x7efdbc0af560 2023-10-16T20:07:31.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.761+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb8004e00 con 0x7efdbc0af560 2023-10-16T20:07:31.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.761+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8007310 con 0x7efdbc0af560 2023-10-16T20:07:31.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.761+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb4009a70 con 0x7efdbc0af560 2023-10-16T20:07:31.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.761+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc0c7f00 con 0x7efdbc0af560 2023-10-16T20:07:31.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.761+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc04ebb0 con 0x7efdbc0af560 2023-10-16T20:07:31.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.762+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efdb8007470 con 0x7efdbc0af560 2023-10-16T20:07:31.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.762+0000 7efdb27fc700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efda006af00 0x7efda006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:31.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.762+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efdb80895d0 con 0x7efdbc0af560 2023-10-16T20:07:31.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.762+0000 7efdc18eb700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efda006af00 0x7efda006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:31.774 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.763+0000 7efdc18eb700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efda006af00 0x7efda006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdac009d70 tx=0x7efdac009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:31.775 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:31.767+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdb80542b0 con 0x7efdbc0af560 2023-10-16T20:07:32.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.001+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdbc072690 con 0x7efdbc0af560 2023-10-16T20:07:32.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.002+0000 7efdb27fc700 1 -- 172.21.15.152:0/1536317963 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7efdb80578d0 con 0x7efdbc0af560 2023-10-16T20:07:32.005 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:32.005 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:07:32.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efda006af00 msgr2=0x7efda006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efda006af00 0x7efda006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efdac009d70 tx=0x7efdac009210 comp rx=0 tx=0).stop 2023-10-16T20:07:32.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 msgr2=0x7efdbc0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 0x7efdbc0b2170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efdb80011e0 tx=0x7efdb800ca30 comp rx=0 tx=0).stop 2023-10-16T20:07:32.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 shutdown_connections 2023-10-16T20:07:32.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efda006af00 0x7efda006d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efdbc15daa0 0x7efdbc0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efdbc071f60 0x7efdbc1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 --2- 172.21.15.152:0/1536317963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdbc0af560 0x7efdbc0b2170 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 >> 172.21.15.152:0/1536317963 conn(0x7efdbc0d0180 msgr2=0x7efdbc0acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 shutdown_connections 2023-10-16T20:07:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.004+0000 7efdc3b4f700 1 -- 172.21.15.152:0/1536317963 wait complete. 2023-10-16T20:07:32.009 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:07:32.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:32.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.136+0000 7f807b2da700 1 Processor -- start 2023-10-16T20:07:32.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.136+0000 7f807b2da700 1 -- start start 2023-10-16T20:07:32.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f807b2da700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f807406a820 0x7f80740cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f807b2da700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f807415e7f0 0x7f807406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f807b2da700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80740cfeb0 con 0x7f80740ca7d0 2023-10-16T20:07:32.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f807b2da700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740ce410 con 0x7f807406a820 2023-10-16T20:07:32.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f807b2da700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807415ec50 con 0x7f807415e7f0 2023-10-16T20:07:32.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f8079076700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f807406a820 0x7f80740cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f8079076700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f807406a820 0x7f80740cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60384/0 (socket says 172.21.15.152:60384) 2023-10-16T20:07:32.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.137+0000 7f8079076700 1 -- 172.21.15.152:0/2586158411 learned_addr learned my addr 172.21.15.152:0/2586158411 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:32.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f8078875700 1 --2- 172.21.15.152:0/2586158411 >> v2:172.21.15.163:3300/0 conn(0x7f807415e7f0 0x7f807406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f8079076700 1 -- 172.21.15.152:0/2586158411 >> v2:172.21.15.163:3300/0 conn(0x7f807415e7f0 msgr2=0x7f807406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:32.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f8079076700 1 --2- 172.21.15.152:0/2586158411 >> v2:172.21.15.163:3300/0 conn(0x7f807415e7f0 0x7f807406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f8079076700 1 -- 172.21.15.152:0/2586158411 >> v1:172.21.15.163:6789/0 conn(0x7f80740ca7d0 legacy=0x7f8074071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:32.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f8079076700 1 -- 172.21.15.152:0/2586158411 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740af9d0 con 0x7f807406a820 2023-10-16T20:07:32.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f8079076700 1 --2- 172.21.15.152:0/2586158411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f807406a820 0x7f80740cf7d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f807406c8a0 tx=0x7f8064009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c99cc5058072d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f806bfff700 1 -- 172.21.15.152:0/2586158411 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064004230 con 0x7f807406a820 2023-10-16T20:07:32.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f806bfff700 1 -- 172.21.15.152:0/2586158411 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8064004390 con 0x7f807406a820 2023-10-16T20:07:32.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f806bfff700 1 -- 172.21.15.152:0/2586158411 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640036a0 con 0x7f807406a820 2023-10-16T20:07:32.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f807b2da700 1 -- 172.21.15.152:0/2586158411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f807406a820 msgr2=0x7f80740cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.138+0000 7f807b2da700 1 --2- 172.21.15.152:0/2586158411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f807406a820 0x7f80740cf7d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f807406c8a0 tx=0x7f8064009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.139+0000 7f807b2da700 1 -- 172.21.15.152:0/2586158411 shutdown_connections 2023-10-16T20:07:32.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.139+0000 7f807b2da700 1 --2- 172.21.15.152:0/2586158411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f807406a820 0x7f80740cf7d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.139+0000 7f807b2da700 1 --2- 172.21.15.152:0/2586158411 >> v2:172.21.15.163:3300/0 conn(0x7f807415e7f0 0x7f807406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.139+0000 7f807b2da700 1 -- 172.21.15.152:0/2586158411 >> 172.21.15.152:0/2586158411 conn(0x7f80740d0180 msgr2=0x7f80740d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:32.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.139+0000 7f807b2da700 1 -- 172.21.15.152:0/2586158411 shutdown_connections 2023-10-16T20:07:32.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.139+0000 7f807b2da700 1 -- 172.21.15.152:0/2586158411 wait complete. 2023-10-16T20:07:32.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.140+0000 7f807b2da700 1 Processor -- start 2023-10-16T20:07:32.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.140+0000 7f807b2da700 1 -- start start 2023-10-16T20:07:32.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f807406a820 0x7f80741f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 0x7f8074160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f807415e7f0 0x7f8074160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80740c9430 con 0x7f80740ca7d0 2023-10-16T20:07:32.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80740c98c0 con 0x7f807415e7f0 2023-10-16T20:07:32.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80741f4170 con 0x7f807406a820 2023-10-16T20:07:32.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 0x7f8074160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 0x7f8074160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60390/0 (socket says 172.21.15.152:60390) 2023-10-16T20:07:32.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 -- 172.21.15.152:0/2366125203 learned_addr learned my addr 172.21.15.152:0/2366125203 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:32.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8079076700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f807406a820 0x7f80741f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 -- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f807406a820 msgr2=0x7f80741f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f807406a820 0x7f80741f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8079877700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f807415e7f0 0x7f8074160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 -- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f807415e7f0 msgr2=0x7f8074160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f807415e7f0 0x7f8074160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 -- 172.21.15.152:0/2366125203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064009550 con 0x7f80740ca7d0 2023-10-16T20:07:32.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8079076700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f807406a820 0x7f80741f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:32.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8079877700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f807415e7f0 0x7f8074160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:32.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8078875700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 0x7f8074160050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f807000d830 tx=0x7f807000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700125f0 con 0x7f80740ca7d0 2023-10-16T20:07:32.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070012750 con 0x7f80740ca7d0 2023-10-16T20:07:32.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80740c8820 con 0x7f80740ca7d0 2023-10-16T20:07:32.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.141+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070012b00 con 0x7f80740ca7d0 2023-10-16T20:07:32.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.142+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80740c8de0 con 0x7f80740ca7d0 2023-10-16T20:07:32.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.142+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80740c95e0 con 0x7f80740ca7d0 2023-10-16T20:07:32.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.143+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8070012c60 con 0x7f80740ca7d0 2023-10-16T20:07:32.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.143+0000 7f8069ffb700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f805806af00 0x7f805806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.143+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8070089ce0 con 0x7f80740ca7d0 2023-10-16T20:07:32.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.143+0000 7f8079076700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f805806af00 0x7f805806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.144+0000 7f8079076700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f805806af00 0x7f805806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f80740b5b60 tx=0x7f8064008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.148+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80740c95e0 con 0x7f80740ca7d0 2023-10-16T20:07:32.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.339+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80740c95e0 con 0x7f80740ca7d0 2023-10-16T20:07:32.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.341+0000 7f8069ffb700 1 -- 172.21.15.152:0/2366125203 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7f80740c95e0 con 0x7f80740ca7d0 2023-10-16T20:07:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:32.344 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:32.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f805806af00 msgr2=0x7f805806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f805806af00 0x7f805806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f80740b5b60 tx=0x7f8064008030 comp rx=0 tx=0).stop 2023-10-16T20:07:32.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 msgr2=0x7f8074160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 0x7f8074160050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f807000d830 tx=0x7f807000dbf0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 shutdown_connections 2023-10-16T20:07:32.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f805806af00 0x7f805806d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f807406a820 0x7f80741f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f807415e7f0 0x7f8074160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 --2- 172.21.15.152:0/2366125203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740ca7d0 0x7f8074160050 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 >> 172.21.15.152:0/2366125203 conn(0x7f80740d0180 msgr2=0x7f80740b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:32.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 shutdown_connections 2023-10-16T20:07:32.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.343+0000 7f807b2da700 1 -- 172.21.15.152:0/2366125203 wait complete. 2023-10-16T20:07:32.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T20:07:32.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.479+0000 7f7fb8f4c700 1 Processor -- start 2023-10-16T20:07:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.479+0000 7f7fb8f4c700 1 -- start start 2023-10-16T20:07:32.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb8f4c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7fb415daa0 0x7f7fb40af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb8f4c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7fb4071f60 0x7f7fb406d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb8f4c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb415ed10 con 0x7f7fb40af560 2023-10-16T20:07:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb8f4c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb415de80 con 0x7f7fb4071f60 2023-10-16T20:07:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb8f4c700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb415e100 con 0x7f7fb415daa0 2023-10-16T20:07:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7fb4071f60 0x7f7fb406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7fb4071f60 0x7f7fb406d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60400/0 (socket says 172.21.15.152:60400) 2023-10-16T20:07:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/215591226 learned_addr learned my addr 172.21.15.152:0/215591226 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb259c700 1 --2- 172.21.15.152:0/215591226 >> v2:172.21.15.163:3300/0 conn(0x7f7fb415daa0 0x7f7fb40af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/215591226 >> v2:172.21.15.163:3300/0 conn(0x7f7fb415daa0 msgr2=0x7f7fb40af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 --2- 172.21.15.152:0/215591226 >> v2:172.21.15.163:3300/0 conn(0x7f7fb415daa0 0x7f7fb40af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/215591226 >> v1:172.21.15.163:6789/0 conn(0x7f7fb40af560 legacy=0x7f7fb4071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/215591226 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb415e3e0 con 0x7f7fb4071f60 2023-10-16T20:07:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb2d9d700 1 --2- 172.21.15.152:0/215591226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb4071f60 0x7f7fb406d100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4072fb0 tx=0x7f7fac00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b4f2a45e7bbcc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.480+0000 7f7fb159a700 1 -- 172.21.15.152:0/215591226 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac010070 con 0x7f7fb4071f60 2023-10-16T20:07:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb159a700 1 -- 172.21.15.152:0/215591226 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00dd90 con 0x7f7fb4071f60 2023-10-16T20:07:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb159a700 1 -- 172.21.15.152:0/215591226 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00b310 con 0x7f7fb4071f60 2023-10-16T20:07:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/215591226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb4071f60 msgr2=0x7f7fb406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/215591226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb4071f60 0x7f7fb406d100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4072fb0 tx=0x7f7fac00d430 comp rx=0 tx=0).stop 2023-10-16T20:07:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/215591226 shutdown_connections 2023-10-16T20:07:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/215591226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb4071f60 0x7f7fb406d100 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/215591226 >> v2:172.21.15.163:3300/0 conn(0x7f7fb415daa0 0x7f7fb40af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/215591226 >> 172.21.15.152:0/215591226 conn(0x7f7fb40d0180 msgr2=0x7f7fb40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/215591226 shutdown_connections 2023-10-16T20:07:32.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.481+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/215591226 wait complete. 2023-10-16T20:07:32.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.482+0000 7f7fb8f4c700 1 Processor -- start 2023-10-16T20:07:32.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.482+0000 7f7fb8f4c700 1 -- start start 2023-10-16T20:07:32.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb8f4c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4071f60 0x7f7fb41579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb8f4c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb40af560 0x7f7fb40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb8f4c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 0x7f7fb40ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb8f4c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4157ef0 con 0x7f7fb415daa0 2023-10-16T20:07:32.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb8f4c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41eed90 con 0x7f7fb4071f60 2023-10-16T20:07:32.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb8f4c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41ef070 con 0x7f7fb40af560 2023-10-16T20:07:32.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb2d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 0x7f7fb40ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb2d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 0x7f7fb40ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60404/0 (socket says 172.21.15.152:60404) 2023-10-16T20:07:32.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.483+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/2160638309 learned_addr learned my addr 172.21.15.152:0/2160638309 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:32.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb259c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4071f60 0x7f7fb41579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb1d9b700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb40af560 0x7f7fb40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb40af560 msgr2=0x7f7fb40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb2d9d700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb40af560 0x7f7fb40ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4071f60 msgr2=0x7f7fb41579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb2d9d700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4071f60 0x7f7fb41579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb2d9d700 1 -- 172.21.15.152:0/2160638309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac00bd40 con 0x7f7fb415daa0 2023-10-16T20:07:32.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb2d9d700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 0x7f7fb40ce7c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00d470 tx=0x7f7fac004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00bbc0 con 0x7f7fb415daa0 2023-10-16T20:07:32.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00b4c0 con 0x7f7fb415daa0 2023-10-16T20:07:32.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb41ef350 con 0x7f7fb415daa0 2023-10-16T20:07:32.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac004040 con 0x7f7fb415daa0 2023-10-16T20:07:32.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.484+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb41ef910 con 0x7f7fb415daa0 2023-10-16T20:07:32.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.485+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb404ebb0 con 0x7f7fb415daa0 2023-10-16T20:07:32.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.485+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7fac0041a0 con 0x7f7fb415daa0 2023-10-16T20:07:32.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.486+0000 7f7fa2ffd700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7f9406af00 0x7f7f9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.486+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7fac08d2c0 con 0x7f7fb415daa0 2023-10-16T20:07:32.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.486+0000 7f7fb259c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7f9406af00 0x7f7f9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.486+0000 7f7fb259c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7f9406af00 0x7f7f9406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40ceeb0 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.490+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fac058040 con 0x7f7fb415daa0 2023-10-16T20:07:32.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.722+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fb4072690 con 0x7f7fb415daa0 2023-10-16T20:07:32.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.723+0000 7f7fa2ffd700 1 -- 172.21.15.152:0/2160638309 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f7fac05b660 con 0x7f7fb415daa0 2023-10-16T20:07:32.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:32.726 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:07:32.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7f9406af00 msgr2=0x7f7f9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7f9406af00 0x7f7f9406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40ceeb0 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2023-10-16T20:07:32.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 msgr2=0x7f7fb40ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 0x7f7fb40ce7c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00d470 tx=0x7f7fac004b20 comp rx=0 tx=0).stop 2023-10-16T20:07:32.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 shutdown_connections 2023-10-16T20:07:32.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7f9406af00 0x7f7f9406d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7fb415daa0 0x7f7fb40ce7c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fb4071f60 0x7f7fb41579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 --2- 172.21.15.152:0/2160638309 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7fb40af560 0x7f7fb40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 >> 172.21.15.152:0/2160638309 conn(0x7f7fb40d0180 msgr2=0x7f7fb406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:32.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 shutdown_connections 2023-10-16T20:07:32.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.725+0000 7f7fb8f4c700 1 -- 172.21.15.152:0/2160638309 wait complete. 2023-10-16T20:07:32.731 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:07:32.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:32.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.859+0000 7f9bc901b700 1 Processor -- start 2023-10-16T20:07:32.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.859+0000 7f9bc901b700 1 -- start start 2023-10-16T20:07:32.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc901b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9bc40cf7d0 0x7f9bc415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc901b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9bc40ca7d0 0x7f9bc4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc901b700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40cfeb0 con 0x7f9bc406a820 2023-10-16T20:07:32.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc901b700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40ce410 con 0x7f9bc40ca7d0 2023-10-16T20:07:32.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc901b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40cfc30 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc359e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9bc40ca7d0 0x7f9bc4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc2d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9bc406a820 0x7f9bc406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40606/0 (socket says 172.21.15.152:40606) 2023-10-16T20:07:32.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc2d9d700 1 -- 172.21.15.152:0/3679214460 learned_addr learned my addr 172.21.15.152:0/3679214460 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:32.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc259c700 1 --2- 172.21.15.152:0/3679214460 >> v2:172.21.15.163:3300/0 conn(0x7f9bc40cf7d0 0x7f9bc415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc359e700 1 -- 172.21.15.152:0/3679214460 >> v2:172.21.15.163:3300/0 conn(0x7f9bc40cf7d0 msgr2=0x7f9bc415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:32.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc359e700 1 --2- 172.21.15.152:0/3679214460 >> v2:172.21.15.163:3300/0 conn(0x7f9bc40cf7d0 0x7f9bc415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc359e700 1 -- 172.21.15.152:0/3679214460 >> v1:172.21.15.152:6789/0 conn(0x7f9bc406a820 legacy=0x7f9bc406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc359e700 1 -- 172.21.15.152:0/3679214460 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40af9d0 con 0x7f9bc40ca7d0 2023-10-16T20:07:32.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc1d9b700 1 -- 172.21.15.152:0/3679214460 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697674037 0 0) 0x7f9bc40cfeb0 con 0x7f9bc406a820 2023-10-16T20:07:32.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc359e700 1 --2- 172.21.15.152:0/3679214460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40ca7d0 0x7f9bc4071ea0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9bc406c8a0 tx=0x7f9bbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fec9cbc2e9adaec server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc1d9b700 1 -- 172.21.15.152:0/3679214460 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00e070 con 0x7f9bc40ca7d0 2023-10-16T20:07:32.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc1d9b700 1 -- 172.21.15.152:0/3679214460 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00bb20 con 0x7f9bc40ca7d0 2023-10-16T20:07:32.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.860+0000 7f9bc1d9b700 1 -- 172.21.15.152:0/3679214460 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc012430 con 0x7f9bc40ca7d0 2023-10-16T20:07:32.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 -- 172.21.15.152:0/3679214460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40ca7d0 msgr2=0x7f9bc4071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 --2- 172.21.15.152:0/3679214460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40ca7d0 0x7f9bc4071ea0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9bc406c8a0 tx=0x7f9bbc00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:32.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 -- 172.21.15.152:0/3679214460 shutdown_connections 2023-10-16T20:07:32.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 --2- 172.21.15.152:0/3679214460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40ca7d0 0x7f9bc4071ea0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 --2- 172.21.15.152:0/3679214460 >> v2:172.21.15.163:3300/0 conn(0x7f9bc40cf7d0 0x7f9bc415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 -- 172.21.15.152:0/3679214460 >> 172.21.15.152:0/3679214460 conn(0x7f9bc40d0180 msgr2=0x7f9bc40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:32.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 -- 172.21.15.152:0/3679214460 shutdown_connections 2023-10-16T20:07:32.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.861+0000 7f9bc901b700 1 -- 172.21.15.152:0/3679214460 wait complete. 2023-10-16T20:07:32.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.862+0000 7f9bc901b700 1 Processor -- start 2023-10-16T20:07:32.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.862+0000 7f9bc901b700 1 -- start start 2023-10-16T20:07:32.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc901b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc406a820 0x7f9bc415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc901b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bc40ca7d0 0x7f9bc4160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc901b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 0x7f9bc40c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc901b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc415c570 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc901b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc415b960 con 0x7f9bc406a820 2023-10-16T20:07:32.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc901b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc415bc40 con 0x7f9bc40ca7d0 2023-10-16T20:07:32.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc359e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 0x7f9bc40c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc359e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 0x7f9bc40c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60418/0 (socket says 172.21.15.152:60418) 2023-10-16T20:07:32.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc359e700 1 -- 172.21.15.152:0/823001713 learned_addr learned my addr 172.21.15.152:0/823001713 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:32.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.863+0000 7f9bc259c700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bc40ca7d0 0x7f9bc4160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc2d9d700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc406a820 0x7f9bc415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc359e700 1 -- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bc40ca7d0 msgr2=0x7f9bc4160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc359e700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bc40ca7d0 0x7f9bc4160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc359e700 1 -- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc406a820 msgr2=0x7f9bc415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:32.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc359e700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc406a820 0x7f9bc415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:32.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc359e700 1 -- 172.21.15.152:0/823001713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc009a70 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc2d9d700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc406a820 0x7f9bc415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:32.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc359e700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 0x7f9bc40c4070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00b370 tx=0x7f9bbc004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc012430 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc020070 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc004280 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc415bf20 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.864+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc415b540 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.865+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc415b700 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.865+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9bbc0043e0 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.866+0000 7f9bab7fe700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bb006af00 0x7f9bb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:32.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.866+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9bbc022070 con 0x7f9bc40cf7d0 2023-10-16T20:07:32.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.866+0000 7f9bc2d9d700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bb006af00 0x7f9bb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:32.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.866+0000 7f9bc2d9d700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bb006af00 0x7f9bb006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4000f60 tx=0x7f9bb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:32.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:32.870+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bbc056410 con 0x7f9bc40cf7d0 2023-10-16T20:07:33.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.112+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bc404ebb0 con 0x7f9bc40cf7d0 2023-10-16T20:07:33.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.112+0000 7f9bab7fe700 1 -- 172.21.15.152:0/823001713 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f9bbc059a30 con 0x7f9bc40cf7d0 2023-10-16T20:07:33.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:33.116 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1867799313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1867799313},{"type":"v1","addr":"172.21.15.163:6835","nonce":1867799313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/3664138936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3664138936},{"type":"v1","addr":"172.21.15.163:6833","nonce":3664138936}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1689129669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1689129669},{"type":"v1","addr":"172.21.15.152:6836","nonce":1689129669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:06:32.144481+0000","modified":"2023-10-16T20:06:49.295679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/1439878702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1439878702},{"type":"v1","addr":"172.21.15.152:6837","nonce":1439878702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T20:07:33.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bb006af00 msgr2=0x7f9bb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bb006af00 0x7f9bb006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4000f60 tx=0x7f9bb4009040 comp rx=0 tx=0).stop 2023-10-16T20:07:33.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 msgr2=0x7f9bc40c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 0x7f9bc40c4070 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00b370 tx=0x7f9bbc004b20 comp rx=0 tx=0).stop 2023-10-16T20:07:33.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 shutdown_connections 2023-10-16T20:07:33.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9bb006af00 0x7f9bb006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc40cf7d0 0x7f9bc40c4070 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc406a820 0x7f9bc415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 --2- 172.21.15.152:0/823001713 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9bc40ca7d0 0x7f9bc4160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 >> 172.21.15.152:0/823001713 conn(0x7f9bc40d0180 msgr2=0x7f9bc40cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:33.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 shutdown_connections 2023-10-16T20:07:33.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.115+0000 7f9bc901b700 1 -- 172.21.15.152:0/823001713 wait complete. 2023-10-16T20:07:33.120 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 9 2023-10-16T20:07:33.130 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:33.252 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.249+0000 7fcac1447700 1 Processor -- start 2023-10-16T20:07:33.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.249+0000 7fcac1447700 1 -- start start 2023-10-16T20:07:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.250+0000 7fcac1447700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcabc1523b0 0x7fcabc0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.250+0000 7fcac1447700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc0cc060 con 0x7fcabc0ce4e0 2023-10-16T20:07:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.250+0000 7fcac1447700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc0cda20 con 0x7fcabc0cef20 2023-10-16T20:07:33.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.250+0000 7fcac1447700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc0cdd00 con 0x7fcabc1523b0 2023-10-16T20:07:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.250+0000 7fcaba7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcabc0ce4e0 0x7fcabc15c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40620/0 (socket says 172.21.15.152:40620) 2023-10-16T20:07:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.250+0000 7fcaba7fc700 1 -- 172.21.15.152:0/3075307947 learned_addr learned my addr 172.21.15.152:0/3075307947 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539956209 0 0) 0x7fcabc0cc060 con 0x7fcabc0ce4e0 2023-10-16T20:07:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaa80035b0 con 0x7fcabc0ce4e0 2023-10-16T20:07:33.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcabaffd700 1 --2- 172.21.15.152:0/3075307947 >> v2:172.21.15.163:3300/0 conn(0x7fcabc1523b0 0x7fcabc0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145396082 0 0) 0x7fcaa80035b0 con 0x7fcabc0ce4e0 2023-10-16T20:07:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 >> v2:172.21.15.163:3300/0 conn(0x7fcabc1523b0 msgr2=0x7fcabc0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 --2- 172.21.15.152:0/3075307947 >> v2:172.21.15.163:3300/0 conn(0x7fcabc1523b0 0x7fcabc0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 >> v1:172.21.15.163:6789/0 conn(0x7fcabc0cef20 legacy=0x7fcabc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0cdfe0 con 0x7fcabc0ce4e0 2023-10-16T20:07:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fcaac001670 con 0x7fcabc0ce4e0 2023-10-16T20:07:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 >> v1:172.21.15.152:6789/0 conn(0x7fcabc0ce4e0 legacy=0x7fcabc15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8003a00 0x7fcaa8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcaa8004850 0x7fcaa8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcaa8005210 0x7fcaa800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0cdd00 con 0x7fcaa8004850 2023-10-16T20:07:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa800c0b0 con 0x7fcaa8005210 2023-10-16T20:07:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa800c270 con 0x7fcaa8003a00 2023-10-16T20:07:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcaa8004850 0x7fcaa8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcabb7fe700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcaa8005210 0x7fcaa800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcabaffd700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8003a00 0x7fcaa8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 -- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8003a00 msgr2=0x7fcaa8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8003a00 0x7fcaa8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 -- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcaa8005210 msgr2=0x7fcaa800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:33.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcaa8005210 0x7fcaa800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 -- 172.21.15.152:0/3075307947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa80035b0 con 0x7fcaa8004850 2023-10-16T20:07:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcabb7fe700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcaa8005210 0x7fcaa800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcabb7fe700 1 -- 172.21.15.152:0/3075307947 reap_dead start 2023-10-16T20:07:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.251+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcaa8004850 0x7fcaa8004cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0b0a10 tx=0x7fcaa8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81de894dea98a9a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00cdd0 con 0x7fcaa8004850 2023-10-16T20:07:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac005960 con 0x7fcaa8004850 2023-10-16T20:07:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcab9ffb700 1 -- 172.21.15.152:0/3075307947 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac005cd0 con 0x7fcaa8004850 2023-10-16T20:07:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 -- 172.21.15.152:0/3075307947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcaa8004850 msgr2=0x7fcaa8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcaa8004850 0x7fcaa8004cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0b0a10 tx=0x7fcaa8005880 comp rx=0 tx=0).stop 2023-10-16T20:07:33.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 -- 172.21.15.152:0/3075307947 shutdown_connections 2023-10-16T20:07:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 --2- 172.21.15.152:0/3075307947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcaa8004850 0x7fcaa8004cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 -- 172.21.15.152:0/3075307947 >> 172.21.15.152:0/3075307947 conn(0x7fcabc070460 msgr2=0x7fcabc070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 -- 172.21.15.152:0/3075307947 shutdown_connections 2023-10-16T20:07:33.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.252+0000 7fcac1447700 1 -- 172.21.15.152:0/3075307947 wait complete. 2023-10-16T20:07:33.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 Processor -- start 2023-10-16T20:07:33.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 -- start start 2023-10-16T20:07:33.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8004850 0x7fcabc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 0x7fcabc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcabc154210 0x7fcabc14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc152c30 con 0x7fcabc15e7d0 2023-10-16T20:07:33.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc152f10 con 0x7fcabc154210 2023-10-16T20:07:33.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcac1447700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc1531f0 con 0x7fcaa8004850 2023-10-16T20:07:33.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcaba7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 0x7fcabc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcaba7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 0x7fcabc153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60434/0 (socket says 172.21.15.152:60434) 2023-10-16T20:07:33.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcaba7fc700 1 -- 172.21.15.152:0/1971983332 learned_addr learned my addr 172.21.15.152:0/1971983332 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:33.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.254+0000 7fcabaffd700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8004850 0x7fcabc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcabb7fe700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcabc154210 0x7fcabc14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcaba7fc700 1 -- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8004850 msgr2=0x7fcabc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8004850 0x7fcabc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcaba7fc700 1 -- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcabc154210 msgr2=0x7fcabc14d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcabc154210 0x7fcabc14d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcaba7fc700 1 -- 172.21.15.152:0/1971983332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc1534d0 con 0x7fcabc15e7d0 2023-10-16T20:07:33.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcabaffd700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8004850 0x7fcabc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:33.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcaba7fc700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 0x7fcabc153cd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcaac001930 tx=0x7fcaac001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac004a80 con 0x7fcabc15e7d0 2023-10-16T20:07:33.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac004c00 con 0x7fcabc15e7d0 2023-10-16T20:07:33.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac0070d0 con 0x7fcabc15e7d0 2023-10-16T20:07:33.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcabc1537b0 con 0x7fcabc15e7d0 2023-10-16T20:07:33.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.255+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc14d930 con 0x7fcabc15e7d0 2023-10-16T20:07:33.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.256+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcabc067230 con 0x7fcabc15e7d0 2023-10-16T20:07:33.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.256+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcaac019070 con 0x7fcabc15e7d0 2023-10-16T20:07:33.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.257+0000 7fcab37fe700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca9c06af00 0x7fca9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.257+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcaac08a750 con 0x7fcabc15e7d0 2023-10-16T20:07:33.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.257+0000 7fcabaffd700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca9c06af00 0x7fca9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.257+0000 7fcabaffd700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca9c06af00 0x7fca9c06d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400dc50 tx=0x7fcaa400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.261+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcaac055590 con 0x7fcabc15e7d0 2023-10-16T20:07:33.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.452+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcabc04ebb0 con 0x7fcabc15e7d0 2023-10-16T20:07:33.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.453+0000 7fcab37fe700 1 -- 172.21.15.152:0/1971983332 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18710 (secure 0 0 0) 0x7fcaac007da0 con 0x7fcabc15e7d0 2023-10-16T20:07:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:33.457 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":28,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:13.866693+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T20:06:30.043710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T20:06:31.139769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T20:06:34.880492+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:33.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca9c06af00 msgr2=0x7fca9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca9c06af00 0x7fca9c06d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400dc50 tx=0x7fcaa400d040 comp rx=0 tx=0).stop 2023-10-16T20:07:33.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 msgr2=0x7fcabc153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 0x7fcabc153cd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcaac001930 tx=0x7fcaac001a00 comp rx=0 tx=0).stop 2023-10-16T20:07:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 shutdown_connections 2023-10-16T20:07:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fca9c06af00 0x7fca9c06d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcaa8004850 0x7fcabc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcabc154210 0x7fcabc14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 --2- 172.21.15.152:0/1971983332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcabc15e7d0 0x7fcabc153cd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 >> 172.21.15.152:0/1971983332 conn(0x7fcabc070460 msgr2=0x7fcabc06c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 shutdown_connections 2023-10-16T20:07:33.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.456+0000 7fcac1447700 1 -- 172.21.15.152:0/1971983332 wait complete. 2023-10-16T20:07:33.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T20:07:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.590+0000 7ff54f1dc700 1 Processor -- start 2023-10-16T20:07:33.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.590+0000 7ff54f1dc700 1 -- start start 2023-10-16T20:07:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54f1dc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff54815b3e0 0x7ff5480cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54f1dc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5480acd80 0x7ff54815f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54f1dc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff54806a820 0x7ff54806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54f1dc700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480cc140 con 0x7ff5480acd80 2023-10-16T20:07:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54f1dc700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54815feb0 con 0x7ff54815b3e0 2023-10-16T20:07:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54f1dc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54806b1b0 con 0x7ff54806a820 2023-10-16T20:07:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5480acd80 0x7ff54815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5480acd80 0x7ff54815f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60440/0 (socket says 172.21.15.152:60440) 2023-10-16T20:07:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 -- 172.21.15.152:0/1070222608 learned_addr learned my addr 172.21.15.152:0/1070222608 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54cf78700 1 --2- 172.21.15.152:0/1070222608 >> v2:172.21.15.163:3300/0 conn(0x7ff54815b3e0 0x7ff5480cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff54d779700 1 --2- 172.21.15.152:0/1070222608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff54806a820 0x7ff54806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 -- 172.21.15.152:0/1070222608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff54806a820 msgr2=0x7ff54806ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 --2- 172.21.15.152:0/1070222608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff54806a820 0x7ff54806ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 -- 172.21.15.152:0/1070222608 >> v2:172.21.15.163:3300/0 conn(0x7ff54815b3e0 msgr2=0x7ff5480cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 --2- 172.21.15.152:0/1070222608 >> v2:172.21.15.163:3300/0 conn(0x7ff54815b3e0 0x7ff5480cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.591+0000 7ff547fff700 1 -- 172.21.15.152:0/1070222608 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54806f510 con 0x7ff5480acd80 2023-10-16T20:07:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff547fff700 1 --2- 172.21.15.152:0/1070222608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5480acd80 0x7ff54815f970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff54806f6c0 tx=0x7ff534009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef47c4066411c4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff5477fe700 1 -- 172.21.15.152:0/1070222608 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400b870 con 0x7ff5480acd80 2023-10-16T20:07:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff5477fe700 1 -- 172.21.15.152:0/1070222608 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53400b9d0 con 0x7ff5480acd80 2023-10-16T20:07:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff5477fe700 1 -- 172.21.15.152:0/1070222608 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400bd60 con 0x7ff5480acd80 2023-10-16T20:07:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 -- 172.21.15.152:0/1070222608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5480acd80 msgr2=0x7ff54815f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/1070222608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5480acd80 0x7ff54815f970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff54806f6c0 tx=0x7ff534009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 -- 172.21.15.152:0/1070222608 shutdown_connections 2023-10-16T20:07:33.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/1070222608 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff54806a820 0x7ff54806ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/1070222608 >> v2:172.21.15.163:3300/0 conn(0x7ff54815b3e0 0x7ff5480cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/1070222608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5480acd80 0x7ff54815f970 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 -- 172.21.15.152:0/1070222608 >> 172.21.15.152:0/1070222608 conn(0x7ff5480ccbd0 msgr2=0x7ff5480ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 -- 172.21.15.152:0/1070222608 shutdown_connections 2023-10-16T20:07:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.592+0000 7ff54f1dc700 1 -- 172.21.15.152:0/1070222608 wait complete. 2023-10-16T20:07:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.593+0000 7ff54f1dc700 1 Processor -- start 2023-10-16T20:07:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.593+0000 7ff54f1dc700 1 -- start start 2023-10-16T20:07:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54f1dc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff54806a820 0x7ff5480cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54f1dc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5480acd80 0x7ff5481f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54f1dc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 0x7ff5481f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54f1dc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5481f3110 con 0x7ff54815b3e0 2023-10-16T20:07:33.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54f1dc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cb200 con 0x7ff54806a820 2023-10-16T20:07:33.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54f1dc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5481f2500 con 0x7ff5480acd80 2023-10-16T20:07:33.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54d779700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 0x7ff5481f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54d779700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 0x7ff5481f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60450/0 (socket says 172.21.15.152:60450) 2023-10-16T20:07:33.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.594+0000 7ff54d779700 1 -- 172.21.15.152:0/2205547541 learned_addr learned my addr 172.21.15.152:0/2205547541 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:33.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff547fff700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5480acd80 0x7ff5481f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54cf78700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff54806a820 0x7ff5480cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54d779700 1 -- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5480acd80 msgr2=0x7ff5481f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54d779700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5480acd80 0x7ff5481f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54d779700 1 -- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff54806a820 msgr2=0x7ff5480cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54d779700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff54806a820 0x7ff5480cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54d779700 1 -- 172.21.15.152:0/2205547541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009550 con 0x7ff54815b3e0 2023-10-16T20:07:33.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54d779700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 0x7ff5481f35a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff540007d40 tx=0x7ff54000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000ed30 con 0x7ff54815b3e0 2023-10-16T20:07:33.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540007e30 con 0x7ff54815b3e0 2023-10-16T20:07:33.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5481f27e0 con 0x7ff54815b3e0 2023-10-16T20:07:33.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540014660 con 0x7ff54815b3e0 2023-10-16T20:07:33.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.595+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5481f2da0 con 0x7ff54815b3e0 2023-10-16T20:07:33.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.596+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5481f2f30 con 0x7ff54815b3e0 2023-10-16T20:07:33.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.596+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff5400147c0 con 0x7ff54815b3e0 2023-10-16T20:07:33.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.597+0000 7ff5457fa700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff52c06af00 0x7ff52c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.597+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff540089e80 con 0x7ff54815b3e0 2023-10-16T20:07:33.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.597+0000 7ff54cf78700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff52c06af00 0x7ff52c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.597+0000 7ff54cf78700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff52c06af00 0x7ff52c06d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff53c006b20 tx=0x7ff53c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.602+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff540054b70 con 0x7ff54815b3e0 2023-10-16T20:07:33.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.835+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff54804ebb0 con 0x7ff54815b3e0 2023-10-16T20:07:33.839 INFO:tasks.ceph.mon.a.smithi152.stderr:2023-10-16T20:07:33.836+0000 7f6cb7ace700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T20:07:33.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.837+0000 7ff5457fa700 1 -- 172.21.15.152:0/2205547541 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff540058190 con 0x7ff54815b3e0 2023-10-16T20:07:33.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff52c06af00 msgr2=0x7ff52c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff52c06af00 0x7ff52c06d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff53c006b20 tx=0x7ff53c008040 comp rx=0 tx=0).stop 2023-10-16T20:07:33.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 msgr2=0x7ff5481f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 0x7ff5481f35a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff540007d40 tx=0x7ff54000e3c0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 shutdown_connections 2023-10-16T20:07:33.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff52c06af00 0x7ff52c06d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff54815b3e0 0x7ff5481f35a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff54806a820 0x7ff5480cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 --2- 172.21.15.152:0/2205547541 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5480acd80 0x7ff5481f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.840+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 >> 172.21.15.152:0/2205547541 conn(0x7ff5480ccbd0 msgr2=0x7ff548159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:33.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.841+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 shutdown_connections 2023-10-16T20:07:33.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.841+0000 7ff54f1dc700 1 -- 172.21.15.152:0/2205547541 wait complete. 2023-10-16T20:07:33.846 INFO:teuthology.orchestra.run.smithi152.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T20:07:33.847 INFO:tasks.ceph.mds.a.smithi152.stderr: -5670> 2023-10-16T20:06:35.321+0000 7f1b17d5e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T20:07:33.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T20:07:33.878 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2023-10-16T20:07:33.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.979+0000 7f62c0850700 1 Processor -- start 2023-10-16T20:07:33.983 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.979+0000 7f62c0850700 1 -- start start 2023-10-16T20:07:33.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62c0850700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62bc0ce740 0x7f62bc071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62c0850700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0ce520 con 0x7f62bc15a330 2023-10-16T20:07:33.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62c0850700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0cdf60 con 0x7f62bc15a710 2023-10-16T20:07:33.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62c0850700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc15e5e0 con 0x7f62bc0ce740 2023-10-16T20:07:33.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62bad9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62bc0ce740 0x7f62bc071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62bad9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62bc0ce740 0x7f62bc071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60470/0 (socket says 172.21.15.152:60470) 2023-10-16T20:07:33.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62ba59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f62bc15a330 0x7f62bc0725c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40664/0 (socket says 172.21.15.152:40664) 2023-10-16T20:07:33.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.980+0000 7f62bad9d700 1 -- 172.21.15.152:0/1173847858 learned_addr learned my addr 172.21.15.152:0/1173847858 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:33.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62bad9d700 1 -- 172.21.15.152:0/1173847858 >> v1:172.21.15.163:6789/0 conn(0x7f62bc15a710 legacy=0x7f62bc15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:33.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62bad9d700 1 -- 172.21.15.152:0/1173847858 >> v1:172.21.15.152:6789/0 conn(0x7f62bc15a330 legacy=0x7f62bc0725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62bad9d700 1 -- 172.21.15.152:0/1173847858 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0ce240 con 0x7f62bc0ce740 2023-10-16T20:07:33.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62b959a700 1 -- 172.21.15.152:0/1173847858 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265042492 0 0) 0x7f62bc0ce520 con 0x7f62bc15a330 2023-10-16T20:07:33.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62bad9d700 1 --2- 172.21.15.152:0/1173847858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc0ce740 0x7f62bc071880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f62b400d150 tx=0x7f62b400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05d34720cca30a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62b959a700 1 -- 172.21.15.152:0/1173847858 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4010070 con 0x7f62bc0ce740 2023-10-16T20:07:33.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62b959a700 1 -- 172.21.15.152:0/1173847858 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400dd80 con 0x7f62bc0ce740 2023-10-16T20:07:33.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.981+0000 7f62b959a700 1 -- 172.21.15.152:0/1173847858 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400b310 con 0x7f62bc0ce740 2023-10-16T20:07:33.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 -- 172.21.15.152:0/1173847858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc0ce740 msgr2=0x7f62bc071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 --2- 172.21.15.152:0/1173847858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc0ce740 0x7f62bc071880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f62b400d150 tx=0x7f62b400d460 comp rx=0 tx=0).stop 2023-10-16T20:07:33.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 -- 172.21.15.152:0/1173847858 shutdown_connections 2023-10-16T20:07:33.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 --2- 172.21.15.152:0/1173847858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc0ce740 0x7f62bc071880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 -- 172.21.15.152:0/1173847858 >> 172.21.15.152:0/1173847858 conn(0x7f62bc0ccce0 msgr2=0x7f62bc0cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:33.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 -- 172.21.15.152:0/1173847858 shutdown_connections 2023-10-16T20:07:33.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.982+0000 7f62c0850700 1 -- 172.21.15.152:0/1173847858 wait complete. 2023-10-16T20:07:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.983+0000 7f62c0850700 1 Processor -- start 2023-10-16T20:07:33.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.983+0000 7f62c0850700 1 -- start start 2023-10-16T20:07:33.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62c0850700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62bc0ce740 0x7f62bc0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62c0850700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 0x7f62bc150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62c0850700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62bc15a710 0x7f62bc157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:33.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62c0850700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b4550 con 0x7f62bc15a330 2023-10-16T20:07:33.994 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62c0850700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b4830 con 0x7f62bc15a710 2023-10-16T20:07:33.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62c0850700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0b4b10 con 0x7f62bc0ce740 2023-10-16T20:07:33.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 0x7f62bc150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 0x7f62bc150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60474/0 (socket says 172.21.15.152:60474) 2023-10-16T20:07:33.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 -- 172.21.15.152:0/277391381 learned_addr learned my addr 172.21.15.152:0/277391381 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:33.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62ba59c700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62bc0ce740 0x7f62bc0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62bad9d700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62bc15a710 0x7f62bc157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:33.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 -- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62bc0ce740 msgr2=0x7f62bc0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62bc0ce740 0x7f62bc0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 -- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62bc15a710 msgr2=0x7f62bc157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:33.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62bc15a710 0x7f62bc157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:33.997 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 -- 172.21.15.152:0/277391381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b400bd40 con 0x7f62bc15a330 2023-10-16T20:07:33.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62bad9d700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62bc15a710 0x7f62bc157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:33.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.984+0000 7f62b9d9b700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 0x7f62bc150080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00b450 tx=0x7f62ac00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:33.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.985+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac011830 con 0x7f62bc15a330 2023-10-16T20:07:33.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.985+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac011990 con 0x7f62bc15a330 2023-10-16T20:07:33.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.985+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc0b4df0 con 0x7f62bc15a330 2023-10-16T20:07:33.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.985+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac011d40 con 0x7f62bc15a330 2023-10-16T20:07:33.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.985+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc1505c0 con 0x7f62bc15a330 2023-10-16T20:07:34.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.985+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc0673a0 con 0x7f62bc15a330 2023-10-16T20:07:34.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.986+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62ac01a400 con 0x7f62bc15a330 2023-10-16T20:07:34.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.986+0000 7f62aaffd700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f629c06af00 0x7f629c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:34.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.986+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f62ac0895f0 con 0x7f62bc15a330 2023-10-16T20:07:34.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.986+0000 7f62ba59c700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f629c06af00 0x7f629c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:34.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.987+0000 7f62ba59c700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f629c06af00 0x7f629c06d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007fd0 tx=0x7f62b0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:34.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:33.992+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62ac054340 con 0x7f62bc15a330 2023-10-16T20:07:34.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.223+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f62bc04ebb0 con 0x7f62bc15a330 2023-10-16T20:07:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.838+0000 7f62aaffd700 1 -- 172.21.15.152:0/277391381 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62ac057960 con 0x7f62bc15a330 2023-10-16T20:07:34.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f629c06af00 msgr2=0x7f629c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:34.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f629c06af00 0x7f629c06d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007fd0 tx=0x7f62b0007de0 comp rx=0 tx=0).stop 2023-10-16T20:07:34.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 msgr2=0x7f62bc150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:34.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 0x7f62bc150080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00b450 tx=0x7f62ac00b760 comp rx=0 tx=0).stop 2023-10-16T20:07:34.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 shutdown_connections 2023-10-16T20:07:34.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f629c06af00 0x7f629c06d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:34.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62bc0ce740 0x7f62bc0c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:34.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62bc15a710 0x7f62bc157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:34.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 --2- 172.21.15.152:0/277391381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62bc15a330 0x7f62bc150080 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:34.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 >> 172.21.15.152:0/277391381 conn(0x7f62bc0ccce0 msgr2=0x7f62bc0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:34.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 shutdown_connections 2023-10-16T20:07:34.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:34.841+0000 7f62c0850700 1 -- 172.21.15.152:0/277391381 wait complete. 2023-10-16T20:07:34.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T20:07:35.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.022+0000 7fb4a338c700 1 Processor -- start 2023-10-16T20:07:35.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.022+0000 7fb4a338c700 1 -- start start 2023-10-16T20:07:35.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a338c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb49c15da20 0x7fb49c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:35.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a338c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:35.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a338c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c15de00 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a338c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49c0cc1e0 con 0x7fb49c15da20 2023-10-16T20:07:35.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a338c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0cb660 con 0x7fb49c0ce820 2023-10-16T20:07:35.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb49c15da20 0x7fb49c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:35.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb49c15da20 0x7fb49c0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60482/0 (socket says 172.21.15.152:60482) 2023-10-16T20:07:35.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 -- 172.21.15.152:0/3910476683 learned_addr learned my addr 172.21.15.152:0/3910476683 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:35.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1929700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:35.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 -- 172.21.15.152:0/3910476683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 msgr2=0x7fb49c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:35.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c06cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 -- 172.21.15.152:0/3910476683 >> v1:172.21.15.163:6789/0 conn(0x7fb49c0cb1e0 legacy=0x7fb49c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:35.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 -- 172.21.15.152:0/3910476683 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c0cb940 con 0x7fb49c15da20 2023-10-16T20:07:35.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1929700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c06cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:35.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb4a1128700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c15da20 0x7fb49c0caca0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00bbc0 tx=0x7fb48c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f03c36b84173319 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:35.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb493fff700 1 -- 172.21.15.152:0/3910476683 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00dd50 con 0x7fb49c15da20 2023-10-16T20:07:35.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb493fff700 1 -- 172.21.15.152:0/3910476683 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c010470 con 0x7fb49c15da20 2023-10-16T20:07:35.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.023+0000 7fb493fff700 1 -- 172.21.15.152:0/3910476683 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c010800 con 0x7fb49c15da20 2023-10-16T20:07:35.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 -- 172.21.15.152:0/3910476683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c15da20 msgr2=0x7fb49c0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:35.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c15da20 0x7fb49c0caca0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00bbc0 tx=0x7fb48c00bed0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 -- 172.21.15.152:0/3910476683 shutdown_connections 2023-10-16T20:07:35.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c06cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 --2- 172.21.15.152:0/3910476683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c15da20 0x7fb49c0caca0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 -- 172.21.15.152:0/3910476683 >> 172.21.15.152:0/3910476683 conn(0x7fb49c0b13e0 msgr2=0x7fb49c0b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:35.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 -- 172.21.15.152:0/3910476683 shutdown_connections 2023-10-16T20:07:35.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.024+0000 7fb4a338c700 1 -- 172.21.15.152:0/3910476683 wait complete. 2023-10-16T20:07:35.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.025+0000 7fb4a338c700 1 Processor -- start 2023-10-16T20:07:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.025+0000 7fb4a338c700 1 -- start start 2023-10-16T20:07:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a338c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 0x7fb49c0ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a338c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a338c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c15da20 0x7fb49c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a338c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0ad780 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a338c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c1f30f0 con 0x7fb49c15da20 2023-10-16T20:07:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a338c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0c3d40 con 0x7fb49c0ce820 2023-10-16T20:07:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 0x7fb49c0ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 0x7fb49c0ad240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60488/0 (socket says 172.21.15.152:60488) 2023-10-16T20:07:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 -- 172.21.15.152:0/4237857443 learned_addr learned my addr 172.21.15.152:0/4237857443 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:35.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a0927700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:35.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1929700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c15da20 0x7fb49c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:35.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 -- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 msgr2=0x7fb49c157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:35.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 -- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c15da20 msgr2=0x7fb49c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:35.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c15da20 0x7fb49c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 -- 172.21.15.152:0/4237857443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c00b7f0 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1929700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c15da20 0x7fb49c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:35.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a0927700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:35.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.026+0000 7fb4a1128700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 0x7fb49c0ad240 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00bf10 tx=0x7fb48c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:35.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.027+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c003c30 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.027+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c003db0 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.027+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c0c4020 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.027+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c010820 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.027+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c0c45e0 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.028+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c04ebb0 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.028+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb48c019400 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.028+0000 7fb491ffb700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb48006af00 0x7fb48006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:35.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.029+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fb48c08ae40 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.029+0000 7fb4a0927700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb48006af00 0x7fb48006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:35.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.029+0000 7fb4a0927700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb48006af00 0x7fb48006d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb49c15baf0 tx=0x7fb498009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:35.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.033+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb48c055b70 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.226+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb49c06c140 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.953+0000 7fb491ffb700 1 -- 172.21.15.152:0/4237857443 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb48c059190 con 0x7fb49c0cb1e0 2023-10-16T20:07:35.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb48006af00 msgr2=0x7fb48006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:35.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb48006af00 0x7fb48006d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb49c15baf0 tx=0x7fb498009040 comp rx=0 tx=0).stop 2023-10-16T20:07:35.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 msgr2=0x7fb49c0ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:35.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 0x7fb49c0ad240 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00bf10 tx=0x7fb48c004750 comp rx=0 tx=0).stop 2023-10-16T20:07:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 shutdown_connections 2023-10-16T20:07:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb48006af00 0x7fb48006d3c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c15da20 0x7fb49c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb49c0cb1e0 0x7fb49c0ad240 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 --2- 172.21.15.152:0/4237857443 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb49c0ce820 0x7fb49c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 >> 172.21.15.152:0/4237857443 conn(0x7fb49c0b13e0 msgr2=0x7fb49c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 shutdown_connections 2023-10-16T20:07:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:35.958+0000 7fb4a338c700 1 -- 172.21.15.152:0/4237857443 wait complete. 2023-10-16T20:07:35.962 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' removed 2023-10-16T20:07:35.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T20:07:36.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.110+0000 7f1eddc11700 1 Processor -- start 2023-10-16T20:07:36.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.110+0000 7f1eddc11700 1 -- start start 2023-10-16T20:07:36.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1eddc11700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1ed815b4e0 0x7f1ed806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1eddc11700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 0x7f1ed80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1eddc11700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed8070620 con 0x7f1ed80b3220 2023-10-16T20:07:36.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1eddc11700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80b36b0 con 0x7f1ed815b4e0 2023-10-16T20:07:36.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1eddc11700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8070900 con 0x7f1ed80cd770 2023-10-16T20:07:36.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1ed7fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1ed80b3220 0x7f1ed80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40698/0 (socket says 172.21.15.152:40698) 2023-10-16T20:07:36.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.111+0000 7f1ed7fff700 1 -- 172.21.15.152:0/3214424714 learned_addr learned my addr 172.21.15.152:0/3214424714 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:36.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed6ffd700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 0x7f1ed80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/3214424714 >> v2:172.21.15.163:3300/0 conn(0x7f1ed815b4e0 0x7f1ed806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991478721 0 0) 0x7f1ed8070620 con 0x7f1ed80b3220 2023-10-16T20:07:36.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec40035b0 con 0x7f1ed80b3220 2023-10-16T20:07:36.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2047558400 0 0) 0x7f1ec40035b0 con 0x7f1ed80b3220 2023-10-16T20:07:36.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 msgr2=0x7f1ed80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:36.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 0x7f1ed80b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 >> v2:172.21.15.163:3300/0 conn(0x7f1ed815b4e0 msgr2=0x7f1ed806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:36.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 --2- 172.21.15.152:0/3214424714 >> v2:172.21.15.163:3300/0 conn(0x7f1ed815b4e0 0x7f1ed806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8070be0 con 0x7f1ed80b3220 2023-10-16T20:07:36.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f1ed00019f0 con 0x7f1ed80b3220 2023-10-16T20:07:36.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 >> v1:172.21.15.152:6789/0 conn(0x7f1ed80b3220 legacy=0x7f1ed80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:36.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ec4003a00 0x7f1ec4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 0x7f1ec4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ec4004d90 0x7f1ec4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80b36b0 con 0x7f1ec4003a00 2023-10-16T20:07:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8070900 con 0x7f1ec4004d90 2023-10-16T20:07:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec400ba10 con 0x7f1ed80cd770 2023-10-16T20:07:36.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ec4003a00 0x7f1ec4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed6ffd700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 0x7f1ec4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed7fff700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ec4004d90 0x7f1ec4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 -- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 msgr2=0x7f1ec4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ed80cd770 0x7f1ec4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 -- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ec4004d90 msgr2=0x7f1ec4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ec4004d90 0x7f1ec4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 -- 172.21.15.152:0/3214424714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40035b0 con 0x7f1ec4003a00 2023-10-16T20:07:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed7fff700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ec4004d90 0x7f1ec4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ec4003a00 0x7f1ec4003e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009b60 tx=0x7f1ec4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d197f30c574f0e98 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:36.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.112+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec000e660 con 0x7f1ec4003a00 2023-10-16T20:07:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec000e7c0 con 0x7f1ec4003a00 2023-10-16T20:07:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1ed67fc700 1 -- 172.21.15.152:0/3214424714 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec000eb30 con 0x7f1ec4003a00 2023-10-16T20:07:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1eddc11700 1 -- 172.21.15.152:0/3214424714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ec4003a00 msgr2=0x7f1ec4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1eddc11700 1 --2- 172.21.15.152:0/3214424714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ec4003a00 0x7f1ec4003e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009b60 tx=0x7f1ec4005880 comp rx=0 tx=0).stop 2023-10-16T20:07:36.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1ed7fff700 1 -- 172.21.15.152:0/3214424714 reap_dead start 2023-10-16T20:07:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1eddc11700 1 -- 172.21.15.152:0/3214424714 shutdown_connections 2023-10-16T20:07:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1eddc11700 1 -- 172.21.15.152:0/3214424714 >> 172.21.15.152:0/3214424714 conn(0x7f1ed80cdce0 msgr2=0x7f1ed80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1eddc11700 1 -- 172.21.15.152:0/3214424714 shutdown_connections 2023-10-16T20:07:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.113+0000 7f1eddc11700 1 -- 172.21.15.152:0/3214424714 wait complete. 2023-10-16T20:07:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.114+0000 7f1eddc11700 1 Processor -- start 2023-10-16T20:07:36.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 -- start start 2023-10-16T20:07:36.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ec4003a00 0x7f1ed81e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ed81e4090 0x7f1ed81e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 0x7f1ed81591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed81e5d10 con 0x7f1ed8158d70 2023-10-16T20:07:36.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed81e58f0 con 0x7f1ed81e4090 2023-10-16T20:07:36.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1eddc11700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed81e4a50 con 0x7f1ec4003a00 2023-10-16T20:07:36.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1ed7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 0x7f1ed81591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1ed7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 0x7f1ed81591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60512/0 (socket says 172.21.15.152:60512) 2023-10-16T20:07:36.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.115+0000 7f1ed7fff700 1 -- 172.21.15.152:0/820315113 learned_addr learned my addr 172.21.15.152:0/820315113 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:36.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ec4003a00 0x7f1ed81e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed6ffd700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ed81e4090 0x7f1ed81e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed7fff700 1 -- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ec4003a00 msgr2=0x7f1ed81e6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:36.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed7fff700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ec4003a00 0x7f1ed81e6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed7fff700 1 -- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ed81e4090 msgr2=0x7f1ed81e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:36.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed7fff700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ed81e4090 0x7f1ed81e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed7fff700 1 -- 172.21.15.152:0/820315113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8159730 con 0x7f1ed8158d70 2023-10-16T20:07:36.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed6ffd700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ed81e4090 0x7f1ed81e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:36.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ed7fff700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 0x7f1ed81591f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806f1b0 tx=0x7f1ed000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:36.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0017070 con 0x7f1ed8158d70 2023-10-16T20:07:36.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed000ecd0 con 0x7f1ed8158d70 2023-10-16T20:07:36.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed8159c10 con 0x7f1ed8158d70 2023-10-16T20:07:36.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000ee60 con 0x7f1ed8158d70 2023-10-16T20:07:36.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.116+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed81e4f50 con 0x7f1ed8158d70 2023-10-16T20:07:36.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.117+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed81e5a30 con 0x7f1ed8158d70 2023-10-16T20:07:36.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.117+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ed0013420 con 0x7f1ed8158d70 2023-10-16T20:07:36.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.118+0000 7f1ecffff700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1eb806af00 0x7f1eb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:36.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.118+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f1ed0089410 con 0x7f1ed8158d70 2023-10-16T20:07:36.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.118+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1eb806af00 0x7f1eb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:36.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.118+0000 7f1ed77fe700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1eb806af00 0x7f1eb806d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00090b0 tx=0x7f1ec001f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:36.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.122+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ed81e5a30 con 0x7f1ed8158d70 2023-10-16T20:07:36.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.312+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1ed8159730 con 0x7f1ed8158d70 2023-10-16T20:07:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.964+0000 7f1ecffff700 1 -- 172.21.15.152:0/820315113 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1ed8159730 con 0x7f1ed8158d70 2023-10-16T20:07:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1eb806af00 msgr2=0x7f1eb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1eb806af00 0x7f1eb806d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00090b0 tx=0x7f1ec001f040 comp rx=0 tx=0).stop 2023-10-16T20:07:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 msgr2=0x7f1ed81591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 0x7f1ed81591f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1ed806f1b0 tx=0x7f1ed000e440 comp rx=0 tx=0).stop 2023-10-16T20:07:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 shutdown_connections 2023-10-16T20:07:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1eb806af00 0x7f1eb806d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1ec4003a00 0x7f1ed81e6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ed8158d70 0x7f1ed81591f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 --2- 172.21.15.152:0/820315113 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ed81e4090 0x7f1ed81e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 >> 172.21.15.152:0/820315113 conn(0x7f1ed80cdce0 msgr2=0x7f1ed80ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 shutdown_connections 2023-10-16T20:07:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:36.968+0000 7f1eddc11700 1 -- 172.21.15.152:0/820315113 wait complete. 2023-10-16T20:07:36.973 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' removed 2023-10-16T20:07:36.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-16T20:07:37.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.110+0000 7f3434a39700 1 Processor -- start 2023-10-16T20:07:37.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.110+0000 7f3434a39700 1 -- start start 2023-10-16T20:07:37.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.111+0000 7f3434a39700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f343006f2c0 0x7f3430140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.111+0000 7f3434a39700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343015b930 con 0x7f34300c78d0 2023-10-16T20:07:37.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.111+0000 7f3434a39700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300cf000 con 0x7f34301414e0 2023-10-16T20:07:37.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.111+0000 7f3434a39700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34300c7cb0 con 0x7f343006f2c0 2023-10-16T20:07:37.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.111+0000 7f342e59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f34300c78d0 0x7f343006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40714/0 (socket says 172.21.15.152:40714) 2023-10-16T20:07:37.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.111+0000 7f342e59c700 1 -- 172.21.15.152:0/1174385831 learned_addr learned my addr 172.21.15.152:0/1174385831 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:37.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597852542 0 0) 0x7f343015b930 con 0x7f34300c78d0 2023-10-16T20:07:37.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34180035b0 con 0x7f34300c78d0 2023-10-16T20:07:37.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 --2- 172.21.15.152:0/1174385831 >> v2:172.21.15.163:3300/0 conn(0x7f343006f2c0 0x7f3430140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 987430657 0 0) 0x7f34180035b0 con 0x7f34300c78d0 2023-10-16T20:07:37.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 >> v2:172.21.15.163:3300/0 conn(0x7f343006f2c0 msgr2=0x7f3430140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:37.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 --2- 172.21.15.152:0/1174385831 >> v2:172.21.15.163:3300/0 conn(0x7f343006f2c0 0x7f3430140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 >> v1:172.21.15.163:6789/0 conn(0x7f34301414e0 legacy=0x7f34300cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300cf2e0 con 0x7f34300c78d0 2023-10-16T20:07:37.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f3424001670 con 0x7f34300c78d0 2023-10-16T20:07:37.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 >> v1:172.21.15.152:6789/0 conn(0x7f34300c78d0 legacy=0x7f343006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3418003a00 0x7f3418003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3418004850 0x7f3418004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418005210 0x7f341800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300c7cb0 con 0x7f3418004850 2023-10-16T20:07:37.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341800c0b0 con 0x7f3418003a00 2023-10-16T20:07:37.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341800c270 con 0x7f3418005210 2023-10-16T20:07:37.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3418004850 0x7f3418004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342e59c700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3418003a00 0x7f3418003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342ed9d700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418005210 0x7f341800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 -- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418005210 msgr2=0x7f341800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:37.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418005210 0x7f341800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 -- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3418003a00 msgr2=0x7f3418003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:37.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3418003a00 0x7f3418003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342dd9b700 1 -- 172.21.15.152:0/1174385831 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180035b0 con 0x7f3418004850 2023-10-16T20:07:37.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.112+0000 7f342ed9d700 1 -- 172.21.15.152:0/1174385831 reap_dead start 2023-10-16T20:07:37.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f342dd9b700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3418004850 0x7f3418004cd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3420009b60 tx=0x7f3418005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e552851d03fc0ebf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:37.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000e6c0 con 0x7f3418004850 2023-10-16T20:07:37.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342000e820 con 0x7f3418004850 2023-10-16T20:07:37.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f342d59a700 1 -- 172.21.15.152:0/1174385831 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000eb90 con 0x7f3418004850 2023-10-16T20:07:37.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 -- 172.21.15.152:0/1174385831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3418004850 msgr2=0x7f3418004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3418004850 0x7f3418004cd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3420009b60 tx=0x7f3418005880 comp rx=0 tx=0).stop 2023-10-16T20:07:37.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 -- 172.21.15.152:0/1174385831 shutdown_connections 2023-10-16T20:07:37.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 --2- 172.21.15.152:0/1174385831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3418004850 0x7f3418004cd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 -- 172.21.15.152:0/1174385831 >> 172.21.15.152:0/1174385831 conn(0x7f34300d1290 msgr2=0x7f34300d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:37.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 -- 172.21.15.152:0/1174385831 shutdown_connections 2023-10-16T20:07:37.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.113+0000 7f3434a39700 1 -- 172.21.15.152:0/1174385831 wait complete. 2023-10-16T20:07:37.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.115+0000 7f3434a39700 1 Processor -- start 2023-10-16T20:07:37.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.115+0000 7f3434a39700 1 -- start start 2023-10-16T20:07:37.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.115+0000 7f3434a39700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418004850 0x7f34301f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.115+0000 7f3434a39700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34301f5090 0x7f34300c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f3434a39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 0x7f34301422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f3434a39700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300c9930 con 0x7f34300ca300 2023-10-16T20:07:37.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f3434a39700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3430156670 con 0x7f34301f5090 2023-10-16T20:07:37.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f3434a39700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3430156950 con 0x7f3418004850 2023-10-16T20:07:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 0x7f34301422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 0x7f34301422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60530/0 (socket says 172.21.15.152:60530) 2023-10-16T20:07:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 -- 172.21.15.152:0/1985991988 learned_addr learned my addr 172.21.15.152:0/1985991988 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342dd9b700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34301f5090 0x7f34300c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342e59c700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418004850 0x7f34301f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 -- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418004850 msgr2=0x7f34301f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418004850 0x7f34301f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 -- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34301f5090 msgr2=0x7f34300c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34301f5090 0x7f34300c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 -- 172.21.15.152:0/1985991988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430156c30 con 0x7f34300ca300 2023-10-16T20:07:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342e59c700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418004850 0x7f34301f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f342ed9d700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 0x7f34301422d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f34300cdc10 tx=0x7f34280021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428003c10 con 0x7f34300ca300 2023-10-16T20:07:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428003d90 con 0x7f34300ca300 2023-10-16T20:07:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34300c95c0 con 0x7f34300ca300 2023-10-16T20:07:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342800d9a0 con 0x7f34300ca300 2023-10-16T20:07:37.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.116+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34301429f0 con 0x7f34300ca300 2023-10-16T20:07:37.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.117+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343004ebb0 con 0x7f34300ca300 2023-10-16T20:07:37.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.118+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f342800db00 con 0x7f34300ca300 2023-10-16T20:07:37.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.118+0000 7f341effd700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f341006af00 0x7f341006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.118+0000 7f342e59c700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f341006af00 0x7f341006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.118+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f3428089730 con 0x7f34300ca300 2023-10-16T20:07:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.119+0000 7f342e59c700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f341006af00 0x7f341006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34300694d0 tx=0x7f3424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.123+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3428054790 con 0x7f34300ca300 2023-10-16T20:07:37.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.315+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f34300c6270 con 0x7f34300ca300 2023-10-16T20:07:37.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.969+0000 7f341effd700 1 -- 172.21.15.152:0/1985991988 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3428057db0 con 0x7f34300ca300 2023-10-16T20:07:37.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.973+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f341006af00 msgr2=0x7f341006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.973+0000 7f3434a39700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f341006af00 0x7f341006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f34300694d0 tx=0x7f3424009040 comp rx=0 tx=0).stop 2023-10-16T20:07:37.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.973+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 msgr2=0x7f34301422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:37.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.973+0000 7f3434a39700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 0x7f34301422d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f34300cdc10 tx=0x7f34280021b0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 shutdown_connections 2023-10-16T20:07:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f341006af00 0x7f341006d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3418004850 0x7f34301f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34300ca300 0x7f34301422d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 --2- 172.21.15.152:0/1985991988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34301f5090 0x7f34300c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 >> 172.21.15.152:0/1985991988 conn(0x7f34300d1290 msgr2=0x7f34300d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 shutdown_connections 2023-10-16T20:07:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:37.974+0000 7f3434a39700 1 -- 172.21.15.152:0/1985991988 wait complete. 2023-10-16T20:07:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data_ec' removed 2023-10-16T20:07:37.991 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T20:07:37.991 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T20:07:37.991 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T20:07:37.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:07:37.992 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T20:07:37.992 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T20:07:37.992 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T20:07:37.992 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:07:37.993 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T20:07:37.993 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T20:07:37.993 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T20:07:37.994 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:07:37.994 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T20:07:37.994 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T20:07:37.995 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T20:07:37.995 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:07:38.002 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T20:07:38.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T20:07:38.004 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T20:07:38.004 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T20:07:38.006 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T20:07:38.006 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T20:07:38.045 INFO:tasks.ceph.mds.c:Started 2023-10-16T20:07:38.045 DEBUG:teuthology.parallel:result is None 2023-10-16T20:07:38.047 INFO:tasks.ceph.mds.b:Started 2023-10-16T20:07:38.047 DEBUG:teuthology.parallel:result is None 2023-10-16T20:07:38.048 INFO:tasks.ceph.mds.d:Started 2023-10-16T20:07:38.048 DEBUG:teuthology.parallel:result is None 2023-10-16T20:07:38.126 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2023-10-16T20:07:38.134 INFO:tasks.ceph.mds.b.smithi163.stdout:starting mds.b at 2023-10-16T20:07:38.135 INFO:tasks.ceph.mds.d.smithi163.stdout:starting mds.d at 2023-10-16T20:07:40.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-16T20:07:44.002 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T20:07:44.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T20:07:44.005 INFO:tasks.ceph.mds.a:Started 2023-10-16T20:07:44.006 DEBUG:teuthology.parallel:result is None 2023-10-16T20:07:44.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T20:07:44.096 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2023-10-16T20:07:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.144+0000 7fe5e11c7700 1 Processor -- start 2023-10-16T20:07:44.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.144+0000 7fe5e11c7700 1 -- start start 2023-10-16T20:07:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.144+0000 7fe5e11c7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe5dc0b5700 0x7fe5dc0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5e11c7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe5dc0b9000 0x7fe5dc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5e11c7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc0d0010 con 0x7fe5dc160b50 2023-10-16T20:07:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5e11c7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc0d02f0 con 0x7fe5dc0b9000 2023-10-16T20:07:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5e11c7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc0d05d0 con 0x7fe5dc0b5700 2023-10-16T20:07:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5db59e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe5dc0b9000 0x7fe5dc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5dad9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe5dc160b50 0x7fe5dc0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40764/0 (socket says 172.21.15.152:40764) 2023-10-16T20:07:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5dad9d700 1 -- 172.21.15.152:0/1332034179 learned_addr learned my addr 172.21.15.152:0/1332034179 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5da59c700 1 --2- 172.21.15.152:0/1332034179 >> v2:172.21.15.163:3300/0 conn(0x7fe5dc0b5700 0x7fe5dc0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5db59e700 1 -- 172.21.15.152:0/1332034179 >> v2:172.21.15.163:3300/0 conn(0x7fe5dc0b5700 msgr2=0x7fe5dc0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5db59e700 1 --2- 172.21.15.152:0/1332034179 >> v2:172.21.15.163:3300/0 conn(0x7fe5dc0b5700 0x7fe5dc0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5db59e700 1 -- 172.21.15.152:0/1332034179 >> v1:172.21.15.152:6789/0 conn(0x7fe5dc160b50 legacy=0x7fe5dc0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5db59e700 1 -- 172.21.15.152:0/1332034179 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc0ce160 con 0x7fe5dc0b9000 2023-10-16T20:07:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5d9d9b700 1 -- 172.21.15.152:0/1332034179 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907312613 0 0) 0x7fe5dc0d0010 con 0x7fe5dc160b50 2023-10-16T20:07:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5db59e700 1 --2- 172.21.15.152:0/1332034179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc0b9000 0x7fe5dc0ce680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc162290 tx=0x7fe5d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baf4368902c1c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5d9d9b700 1 -- 172.21.15.152:0/1332034179 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d400e070 con 0x7fe5dc0b9000 2023-10-16T20:07:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5d9d9b700 1 -- 172.21.15.152:0/1332034179 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d400bb20 con 0x7fe5dc0b9000 2023-10-16T20:07:44.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.145+0000 7fe5d9d9b700 1 -- 172.21.15.152:0/1332034179 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4012430 con 0x7fe5dc0b9000 2023-10-16T20:07:44.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 -- 172.21.15.152:0/1332034179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc0b9000 msgr2=0x7fe5dc0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:44.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/1332034179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc0b9000 0x7fe5dc0ce680 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc162290 tx=0x7fe5d400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:44.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 -- 172.21.15.152:0/1332034179 shutdown_connections 2023-10-16T20:07:44.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/1332034179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc0b9000 0x7fe5dc0ce680 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:44.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/1332034179 >> v2:172.21.15.163:3300/0 conn(0x7fe5dc0b5700 0x7fe5dc0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:44.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 -- 172.21.15.152:0/1332034179 >> 172.21.15.152:0/1332034179 conn(0x7fe5dc06bc70 msgr2=0x7fe5dc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:44.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 -- 172.21.15.152:0/1332034179 shutdown_connections 2023-10-16T20:07:44.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.146+0000 7fe5e11c7700 1 -- 172.21.15.152:0/1332034179 wait complete. 2023-10-16T20:07:44.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.147+0000 7fe5e11c7700 1 Processor -- start 2023-10-16T20:07:44.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.147+0000 7fe5e11c7700 1 -- start start 2023-10-16T20:07:44.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5e11c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5dc0b5700 0x7fe5dc1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:44.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5e11c7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5dc0b9000 0x7fe5dc1f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:44.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5e11c7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 0x7fe5dc0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:44.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5e11c7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc1522c0 con 0x7fe5dc160b50 2023-10-16T20:07:44.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5e11c7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc155d00 con 0x7fe5dc0b5700 2023-10-16T20:07:44.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5e11c7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc1577c0 con 0x7fe5dc0b9000 2023-10-16T20:07:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5db59e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 0x7fe5dc0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5db59e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 0x7fe5dc0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60576/0 (socket says 172.21.15.152:60576) 2023-10-16T20:07:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.148+0000 7fe5db59e700 1 -- 172.21.15.152:0/3144903108 learned_addr learned my addr 172.21.15.152:0/3144903108 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5dad9d700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5dc0b5700 0x7fe5dc1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:44.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5da59c700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5dc0b9000 0x7fe5dc1f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:44.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5db59e700 1 -- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5dc0b9000 msgr2=0x7fe5dc1f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:44.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5db59e700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5dc0b9000 0x7fe5dc1f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:44.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5db59e700 1 -- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5dc0b5700 msgr2=0x7fe5dc1f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:44.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5db59e700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5dc0b5700 0x7fe5dc1f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:44.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5db59e700 1 -- 172.21.15.152:0/3144903108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d4009a70 con 0x7fe5dc160b50 2023-10-16T20:07:44.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5db59e700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 0x7fe5dc0ccd90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0d0cb0 tx=0x7fe5d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:44.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4012430 con 0x7fe5dc160b50 2023-10-16T20:07:44.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4020070 con 0x7fe5dc160b50 2023-10-16T20:07:44.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc157a80 con 0x7fe5dc160b50 2023-10-16T20:07:44.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4004280 con 0x7fe5dc160b50 2023-10-16T20:07:44.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.149+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc158040 con 0x7fe5dc160b50 2023-10-16T20:07:44.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.150+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc04ebb0 con 0x7fe5dc160b50 2023-10-16T20:07:44.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.150+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5d40043e0 con 0x7fe5dc160b50 2023-10-16T20:07:44.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.151+0000 7fe5c37fe700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe5c806af00 0x7fe5c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:44.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.151+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe5d4022070 con 0x7fe5dc160b50 2023-10-16T20:07:44.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.151+0000 7fe5dad9d700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe5c806af00 0x7fe5c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:44.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.151+0000 7fe5dad9d700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe5c806af00 0x7fe5c806d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000f60 tx=0x7fe5cc007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:44.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.155+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5d4056790 con 0x7fe5dc160b50 2023-10-16T20:07:44.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:44.362+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe5dc15ff10 con 0x7fe5dc160b50 2023-10-16T20:07:46.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:45.999+0000 7fe5c37fe700 1 -- 172.21.15.152:0/3144903108 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe5d4059db0 con 0x7fe5dc160b50 2023-10-16T20:07:46.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.001+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe5c806af00 msgr2=0x7fe5c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.001+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe5c806af00 0x7fe5c806d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000f60 tx=0x7fe5cc007be0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.001+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 msgr2=0x7fe5dc0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.001+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 0x7fe5dc0ccd90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0d0cb0 tx=0x7fe5d4004ad0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 shutdown_connections 2023-10-16T20:07:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe5c806af00 0x7fe5c806d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5dc160b50 0x7fe5dc0ccd90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5dc0b5700 0x7fe5dc1f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 --2- 172.21.15.152:0/3144903108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe5dc0b9000 0x7fe5dc1f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 >> 172.21.15.152:0/3144903108 conn(0x7fe5dc06bc70 msgr2=0x7fe5dc0d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:46.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 shutdown_connections 2023-10-16T20:07:46.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.002+0000 7fe5e11c7700 1 -- 172.21.15.152:0/3144903108 wait complete. 2023-10-16T20:07:46.007 INFO:teuthology.orchestra.run.smithi152.stderr: removed all blocklist entries 2023-10-16T20:07:46.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T20:07:46.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.144+0000 7f8ee5249700 1 Processor -- start 2023-10-16T20:07:46.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.144+0000 7f8ee5249700 1 -- start start 2023-10-16T20:07:46.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8ee5249700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8ee00cf7d0 0x7f8ee015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8ee5249700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ee0071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8ee5249700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee00cfeb0 con 0x7f8ee006a820 2023-10-16T20:07:46.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8ee5249700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee00ce410 con 0x7f8ee00cf7d0 2023-10-16T20:07:46.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8ee5249700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00cfc30 con 0x7f8ee00ca7d0 2023-10-16T20:07:46.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8eded9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8ee006a820 0x7f8ee006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40780/0 (socket says 172.21.15.152:40780) 2023-10-16T20:07:46.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8eded9d700 1 -- 172.21.15.152:0/4257090335 learned_addr learned my addr 172.21.15.152:0/4257090335 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:46.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8ede59c700 1 --2- 172.21.15.152:0/4257090335 >> v2:172.21.15.163:3300/0 conn(0x7f8ee00cf7d0 0x7f8ee015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144258738 0 0) 0x7f8ee00cfeb0 con 0x7f8ee006a820 2023-10-16T20:07:46.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec80035b0 con 0x7f8ee006a820 2023-10-16T20:07:46.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.145+0000 7f8edf59e700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ee0071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175710155 0 0) 0x7f8ec80035b0 con 0x7f8ee006a820 2023-10-16T20:07:46.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 msgr2=0x7f8ee0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:46.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ee0071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 >> v2:172.21.15.163:3300/0 conn(0x7f8ee00cf7d0 msgr2=0x7f8ee015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:46.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 --2- 172.21.15.152:0/4257090335 >> v2:172.21.15.163:3300/0 conn(0x7f8ee00cf7d0 0x7f8ee015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee00af9d0 con 0x7f8ee006a820 2023-10-16T20:07:46.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f8ed4001670 con 0x7f8ee006a820 2023-10-16T20:07:46.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 >> v1:172.21.15.152:6789/0 conn(0x7f8ee006a820 legacy=0x7f8ee006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ec8003a00 0x7f8ec8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ec8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ec8004d90 0x7f8ec8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00ce410 con 0x7f8ec8004d90 2023-10-16T20:07:46.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00cfc30 con 0x7f8ec8003a00 2023-10-16T20:07:46.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec800bac0 con 0x7f8ee00ca7d0 2023-10-16T20:07:46.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ec8004d90 0x7f8ec8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eded9d700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ec8003a00 0x7f8ec8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8ede59c700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ec8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 -- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 msgr2=0x7f8ec8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:46.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ec8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 -- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ec8003a00 msgr2=0x7f8ec8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:46.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ec8003a00 0x7f8ec8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 -- 172.21.15.152:0/4257090335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80035b0 con 0x7f8ec8004d90 2023-10-16T20:07:46.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8ede59c700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee00ca7d0 0x7f8ec8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:46.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8edf59e700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ec8004d90 0x7f8ec8005210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8007360 tx=0x7f8ec8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7718ad4e0e08e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:46.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8007e80 con 0x7f8ec8004d90 2023-10-16T20:07:46.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed8014400 con 0x7f8ec8004d90 2023-10-16T20:07:46.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.146+0000 7f8eddd9b700 1 -- 172.21.15.152:0/4257090335 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8014790 con 0x7f8ec8004d90 2023-10-16T20:07:46.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8ee5249700 1 -- 172.21.15.152:0/4257090335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ec8004d90 msgr2=0x7f8ec8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8ee5249700 1 --2- 172.21.15.152:0/4257090335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ec8004d90 0x7f8ec8005210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8007360 tx=0x7f8ec8005880 comp rx=0 tx=0).stop 2023-10-16T20:07:46.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8edf59e700 1 -- 172.21.15.152:0/4257090335 reap_dead start 2023-10-16T20:07:46.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8ee5249700 1 -- 172.21.15.152:0/4257090335 shutdown_connections 2023-10-16T20:07:46.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8ee5249700 1 -- 172.21.15.152:0/4257090335 >> 172.21.15.152:0/4257090335 conn(0x7f8ee00d0180 msgr2=0x7f8ee00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:46.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8ee5249700 1 -- 172.21.15.152:0/4257090335 shutdown_connections 2023-10-16T20:07:46.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.147+0000 7f8ee5249700 1 -- 172.21.15.152:0/4257090335 wait complete. 2023-10-16T20:07:46.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 Processor -- start 2023-10-16T20:07:46.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 -- start start 2023-10-16T20:07:46.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 0x7f8ee015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee006e7a0 0x7f8ee015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ee015c5e0 0x7f8ee01574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00c7250 con 0x7f8ee006e3c0 2023-10-16T20:07:46.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00c8d80 con 0x7f8ee015c5e0 2023-10-16T20:07:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8ee5249700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00c9060 con 0x7f8ee006e7a0 2023-10-16T20:07:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8eded9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 0x7f8ee015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8eded9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 0x7f8ee015a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60594/0 (socket says 172.21.15.152:60594) 2023-10-16T20:07:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.149+0000 7f8eded9d700 1 -- 172.21.15.152:0/1888450724 learned_addr learned my addr 172.21.15.152:0/1888450724 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8ede59c700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee006e7a0 0x7f8ee015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8edf59e700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ee015c5e0 0x7f8ee01574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8eded9d700 1 -- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee006e7a0 msgr2=0x7f8ee015c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8eded9d700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee006e7a0 0x7f8ee015c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8eded9d700 1 -- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ee015c5e0 msgr2=0x7f8ee01574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8eded9d700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ee015c5e0 0x7f8ee01574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8eded9d700 1 -- 172.21.15.152:0/1888450724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee00c9340 con 0x7f8ee006e3c0 2023-10-16T20:07:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8edf59e700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ee015c5e0 0x7f8ee01574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8eded9d700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 0x7f8ee015a500 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4000c00 tx=0x7f8ed4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400f840 con 0x7f8ee006e3c0 2023-10-16T20:07:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed400f9c0 con 0x7f8ee006e3c0 2023-10-16T20:07:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee00c9620 con 0x7f8ee006e3c0 2023-10-16T20:07:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400fd70 con 0x7f8ee006e3c0 2023-10-16T20:07:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.150+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee015aa40 con 0x7f8ee006e3c0 2023-10-16T20:07:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.151+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee00c9830 con 0x7f8ee006e3c0 2023-10-16T20:07:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.151+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8ed401d460 con 0x7f8ee006e3c0 2023-10-16T20:07:46.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.152+0000 7f8ec77fe700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8ecc06af30 0x7f8ecc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.152+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8ed4089480 con 0x7f8ee006e3c0 2023-10-16T20:07:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.152+0000 7f8ede59c700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8ecc06af30 0x7f8ecc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.152+0000 7f8ede59c700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8ecc06af30 0x7f8ecc06d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ee006ed90 tx=0x7f8ed0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:46.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.156+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ed4054740 con 0x7f8ee006e3c0 2023-10-16T20:07:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.424+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8ee004ebb0 con 0x7f8ee006e3c0 2023-10-16T20:07:46.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.424+0000 7f8ec77fe700 1 -- 172.21.15.152:0/1888450724 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8ed4057d60 con 0x7f8ee006e3c0 2023-10-16T20:07:46.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:46.427 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:07:46.428 INFO:teuthology.orchestra.run.smithi152.stdout: "auth_dump": [ 2023-10-16T20:07:46.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.428 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.a", 2023-10-16T20:07:46.428 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lYhS0DxAALmh4JVgtqSdl6/9mRnGABQ==", 2023-10-16T20:07:46.428 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.429 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.429 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2023-10-16T20:07:46.429 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2023-10-16T20:07:46.429 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.430 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.430 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.b", 2023-10-16T20:07:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lGE1wHBAAiXxwwNN8MRHu/2PBVnzN1g==", 2023-10-16T20:07:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2023-10-16T20:07:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2023-10-16T20:07:46.431 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.432 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.432 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.c", 2023-10-16T20:07:46.432 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lyL4CFxAA9M83IQ0W0bnwJqsYnN0kQA==", 2023-10-16T20:07:46.433 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2023-10-16T20:07:46.433 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2023-10-16T20:07:46.433 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.433 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.434 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.d", 2023-10-16T20:07:46.434 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lsUQyJBAAJXUKRdtfd/1Tm+F+Ip02TA==", 2023-10-16T20:07:46.434 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.435 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.435 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2023-10-16T20:07:46.435 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2023-10-16T20:07:46.435 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.435 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.436 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.0", 2023-10-16T20:07:46.436 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCRly1llgZcAxAAeElqp2kC0e3tTx7JE18Qrw==", 2023-10-16T20:07:46.436 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.438 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.1", 2023-10-16T20:07:46.438 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCUly1lO9gYAxAAdzacKZqwpqIMdkHVcHhPhA==", 2023-10-16T20:07:46.438 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.438 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.439 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.439 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.439 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.440 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.2", 2023-10-16T20:07:46.440 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCXly1l0/s4AhAAdgzHcaW1Gh5jYuRJQHY9yA==", 2023-10-16T20:07:46.440 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.440 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.441 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.441 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.441 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.442 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.3", 2023-10-16T20:07:46.442 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCaly1lD5ovAhAAxssq/bQrp6mLdpAsBN5H1Q==", 2023-10-16T20:07:46.442 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.443 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.443 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.443 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.443 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.444 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.4", 2023-10-16T20:07:46.444 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCgly1lsYhRCBAA/rufsoEpNoAEKhGrroyZRA==", 2023-10-16T20:07:46.444 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.445 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.445 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.445 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.445 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.5", 2023-10-16T20:07:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCjly1lQgUCCBAAEYklY1QlikhxLs26Y1Edbw==", 2023-10-16T20:07:46.446 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.448 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.6", 2023-10-16T20:07:46.448 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCmly1l8XaABxAAO9CPbSlvRMSYpdZVJsBE8Q==", 2023-10-16T20:07:46.448 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.448 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.449 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.449 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.449 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.450 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.7", 2023-10-16T20:07:46.450 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCply1l/rjNBhAAmik/hiT6QI8FQ9c9PN1DrA==", 2023-10-16T20:07:46.450 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.450 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2023-10-16T20:07:46.451 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2023-10-16T20:07:46.451 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.451 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.452 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.0", 2023-10-16T20:07:46.452 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1l2A6OKBAA5O34FFHdeoZfbqU4ugN4Rw==", 2023-10-16T20:07:46.452 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.452 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.452 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2023-10-16T20:07:46.452 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2023-10-16T20:07:46.453 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2023-10-16T20:07:46.453 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.454 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.1", 2023-10-16T20:07:46.454 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lOkehMRAA+lpyHduc1jI4/58OYnQswA==", 2023-10-16T20:07:46.454 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.454 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.455 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2023-10-16T20:07:46.455 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2023-10-16T20:07:46.455 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2023-10-16T20:07:46.455 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.456 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.2", 2023-10-16T20:07:46.456 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lGQ9DLhAAoF9qKXQRnaOZdE10MqXm+A==", 2023-10-16T20:07:46.456 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.456 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.457 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2023-10-16T20:07:46.457 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2023-10-16T20:07:46.457 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2023-10-16T20:07:46.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.458 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.3", 2023-10-16T20:07:46.458 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1lEgdWNxAAh9FWiZWSibKhBye/y/65/Q==", 2023-10-16T20:07:46.458 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.458 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2023-10-16T20:07:46.459 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2023-10-16T20:07:46.459 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2023-10-16T20:07:46.459 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2023-10-16T20:07:46.459 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.460 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.admin", 2023-10-16T20:07:46.460 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCMly1la96cLRAATeIp+RTobb6okA687DwkBg==", 2023-10-16T20:07:46.460 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.461 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2023-10-16T20:07:46.461 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2023-10-16T20:07:46.461 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2023-10-16T20:07:46.461 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.461 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.462 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-mds", 2023-10-16T20:07:46.462 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCvly1lhGG9BhAAc4w+YiBLlY/wYlcgvnqZsg==", 2023-10-16T20:07:46.462 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.463 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T20:07:46.463 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.463 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T20:07:46.464 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCvly1lM2u9BhAAtQkzFGt4tvkFwBPLYsxVwA==", 2023-10-16T20:07:46.464 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.464 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T20:07:46.464 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.465 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-osd", 2023-10-16T20:07:46.465 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCvly1li3S9BhAA720NusB/9RlOAPfANIeZ3w==", 2023-10-16T20:07:46.465 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.466 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T20:07:46.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.466 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T20:07:46.467 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCvly1lM3y9BhAAMZyPPM8lNMVhbjgnu94TDA==", 2023-10-16T20:07:46.467 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.467 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T20:07:46.467 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.468 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T20:07:46.468 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCvly1l84O9BhAA9U2Ef23N2RcP9mbEwteACw==", 2023-10-16T20:07:46.468 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.468 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T20:07:46.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.469 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T20:07:46.469 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCvly1lqou9BhAAqM5MT5SCERYarSp7eLuY6Q==", 2023-10-16T20:07:46.470 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.470 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T20:07:46.470 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.471 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mgr.x", 2023-10-16T20:07:46.471 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1luLpLDBAAVHIkAFHQYA1M7olQ9X0agA==", 2023-10-16T20:07:46.471 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2023-10-16T20:07:46.472 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile mgr", 2023-10-16T20:07:46.472 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.472 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-10-16T20:07:46.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:46.473 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mgr.y", 2023-10-16T20:07:46.473 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQCNly1l8HkhCBAANzzamcAe5KQ7A6AGgF025g==", 2023-10-16T20:07:46.473 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2023-10-16T20:07:46.473 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2023-10-16T20:07:46.473 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile mgr", 2023-10-16T20:07:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2023-10-16T20:07:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2023-10-16T20:07:46.475 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:07:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8ecc06af30 msgr2=0x7f8ecc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8ecc06af30 0x7f8ecc06d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ee006ed90 tx=0x7f8ed0008040 comp rx=0 tx=0).stop 2023-10-16T20:07:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 msgr2=0x7f8ee015a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 0x7f8ee015a500 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4000c00 tx=0x7f8ed4007720 comp rx=0 tx=0).stop 2023-10-16T20:07:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 shutdown_connections 2023-10-16T20:07:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8ecc06af30 0x7f8ecc06d3f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ee015c5e0 0x7f8ee01574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ee006e3c0 0x7f8ee015a500 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 --2- 172.21.15.152:0/1888450724 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ee006e7a0 0x7f8ee015c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 >> 172.21.15.152:0/1888450724 conn(0x7f8ee00d0180 msgr2=0x7f8ee0071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 shutdown_connections 2023-10-16T20:07:46.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.427+0000 7f8ee5249700 1 -- 172.21.15.152:0/1888450724 wait complete. 2023-10-16T20:07:46.479 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T20:07:46.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.599+0000 7f6ca90e7700 1 Processor -- start 2023-10-16T20:07:46.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.599+0000 7f6ca90e7700 1 -- start start 2023-10-16T20:07:46.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca90e7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6ca406d3c0 0x7f6ca40cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca90e7700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca406d9d0 con 0x7f6ca406cf10 2023-10-16T20:07:46.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca90e7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca406dcb0 con 0x7f6ca40712e0 2023-10-16T20:07:46.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca90e7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40ca420 con 0x7f6ca406d3c0 2023-10-16T20:07:46.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca359e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6ca406d3c0 0x7f6ca40cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca259c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6ca406cf10 0x7f6ca40caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40802/0 (socket says 172.21.15.152:40802) 2023-10-16T20:07:46.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.600+0000 7f6ca259c700 1 -- 172.21.15.152:0/3388215660 learned_addr learned my addr 172.21.15.152:0/3388215660 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:46.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca359e700 1 -- 172.21.15.152:0/3388215660 >> v1:172.21.15.163:6789/0 conn(0x7f6ca40712e0 legacy=0x7f6ca40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:46.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca1d9b700 1 -- 172.21.15.152:0/3388215660 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470452635 0 0) 0x7f6ca406d9d0 con 0x7f6ca406cf10 2023-10-16T20:07:46.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca359e700 1 -- 172.21.15.152:0/3388215660 >> v1:172.21.15.152:6789/0 conn(0x7f6ca406cf10 legacy=0x7f6ca40caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca359e700 1 -- 172.21.15.152:0/3388215660 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40ca700 con 0x7f6ca406d3c0 2023-10-16T20:07:46.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca359e700 1 --2- 172.21.15.152:0/3388215660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40cb610 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009dc0 tx=0x7f6c9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28712f2a9bdb0e91 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:46.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca1d9b700 1 -- 172.21.15.152:0/3388215660 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00e070 con 0x7f6ca406d3c0 2023-10-16T20:07:46.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca1d9b700 1 -- 172.21.15.152:0/3388215660 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00bb90 con 0x7f6ca406d3c0 2023-10-16T20:07:46.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.601+0000 7f6ca1d9b700 1 -- 172.21.15.152:0/3388215660 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c012430 con 0x7f6ca406d3c0 2023-10-16T20:07:46.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 -- 172.21.15.152:0/3388215660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 msgr2=0x7f6ca40cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/3388215660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40cb610 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009dc0 tx=0x7f6c9c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:46.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 -- 172.21.15.152:0/3388215660 shutdown_connections 2023-10-16T20:07:46.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/3388215660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40cb610 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 -- 172.21.15.152:0/3388215660 >> 172.21.15.152:0/3388215660 conn(0x7f6ca40cfcd0 msgr2=0x7f6ca40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:46.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 -- 172.21.15.152:0/3388215660 shutdown_connections 2023-10-16T20:07:46.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.602+0000 7f6ca90e7700 1 -- 172.21.15.152:0/3388215660 wait complete. 2023-10-16T20:07:46.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.603+0000 7f6ca90e7700 1 Processor -- start 2023-10-16T20:07:46.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.603+0000 7f6ca90e7700 1 -- start start 2023-10-16T20:07:46.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca90e7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ca406cf10 0x7f6ca40c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca90e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca90e7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ca40712e0 0x7f6ca4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca90e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4144ef0 con 0x7f6ca406d3c0 2023-10-16T20:07:46.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca90e7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40c99d0 con 0x7f6ca40712e0 2023-10-16T20:07:46.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca90e7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40c8410 con 0x7f6ca406cf10 2023-10-16T20:07:46.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60610/0 (socket says 172.21.15.152:60610) 2023-10-16T20:07:46.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 -- 172.21.15.152:0/801641241 learned_addr learned my addr 172.21.15.152:0/801641241 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:46.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca359e700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ca40712e0 0x7f6ca4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca2d9d700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ca406cf10 0x7f6ca40c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 -- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ca406cf10 msgr2=0x7f6ca40c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ca406cf10 0x7f6ca40c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 -- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ca40712e0 msgr2=0x7f6ca4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ca40712e0 0x7f6ca4156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 -- 172.21.15.152:0/801641241 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c009a70 con 0x7f6ca406d3c0 2023-10-16T20:07:46.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.604+0000 7f6ca259c700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40c9490 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c520 tx=0x7f6c9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:46.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.605+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94004c80 con 0x7f6ca406d3c0 2023-10-16T20:07:46.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.605+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94004e00 con 0x7f6ca406d3c0 2023-10-16T20:07:46.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.605+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca40c85f0 con 0x7f6ca406d3c0 2023-10-16T20:07:46.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.605+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94007310 con 0x7f6ca406d3c0 2023-10-16T20:07:46.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.605+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca40c8e50 con 0x7f6ca406d3c0 2023-10-16T20:07:46.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.606+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca404ebb0 con 0x7f6ca406d3c0 2023-10-16T20:07:46.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.606+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c94007470 con 0x7f6ca406d3c0 2023-10-16T20:07:46.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.607+0000 7f6c8b7fe700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6c9006af30 0x7f6c9006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:46.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.607+0000 7f6ca2d9d700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6c9006af30 0x7f6c9006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:46.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.607+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6c94088f50 con 0x7f6ca406d3c0 2023-10-16T20:07:46.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.607+0000 7f6ca2d9d700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6c9006af30 0x7f6c9006d3f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007fd0 tx=0x7f6c98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:46.618 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.611+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c940542a0 con 0x7f6ca406d3c0 2023-10-16T20:07:46.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-16T20:07:46.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.881+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6ca40c6e30 con 0x7f6ca406d3c0 2023-10-16T20:07:46.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.885+0000 7f6c8b7fe700 1 -- 172.21.15.152:0/801641241 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6c940578c0 con 0x7f6ca406d3c0 2023-10-16T20:07:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6c9006af30 msgr2=0x7f6c9006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6c9006af30 0x7f6c9006d3f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c98007fd0 tx=0x7f6c98009040 comp rx=0 tx=0).stop 2023-10-16T20:07:46.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 msgr2=0x7f6ca40c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:46.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40c9490 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c520 tx=0x7f6c9400c830 comp rx=0 tx=0).stop 2023-10-16T20:07:46.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 shutdown_connections 2023-10-16T20:07:46.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6c9006af30 0x7f6c9006d3f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6ca406cf10 0x7f6ca40c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ca40712e0 0x7f6ca4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 --2- 172.21.15.152:0/801641241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ca406d3c0 0x7f6ca40c9490 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:46.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 >> 172.21.15.152:0/801641241 conn(0x7f6ca40cfcd0 msgr2=0x7f6ca40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:46.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 shutdown_connections 2023-10-16T20:07:46.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:46.888+0000 7f6ca90e7700 1 -- 172.21.15.152:0/801641241 wait complete. 2023-10-16T20:07:46.902 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T20:07:47.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.023+0000 7f94fc519700 1 Processor -- start 2023-10-16T20:07:47.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.023+0000 7f94fc519700 1 -- start start 2023-10-16T20:07:47.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94fc519700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f94f40cf7d0 0x7f94f415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94fc519700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40cfeb0 con 0x7f94f406a820 2023-10-16T20:07:47.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94fc519700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40cfc30 con 0x7f94f40ca7d0 2023-10-16T20:07:47.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94fc519700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40ce410 con 0x7f94f40cf7d0 2023-10-16T20:07:47.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94fa2b5700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f94f406a820 0x7f94f406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40814/0 (socket says 172.21.15.152:40814) 2023-10-16T20:07:47.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94fa2b5700 1 -- 172.21.15.152:0/1441161314 learned_addr learned my addr 172.21.15.152:0/1441161314 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:47.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140422326 0 0) 0x7f94f40cfeb0 con 0x7f94f406a820 2023-10-16T20:07:47.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e00035b0 con 0x7f94f406a820 2023-10-16T20:07:47.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f9ab4700 1 --2- 172.21.15.152:0/1441161314 >> v2:172.21.15.163:3300/0 conn(0x7f94f40cf7d0 0x7f94f415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2013879791 0 0) 0x7f94e00035b0 con 0x7f94f406a820 2023-10-16T20:07:47.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 >> v2:172.21.15.163:3300/0 conn(0x7f94f40cf7d0 msgr2=0x7f94f415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 --2- 172.21.15.152:0/1441161314 >> v2:172.21.15.163:3300/0 conn(0x7f94f40cf7d0 0x7f94f415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 >> v1:172.21.15.163:6789/0 conn(0x7f94f40ca7d0 legacy=0x7f94f4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.024+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40af9d0 con 0x7f94f406a820 2023-10-16T20:07:47.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f94e4001670 con 0x7f94f406a820 2023-10-16T20:07:47.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 >> v1:172.21.15.152:6789/0 conn(0x7f94f406a820 legacy=0x7f94f406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94e0003a00 0x7f94e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0004850 0x7f94e0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94e0005210 0x7f94e000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40ce410 con 0x7f94e0005210 2023-10-16T20:07:47.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e000c1b0 con 0x7f94e0003a00 2023-10-16T20:07:47.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e000c370 con 0x7f94e0004850 2023-10-16T20:07:47.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94e0005210 0x7f94e000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94fa2b5700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94e0003a00 0x7f94e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f9ab4700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0004850 0x7f94e0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 -- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0004850 msgr2=0x7f94e0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0004850 0x7f94e0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 -- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94e0003a00 msgr2=0x7f94e0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94e0003a00 0x7f94e0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 -- 172.21.15.152:0/1441161314 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00035b0 con 0x7f94e0005210 2023-10-16T20:07:47.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 -- 172.21.15.152:0/1441161314 reap_dead start 2023-10-16T20:07:47.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94faab6700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94e0005210 0x7f94e000ba10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00c190 tx=0x7f94e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84fdabf8407f3b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec001de0 con 0x7f94e0005210 2023-10-16T20:07:47.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00cd30 con 0x7f94e0005210 2023-10-16T20:07:47.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.025+0000 7f94f92b3700 1 -- 172.21.15.152:0/1441161314 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00cea0 con 0x7f94e0005210 2023-10-16T20:07:47.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 -- 172.21.15.152:0/1441161314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94e0005210 msgr2=0x7f94e000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94e0005210 0x7f94e000ba10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00c190 tx=0x7f94e0005880 comp rx=0 tx=0).stop 2023-10-16T20:07:47.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 -- 172.21.15.152:0/1441161314 shutdown_connections 2023-10-16T20:07:47.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 --2- 172.21.15.152:0/1441161314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94e0005210 0x7f94e000ba10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 -- 172.21.15.152:0/1441161314 >> 172.21.15.152:0/1441161314 conn(0x7f94f40d0180 msgr2=0x7f94f40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:47.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 -- 172.21.15.152:0/1441161314 shutdown_connections 2023-10-16T20:07:47.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.026+0000 7f94fc519700 1 -- 172.21.15.152:0/1441161314 wait complete. 2023-10-16T20:07:47.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.027+0000 7f94fc519700 1 Processor -- start 2023-10-16T20:07:47.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.027+0000 7f94fc519700 1 -- start start 2023-10-16T20:07:47.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fc519700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0005210 0x7f94f4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fc519700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94f40ada00 0x7f94f40ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fc519700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 0x7f94f40c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fc519700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4157c00 con 0x7f94f40c7a80 2023-10-16T20:07:47.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fc519700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40ae3c0 con 0x7f94f40ada00 2023-10-16T20:07:47.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fc519700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f415beb0 con 0x7f94e0005210 2023-10-16T20:07:47.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 0x7f94f40c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94f9ab4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94f40ada00 0x7f94f40ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94f9ab4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94f40ada00 0x7f94f40ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:33398/0 (socket says 172.21.15.152:33398) 2023-10-16T20:07:47.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 0x7f94f40c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60632/0 (socket says 172.21.15.152:60632) 2023-10-16T20:07:47.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94f9ab4700 1 -- 172.21.15.152:0/3197123854 learned_addr learned my addr 172.21.15.152:0/3197123854 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:47.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94fa2b5700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0005210 0x7f94f4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 -- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0005210 msgr2=0x7f94f4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0005210 0x7f94f4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 -- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94f40ada00 msgr2=0x7f94f40ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94f40ada00 0x7f94f40ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 -- 172.21.15.152:0/3197123854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f415c190 con 0x7f94f40c7a80 2023-10-16T20:07:47.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.028+0000 7f94faab6700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 0x7f94f40c7f00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94f41623a0 tx=0x7f94ec0014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.029+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00cea0 con 0x7f94f40c7a80 2023-10-16T20:07:47.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.029+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0052e0 con 0x7f94f40c7a80 2023-10-16T20:07:47.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.029+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec005690 con 0x7f94f40c7a80 2023-10-16T20:07:47.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.029+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f415c470 con 0x7f94f40c7a80 2023-10-16T20:07:47.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.029+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f415ca30 con 0x7f94f40c7a80 2023-10-16T20:07:47.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.030+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f404ebb0 con 0x7f94f40c7a80 2023-10-16T20:07:47.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.030+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94ec0057f0 con 0x7f94f40c7a80 2023-10-16T20:07:47.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.030+0000 7f94eaffd700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f94d806af30 0x7f94d806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.030+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f94ec08a030 con 0x7f94f40c7a80 2023-10-16T20:07:47.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.030+0000 7f94fa2b5700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f94d806af30 0x7f94d806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.031+0000 7f94fa2b5700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f94d806af30 0x7f94d806d3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f94e4001c90 tx=0x7f94e4001b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.035+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94ec055440 con 0x7f94f40c7a80 2023-10-16T20:07:47.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.302+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f94f406b490 con 0x7f94f40c7a80 2023-10-16T20:07:47.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.304+0000 7f94eaffd700 1 -- 172.21.15.152:0/3197123854 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f94ec058a60 con 0x7f94f40c7a80 2023-10-16T20:07:47.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f94d806af30 msgr2=0x7f94d806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f94d806af30 0x7f94d806d3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f94e4001c90 tx=0x7f94e4001b20 comp rx=0 tx=0).stop 2023-10-16T20:07:47.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 msgr2=0x7f94f40c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 0x7f94f40c7f00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94f41623a0 tx=0x7f94ec0014f0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 shutdown_connections 2023-10-16T20:07:47.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f94d806af30 0x7f94d806d3f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f94e0005210 0x7f94f4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94f40c7a80 0x7f94f40c7f00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 --2- 172.21.15.152:0/3197123854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f94f40ada00 0x7f94f40ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 >> 172.21.15.152:0/3197123854 conn(0x7f94f40d0180 msgr2=0x7f94f40cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:47.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 shutdown_connections 2023-10-16T20:07:47.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.306+0000 7f94fc519700 1 -- 172.21.15.152:0/3197123854 wait complete. 2023-10-16T20:07:47.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T20:07:47.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.440+0000 7f223b5af700 1 Processor -- start 2023-10-16T20:07:47.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.440+0000 7f223b5af700 1 -- start start 2023-10-16T20:07:47.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223b5af700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223406a820 0x7f22340cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223b5af700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f223415e7f0 0x7f223406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223b5af700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22340ca7d0 0x7f2234071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223b5af700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22340ce410 con 0x7f22340ca7d0 2023-10-16T20:07:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223b5af700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22340cfeb0 con 0x7f223415e7f0 2023-10-16T20:07:47.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223b5af700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223415ec70 con 0x7f223406a820 2023-10-16T20:07:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22340ca7d0 0x7f2234071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22340ca7d0 0x7f2234071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60640/0 (socket says 172.21.15.152:60640) 2023-10-16T20:07:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 -- 172.21.15.152:0/3285210505 learned_addr learned my addr 172.21.15.152:0/3285210505 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2238b4a700 1 --2- 172.21.15.152:0/3285210505 >> v2:172.21.15.163:3300/0 conn(0x7f223415e7f0 0x7f223406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223934b700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223406a820 0x7f22340cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 -- 172.21.15.152:0/3285210505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223406a820 msgr2=0x7f22340cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223406a820 0x7f22340cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 -- 172.21.15.152:0/3285210505 >> v2:172.21.15.163:3300/0 conn(0x7f223415e7f0 msgr2=0x7f223406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 --2- 172.21.15.152:0/3285210505 >> v2:172.21.15.163:3300/0 conn(0x7f223415e7f0 0x7f223406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 -- 172.21.15.152:0/3285210505 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340af9d0 con 0x7f22340ca7d0 2023-10-16T20:07:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2238b4a700 1 --2- 172.21.15.152:0/3285210505 >> v2:172.21.15.163:3300/0 conn(0x7f223415e7f0 0x7f223406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f223934b700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223406a820 0x7f22340cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.441+0000 7f2239b4c700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22340ca7d0 0x7f2234071ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f22340b2c80 tx=0x7f222c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683a29a2641fe3a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f222bfff700 1 -- 172.21.15.152:0/3285210505 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00e070 con 0x7f22340ca7d0 2023-10-16T20:07:47.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f222bfff700 1 -- 172.21.15.152:0/3285210505 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c00b9c0 con 0x7f22340ca7d0 2023-10-16T20:07:47.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f222bfff700 1 -- 172.21.15.152:0/3285210505 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00bd70 con 0x7f22340ca7d0 2023-10-16T20:07:47.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 -- 172.21.15.152:0/3285210505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22340ca7d0 msgr2=0x7f2234071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22340ca7d0 0x7f2234071ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f22340b2c80 tx=0x7f222c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:47.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 -- 172.21.15.152:0/3285210505 shutdown_connections 2023-10-16T20:07:47.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f223406a820 0x7f22340cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 --2- 172.21.15.152:0/3285210505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22340ca7d0 0x7f2234071ea0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 --2- 172.21.15.152:0/3285210505 >> v2:172.21.15.163:3300/0 conn(0x7f223415e7f0 0x7f223406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 -- 172.21.15.152:0/3285210505 >> 172.21.15.152:0/3285210505 conn(0x7f22340d0180 msgr2=0x7f22340d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:47.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 -- 172.21.15.152:0/3285210505 shutdown_connections 2023-10-16T20:07:47.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.442+0000 7f223b5af700 1 -- 172.21.15.152:0/3285210505 wait complete. 2023-10-16T20:07:47.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.443+0000 7f223b5af700 1 Processor -- start 2023-10-16T20:07:47.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.443+0000 7f223b5af700 1 -- start start 2023-10-16T20:07:47.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223b5af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 0x7f223414d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223b5af700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22340ca7d0 0x7f223415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223b5af700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223415e7f0 0x7f223415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223b5af700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22340c78c0 con 0x7f223406a820 2023-10-16T20:07:47.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223b5af700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223415d2d0 con 0x7f223415e7f0 2023-10-16T20:07:47.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223b5af700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223415ca30 con 0x7f22340ca7d0 2023-10-16T20:07:47.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223934b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 0x7f223414d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223934b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 0x7f223414d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60642/0 (socket says 172.21.15.152:60642) 2023-10-16T20:07:47.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.444+0000 7f223934b700 1 -- 172.21.15.152:0/2308069859 learned_addr learned my addr 172.21.15.152:0/2308069859 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:47.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223934b700 1 -- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22340ca7d0 msgr2=0x7f223415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f2239b4c700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223415e7f0 0x7f223415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223934b700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22340ca7d0 0x7f223415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223934b700 1 -- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223415e7f0 msgr2=0x7f223415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223934b700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223415e7f0 0x7f223415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223934b700 1 -- 172.21.15.152:0/2308069859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c009b30 con 0x7f223406a820 2023-10-16T20:07:47.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223934b700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 0x7f223414d5f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f223000c750 tx=0x7f223000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230011800 con 0x7f223406a820 2023-10-16T20:07:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230011960 con 0x7f223406a820 2023-10-16T20:07:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230011cd0 con 0x7f223406a820 2023-10-16T20:07:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223415cd10 con 0x7f223406a820 2023-10-16T20:07:47.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.445+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22340c7af0 con 0x7f223406a820 2023-10-16T20:07:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.446+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22340c7d10 con 0x7f223406a820 2023-10-16T20:07:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.446+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2230021350 con 0x7f223406a820 2023-10-16T20:07:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.447+0000 7f2229ffb700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221806af30 0x7f221806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.447+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2230089360 con 0x7f223406a820 2023-10-16T20:07:47.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.447+0000 7f2238b4a700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221806af30 0x7f221806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.447+0000 7f2238b4a700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221806af30 0x7f221806d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2224006ba0 tx=0x7f2224008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.451+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2230054610 con 0x7f223406a820 2023-10-16T20:07:47.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.719+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f223404ebb0 con 0x7f223406a820 2023-10-16T20:07:47.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.724+0000 7f2229ffb700 1 -- 172.21.15.152:0/2308069859 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2230057c30 con 0x7f223406a820 2023-10-16T20:07:47.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221806af30 msgr2=0x7f221806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221806af30 0x7f221806d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2224006ba0 tx=0x7f2224008040 comp rx=0 tx=0).stop 2023-10-16T20:07:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 msgr2=0x7f223414d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 0x7f223414d5f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f223000c750 tx=0x7f223000cb10 comp rx=0 tx=0).stop 2023-10-16T20:07:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 shutdown_connections 2023-10-16T20:07:47.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f221806af30 0x7f221806d3f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f223415e7f0 0x7f223415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f223406a820 0x7f223414d5f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 --2- 172.21.15.152:0/2308069859 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f22340ca7d0 0x7f223415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 >> 172.21.15.152:0/2308069859 conn(0x7f22340d0180 msgr2=0x7f22340cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:47.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 shutdown_connections 2023-10-16T20:07:47.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.726+0000 7f223b5af700 1 -- 172.21.15.152:0/2308069859 wait complete. 2023-10-16T20:07:47.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T20:07:47.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.860+0000 7f0b6483b700 1 Processor -- start 2023-10-16T20:07:47.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.860+0000 7f0b6483b700 1 -- start start 2023-10-16T20:07:47.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b6483b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0b600cea80 0x7f0b6006e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b6483b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 0x7f0b6015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b6483b700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600cb3d0 con 0x7f0b6015e3e0 2023-10-16T20:07:47.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b6483b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6015e850 con 0x7f0b600cea80 2023-10-16T20:07:47.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b6483b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600cb6b0 con 0x7f0b600cab60 2023-10-16T20:07:47.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b5ed9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0b6015e3e0 0x7f0b60157510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40852/0 (socket says 172.21.15.152:40852) 2023-10-16T20:07:47.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.861+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2184948319 learned_addr learned my addr 172.21.15.152:0/2184948319 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:47.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5e59c700 1 --2- 172.21.15.152:0/2184948319 >> v2:172.21.15.163:3300/0 conn(0x7f0b600cea80 0x7f0b6006e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5dd9b700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 0x7f0b6015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963538327 0 0) 0x7f0b600cb3d0 con 0x7f0b6015e3e0 2023-10-16T20:07:47.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b480057c0 con 0x7f0b6015e3e0 2023-10-16T20:07:47.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276990874 0 0) 0x7f0b480057c0 con 0x7f0b6015e3e0 2023-10-16T20:07:47.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 msgr2=0x7f0b6015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 0x7f0b6015dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 >> v2:172.21.15.163:3300/0 conn(0x7f0b600cea80 msgr2=0x7f0b6006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 --2- 172.21.15.152:0/2184948319 >> v2:172.21.15.163:3300/0 conn(0x7f0b600cea80 0x7f0b6006e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600cb990 con 0x7f0b6015e3e0 2023-10-16T20:07:47.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f0b580019f0 con 0x7f0b6015e3e0 2023-10-16T20:07:47.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 >> v1:172.21.15.152:6789/0 conn(0x7f0b6015e3e0 legacy=0x7f0b60157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 0x7f0b48005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006190 0x7f0b48006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b48006fa0 0x7f0b48007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6015e850 con 0x7f0b48006fa0 2023-10-16T20:07:47.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600cb6b0 con 0x7f0b48006190 2023-10-16T20:07:47.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4800dc20 con 0x7f0b600cab60 2023-10-16T20:07:47.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b48006fa0 0x7f0b48007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5e59c700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 0x7f0b48005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5dd9b700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006190 0x7f0b48006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 msgr2=0x7f0b48005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600cab60 0x7f0b48005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006190 msgr2=0x7f0b48006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:47.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006190 0x7f0b48006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.872 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.862+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2184948319 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480057c0 con 0x7f0b48006fa0 2023-10-16T20:07:47.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b48006fa0 0x7f0b48007420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800a8d0 tx=0x7f0b48007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bceb95e329f0a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800a340 con 0x7f0b48006fa0 2023-10-16T20:07:47.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58012600 con 0x7f0b48006fa0 2023-10-16T20:07:47.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b5d59a700 1 -- 172.21.15.152:0/2184948319 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580129b0 con 0x7f0b48006fa0 2023-10-16T20:07:47.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b6483b700 1 -- 172.21.15.152:0/2184948319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b48006fa0 msgr2=0x7f0b48007420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2184948319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b48006fa0 0x7f0b48007420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800a8d0 tx=0x7f0b48007a90 comp rx=0 tx=0).stop 2023-10-16T20:07:47.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2184948319 reap_dead start 2023-10-16T20:07:47.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b6483b700 1 -- 172.21.15.152:0/2184948319 shutdown_connections 2023-10-16T20:07:47.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b6483b700 1 -- 172.21.15.152:0/2184948319 >> 172.21.15.152:0/2184948319 conn(0x7f0b600cfcd0 msgr2=0x7f0b600d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:47.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b6483b700 1 -- 172.21.15.152:0/2184948319 shutdown_connections 2023-10-16T20:07:47.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.863+0000 7f0b6483b700 1 -- 172.21.15.152:0/2184948319 wait complete. 2023-10-16T20:07:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.865+0000 7f0b6483b700 1 Processor -- start 2023-10-16T20:07:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.865+0000 7f0b6483b700 1 -- start start 2023-10-16T20:07:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b6483b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006fa0 0x7f0b600c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b6483b700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600c92f0 0x7f0b600c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b6483b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 0x7f0b601f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b6483b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600c4990 con 0x7f0b600c52f0 2023-10-16T20:07:47.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b6483b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600c3d10 con 0x7f0b48006fa0 2023-10-16T20:07:47.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b6483b700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600c3ff0 con 0x7f0b600c92f0 2023-10-16T20:07:47.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 0x7f0b601f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 0x7f0b601f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60666/0 (socket says 172.21.15.152:60666) 2023-10-16T20:07:47.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2627256000 learned_addr learned my addr 172.21.15.152:0/2627256000 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:47.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5e59c700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006fa0 0x7f0b600c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5dd9b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600c92f0 0x7f0b600c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600c92f0 msgr2=0x7f0b600c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600c92f0 0x7f0b600c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006fa0 msgr2=0x7f0b600c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:47.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006fa0 0x7f0b600c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:47.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5ed9d700 1 -- 172.21.15.152:0/2627256000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600c42d0 con 0x7f0b600c52f0 2023-10-16T20:07:47.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.866+0000 7f0b5e59c700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006fa0 0x7f0b600c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:47.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.867+0000 7f0b5ed9d700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 0x7f0b601f1a30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0b58015040 tx=0x7f0b58001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.867+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800a340 con 0x7f0b600c52f0 2023-10-16T20:07:47.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.867+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580019c0 con 0x7f0b600c52f0 2023-10-16T20:07:47.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.867+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b600c45b0 con 0x7f0b600c52f0 2023-10-16T20:07:47.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.867+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5801e600 con 0x7f0b600c52f0 2023-10-16T20:07:47.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.867+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b601f1f70 con 0x7f0b600c52f0 2023-10-16T20:07:47.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.868+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6004ebb0 con 0x7f0b600c52f0 2023-10-16T20:07:47.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.868+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b58019030 con 0x7f0b600c52f0 2023-10-16T20:07:47.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.869+0000 7f0b4effd700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b4006af00 0x7f0b4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:47.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.869+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0b5808b670 con 0x7f0b600c52f0 2023-10-16T20:07:47.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.869+0000 7f0b5e59c700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b4006af00 0x7f0b4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:47.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.869+0000 7f0b5e59c700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b4006af00 0x7f0b4006d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ce0 tx=0x7f0b54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:47.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:47.873+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b58056aa0 con 0x7f0b600c52f0 2023-10-16T20:07:48.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.142+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0b6006d540 con 0x7f0b600c52f0 2023-10-16T20:07:48.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.144+0000 7f0b4effd700 1 -- 172.21.15.152:0/2627256000 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0b580170a0 con 0x7f0b600c52f0 2023-10-16T20:07:48.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b4006af00 msgr2=0x7f0b4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b4006af00 0x7f0b4006d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ce0 tx=0x7f0b54008040 comp rx=0 tx=0).stop 2023-10-16T20:07:48.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 msgr2=0x7f0b601f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 0x7f0b601f1a30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0b58015040 tx=0x7f0b58001360 comp rx=0 tx=0).stop 2023-10-16T20:07:48.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 shutdown_connections 2023-10-16T20:07:48.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f0b4006af00 0x7f0b4006d3c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b600c52f0 0x7f0b601f1a30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b48006fa0 0x7f0b600c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 --2- 172.21.15.152:0/2627256000 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f0b600c92f0 0x7f0b600c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 >> 172.21.15.152:0/2627256000 conn(0x7f0b600cfcd0 msgr2=0x7f0b600cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 shutdown_connections 2023-10-16T20:07:48.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.147+0000 7f0b6483b700 1 -- 172.21.15.152:0/2627256000 wait complete. 2023-10-16T20:07:48.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T20:07:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.281+0000 7f6b16cd4700 1 Processor -- start 2023-10-16T20:07:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.281+0000 7f6b16cd4700 1 -- start start 2023-10-16T20:07:48.285 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b16cd4700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6b1006a820 0x7f6b100cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b16cd4700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6b1015e7f0 0x7f6b1006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b16cd4700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b100cfeb0 con 0x7f6b100ca7d0 2023-10-16T20:07:48.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b16cd4700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b100ce410 con 0x7f6b1015e7f0 2023-10-16T20:07:48.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b16cd4700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1015ec50 con 0x7f6b1006a820 2023-10-16T20:07:48.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0ffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6b1015e7f0 0x7f6b1006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b15271700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6b100ca7d0 0x7f6b10071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40872/0 (socket says 172.21.15.152:40872) 2023-10-16T20:07:48.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b15271700 1 -- 172.21.15.152:0/188222656 learned_addr learned my addr 172.21.15.152:0/188222656 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:48.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b14a70700 1 --2- 172.21.15.152:0/188222656 >> v2:172.21.15.163:3300/0 conn(0x7f6b1006a820 0x7f6b100cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0ffff700 1 -- 172.21.15.152:0/188222656 >> v2:172.21.15.163:3300/0 conn(0x7f6b1006a820 msgr2=0x7f6b100cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:48.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0ffff700 1 --2- 172.21.15.152:0/188222656 >> v2:172.21.15.163:3300/0 conn(0x7f6b1006a820 0x7f6b100cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0ffff700 1 -- 172.21.15.152:0/188222656 >> v1:172.21.15.152:6789/0 conn(0x7f6b100ca7d0 legacy=0x7f6b10071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0ffff700 1 -- 172.21.15.152:0/188222656 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100af9d0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0f7fe700 1 -- 172.21.15.152:0/188222656 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322733411 0 0) 0x7f6b100cfeb0 con 0x7f6b100ca7d0 2023-10-16T20:07:48.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0ffff700 1 --2- 172.21.15.152:0/188222656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b1006ac00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6b10067df0 tx=0x7f6afc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801d15ba6a88c4b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:48.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0f7fe700 1 -- 172.21.15.152:0/188222656 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc011830 con 0x7f6b1015e7f0 2023-10-16T20:07:48.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0f7fe700 1 -- 172.21.15.152:0/188222656 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc011990 con 0x7f6b1015e7f0 2023-10-16T20:07:48.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.282+0000 7f6b0f7fe700 1 -- 172.21.15.152:0/188222656 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc011d20 con 0x7f6b1015e7f0 2023-10-16T20:07:48.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 -- 172.21.15.152:0/188222656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 msgr2=0x7f6b1006ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.289 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/188222656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b1006ac00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6b10067df0 tx=0x7f6afc009b20 comp rx=0 tx=0).stop 2023-10-16T20:07:48.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 -- 172.21.15.152:0/188222656 shutdown_connections 2023-10-16T20:07:48.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/188222656 >> v2:172.21.15.163:3300/0 conn(0x7f6b1006a820 0x7f6b100cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/188222656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b1006ac00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 -- 172.21.15.152:0/188222656 >> 172.21.15.152:0/188222656 conn(0x7f6b100d0180 msgr2=0x7f6b100d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:48.290 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 -- 172.21.15.152:0/188222656 shutdown_connections 2023-10-16T20:07:48.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.283+0000 7f6b16cd4700 1 -- 172.21.15.152:0/188222656 wait complete. 2023-10-16T20:07:48.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.284+0000 7f6b16cd4700 1 Processor -- start 2023-10-16T20:07:48.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.284+0000 7f6b16cd4700 1 -- start start 2023-10-16T20:07:48.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b16cd4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b1006a820 0x7f6b1006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b16cd4700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b100ca7d0 0x7f6b1006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b16cd4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b101fb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b16cd4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1006d640 con 0x7f6b1015e7f0 2023-10-16T20:07:48.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b16cd4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b10158f50 con 0x7f6b1006a820 2023-10-16T20:07:48.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b16cd4700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b101fac30 con 0x7f6b100ca7d0 2023-10-16T20:07:48.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b15271700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b101fb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b15271700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b101fb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60680/0 (socket says 172.21.15.152:60680) 2023-10-16T20:07:48.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b15271700 1 -- 172.21.15.152:0/4027991233 learned_addr learned my addr 172.21.15.152:0/4027991233 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:48.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b14a70700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b1006a820 0x7f6b1006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.285+0000 7f6b0ffff700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b100ca7d0 0x7f6b1006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b15271700 1 -- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b100ca7d0 msgr2=0x7f6b1006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b15271700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b100ca7d0 0x7f6b1006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b15271700 1 -- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b1006a820 msgr2=0x7f6b1006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b15271700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b1006a820 0x7f6b1006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b15271700 1 -- 172.21.15.152:0/4027991233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0094a0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b0ffff700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b100ca7d0 0x7f6b1006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:48.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b15271700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b101fb3a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800cbf0 tx=0x7f6b0800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:48.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800ab50 con 0x7f6b1015e7f0 2023-10-16T20:07:48.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0800acd0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1006d870 con 0x7f6b1015e7f0 2023-10-16T20:07:48.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08007310 con 0x7f6b1015e7f0 2023-10-16T20:07:48.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.286+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1006de30 con 0x7f6b1015e7f0 2023-10-16T20:07:48.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.287+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1004ebb0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.287+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b08007470 con 0x7f6b1015e7f0 2023-10-16T20:07:48.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.288+0000 7f6b0d7fa700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6af406af00 0x7f6af406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.288+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6b080891e0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.288+0000 7f6b14a70700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6af406af00 0x7f6af406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.288+0000 7f6b14a70700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6af406af00 0x7f6af406d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b10160ae0 tx=0x7f6b04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:48.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.292+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b080544a0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.559+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6b1006e930 con 0x7f6b1015e7f0 2023-10-16T20:07:48.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.561+0000 7f6b0d7fa700 1 -- 172.21.15.152:0/4027991233 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6b08057ac0 con 0x7f6b1015e7f0 2023-10-16T20:07:48.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6af406af00 msgr2=0x7f6af406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6af406af00 0x7f6af406d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b10160ae0 tx=0x7f6b04008040 comp rx=0 tx=0).stop 2023-10-16T20:07:48.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 msgr2=0x7f6b101fb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b101fb3a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800cbf0 tx=0x7f6b0800cf00 comp rx=0 tx=0).stop 2023-10-16T20:07:48.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 shutdown_connections 2023-10-16T20:07:48.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6af406af00 0x7f6af406d3c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b1015e7f0 0x7f6b101fb3a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b1006a820 0x7f6b1006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 --2- 172.21.15.152:0/4027991233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b100ca7d0 0x7f6b1006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 >> 172.21.15.152:0/4027991233 conn(0x7f6b100d0180 msgr2=0x7f6b10071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:48.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 shutdown_connections 2023-10-16T20:07:48.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.563+0000 7f6b16cd4700 1 -- 172.21.15.152:0/4027991233 wait complete. 2023-10-16T20:07:48.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T20:07:48.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.697+0000 7efc55e76700 1 Processor -- start 2023-10-16T20:07:48.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.697+0000 7efc55e76700 1 -- start start 2023-10-16T20:07:48.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc55e76700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc500cd4b0 0x7efc5006e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc55e76700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efc5006bf80 0x7efc5015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc55e76700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5006e7d0 con 0x7efc50161ec0 2023-10-16T20:07:48.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc55e76700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5006ea50 con 0x7efc5006bf80 2023-10-16T20:07:48.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc55e76700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc501613e0 con 0x7efc500cd4b0 2023-10-16T20:07:48.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4ffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efc5006bf80 0x7efc5015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4effd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efc50161ec0 0x7efc500cd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40884/0 (socket says 172.21.15.152:40884) 2023-10-16T20:07:48.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4effd700 1 -- 172.21.15.152:0/1313598433 learned_addr learned my addr 172.21.15.152:0/1313598433 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:48.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4f7fe700 1 --2- 172.21.15.152:0/1313598433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc500cd4b0 0x7efc5006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4ffff700 1 -- 172.21.15.152:0/1313598433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc500cd4b0 msgr2=0x7efc5006e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:48.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4ffff700 1 --2- 172.21.15.152:0/1313598433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc500cd4b0 0x7efc5006e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4ffff700 1 -- 172.21.15.152:0/1313598433 >> v1:172.21.15.152:6789/0 conn(0x7efc50161ec0 legacy=0x7efc500cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4ffff700 1 -- 172.21.15.152:0/1313598433 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc501616c0 con 0x7efc5006bf80 2023-10-16T20:07:48.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4e7fc700 1 -- 172.21.15.152:0/1313598433 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534818801 0 0) 0x7efc5006e7d0 con 0x7efc50161ec0 2023-10-16T20:07:48.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.698+0000 7efc4ffff700 1 --2- 172.21.15.152:0/1313598433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc5015dc70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efc48009d90 tx=0x7efc4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffefc333ac5b10c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:48.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc4e7fc700 1 -- 172.21.15.152:0/1313598433 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800e070 con 0x7efc5006bf80 2023-10-16T20:07:48.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc4e7fc700 1 -- 172.21.15.152:0/1313598433 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800bbd0 con 0x7efc5006bf80 2023-10-16T20:07:48.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc4e7fc700 1 -- 172.21.15.152:0/1313598433 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48012430 con 0x7efc5006bf80 2023-10-16T20:07:48.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 -- 172.21.15.152:0/1313598433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 msgr2=0x7efc5015dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 --2- 172.21.15.152:0/1313598433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc5015dc70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efc48009d90 tx=0x7efc4800b330 comp rx=0 tx=0).stop 2023-10-16T20:07:48.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 -- 172.21.15.152:0/1313598433 shutdown_connections 2023-10-16T20:07:48.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 --2- 172.21.15.152:0/1313598433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc500cd4b0 0x7efc5006e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 --2- 172.21.15.152:0/1313598433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc5015dc70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 -- 172.21.15.152:0/1313598433 >> 172.21.15.152:0/1313598433 conn(0x7efc500cfcd0 msgr2=0x7efc500d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:48.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 -- 172.21.15.152:0/1313598433 shutdown_connections 2023-10-16T20:07:48.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.699+0000 7efc55e76700 1 -- 172.21.15.152:0/1313598433 wait complete. 2023-10-16T20:07:48.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.701+0000 7efc55e76700 1 Processor -- start 2023-10-16T20:07:48.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.701+0000 7efc55e76700 1 -- start start 2023-10-16T20:07:48.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc55e76700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc501f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc55e76700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc500cd4b0 0x7efc5006adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc55e76700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc50161ec0 0x7efc5006b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc55e76700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500c3520 con 0x7efc5006bf80 2023-10-16T20:07:48.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc55e76700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500c3800 con 0x7efc500cd4b0 2023-10-16T20:07:48.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc55e76700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500c3ae0 con 0x7efc50161ec0 2023-10-16T20:07:48.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc501f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc501f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60690/0 (socket says 172.21.15.152:60690) 2023-10-16T20:07:48.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 -- 172.21.15.152:0/3338324067 learned_addr learned my addr 172.21.15.152:0/3338324067 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:48.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4ffff700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc50161ec0 0x7efc5006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4effd700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc500cd4b0 0x7efc5006adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 -- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc50161ec0 msgr2=0x7efc5006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc50161ec0 0x7efc5006b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 -- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc500cd4b0 msgr2=0x7efc5006adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc500cd4b0 0x7efc5006adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 -- 172.21.15.152:0/3338324067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009a70 con 0x7efc5006bf80 2023-10-16T20:07:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4effd700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc500cd4b0 0x7efc5006adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.702+0000 7efc4f7fe700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc501f26d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efc4400e810 tx=0x7efc4400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.703+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44013610 con 0x7efc5006bf80 2023-10-16T20:07:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.703+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc44013770 con 0x7efc5006bf80 2023-10-16T20:07:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.703+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc501581a0 con 0x7efc5006bf80 2023-10-16T20:07:48.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.703+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44013b20 con 0x7efc5006bf80 2023-10-16T20:07:48.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.703+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5015f1d0 con 0x7efc5006bf80 2023-10-16T20:07:48.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.703+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc500c4130 con 0x7efc5006bf80 2023-10-16T20:07:48.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.704+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc44013c80 con 0x7efc5006bf80 2023-10-16T20:07:48.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.704+0000 7efc37fff700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efc3c06af00 0x7efc3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:48.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.705+0000 7efc4effd700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efc3c06af00 0x7efc3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:48.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.705+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7efc44088fd0 con 0x7efc5006bf80 2023-10-16T20:07:48.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.705+0000 7efc4effd700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efc3c06af00 0x7efc3c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc5015e100 tx=0x7efc40007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:48.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.709+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc440542a0 con 0x7efc5006bf80 2023-10-16T20:07:48.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.978+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efc500c3660 con 0x7efc5006bf80 2023-10-16T20:07:48.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.980+0000 7efc37fff700 1 -- 172.21.15.152:0/3338324067 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7efc500c3660 con 0x7efc5006bf80 2023-10-16T20:07:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efc3c06af00 msgr2=0x7efc3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efc3c06af00 0x7efc3c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc5015e100 tx=0x7efc40007d30 comp rx=0 tx=0).stop 2023-10-16T20:07:48.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 msgr2=0x7efc501f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc501f26d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efc4400e810 tx=0x7efc4400eb20 comp rx=0 tx=0).stop 2023-10-16T20:07:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 shutdown_connections 2023-10-16T20:07:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7efc3c06af00 0x7efc3c06d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7efc50161ec0 0x7efc5006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc5006bf80 0x7efc501f26d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 --2- 172.21.15.152:0/3338324067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc500cd4b0 0x7efc5006adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 >> 172.21.15.152:0/3338324067 conn(0x7efc500cfcd0 msgr2=0x7efc500adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 shutdown_connections 2023-10-16T20:07:48.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:48.983+0000 7efc55e76700 1 -- 172.21.15.152:0/3338324067 wait complete. 2023-10-16T20:07:48.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:49.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.116+0000 7f8534886700 1 Processor -- start 2023-10-16T20:07:49.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.116+0000 7f8534886700 1 -- start start 2023-10-16T20:07:49.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f8534886700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f85300b3410 0x7f85300cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f8534886700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f85300cb8d0 0x7f85300b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f8534886700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8530070d70 con 0x7f8530152470 2023-10-16T20:07:49.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f8534886700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8530071200 con 0x7f85300b3410 2023-10-16T20:07:49.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f8534886700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8530070440 con 0x7f85300cb8d0 2023-10-16T20:07:49.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f85300b3410 0x7f85300cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f85300b3410 0x7f85300cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60700/0 (socket says 172.21.15.152:60700) 2023-10-16T20:07:49.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 -- 172.21.15.152:0/22255909 learned_addr learned my addr 172.21.15.152:0/22255909 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:49.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852ed9d700 1 --2- 172.21.15.152:0/22255909 >> v2:172.21.15.163:3300/0 conn(0x7f85300cb8d0 0x7f85300b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 -- 172.21.15.152:0/22255909 >> v2:172.21.15.163:3300/0 conn(0x7f85300cb8d0 msgr2=0x7f85300b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:49.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 --2- 172.21.15.152:0/22255909 >> v2:172.21.15.163:3300/0 conn(0x7f85300cb8d0 0x7f85300b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 -- 172.21.15.152:0/22255909 >> v1:172.21.15.163:6789/0 conn(0x7f8530152470 legacy=0x7f85300b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 -- 172.21.15.152:0/22255909 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530070720 con 0x7f85300b3410 2023-10-16T20:07:49.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852ed9d700 1 --2- 172.21.15.152:0/22255909 >> v2:172.21.15.163:3300/0 conn(0x7f85300cb8d0 0x7f85300b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:49.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852dd9b700 1 --2- 172.21.15.152:0/22255909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300b3410 0x7f85300cd570 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8530072770 tx=0x7f8524009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceecf8d91401591 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852d59a700 1 -- 172.21.15.152:0/22255909 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852400b870 con 0x7f85300b3410 2023-10-16T20:07:49.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852d59a700 1 -- 172.21.15.152:0/22255909 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852400b9d0 con 0x7f85300b3410 2023-10-16T20:07:49.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.117+0000 7f852d59a700 1 -- 172.21.15.152:0/22255909 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852400bd60 con 0x7f85300b3410 2023-10-16T20:07:49.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 -- 172.21.15.152:0/22255909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300b3410 msgr2=0x7f85300cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 --2- 172.21.15.152:0/22255909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300b3410 0x7f85300cd570 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8530072770 tx=0x7f8524009bd0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 -- 172.21.15.152:0/22255909 shutdown_connections 2023-10-16T20:07:49.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 --2- 172.21.15.152:0/22255909 >> v2:172.21.15.163:3300/0 conn(0x7f85300cb8d0 0x7f85300b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 --2- 172.21.15.152:0/22255909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300b3410 0x7f85300cd570 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 -- 172.21.15.152:0/22255909 >> 172.21.15.152:0/22255909 conn(0x7f85300cdd00 msgr2=0x7f85300ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:49.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 -- 172.21.15.152:0/22255909 shutdown_connections 2023-10-16T20:07:49.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.118+0000 7f8534886700 1 -- 172.21.15.152:0/22255909 wait complete. 2023-10-16T20:07:49.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.119+0000 7f8534886700 1 Processor -- start 2023-10-16T20:07:49.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.119+0000 7f8534886700 1 -- start start 2023-10-16T20:07:49.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f8534886700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85300b3410 0x7f85301f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f8534886700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 0x7f8530155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f8534886700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8530152470 0x7f85300c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f8534886700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300c71f0 con 0x7f85300cb8d0 2023-10-16T20:07:49.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f8534886700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530155c80 con 0x7f8530152470 2023-10-16T20:07:49.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f8534886700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300c6340 con 0x7f85300b3410 2023-10-16T20:07:49.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f852dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 0x7f8530155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f852dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 0x7f8530155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60706/0 (socket says 172.21.15.152:60706) 2023-10-16T20:07:49.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f852dd9b700 1 -- 172.21.15.152:0/1149082044 learned_addr learned my addr 172.21.15.152:0/1149082044 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:49.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f852e59c700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85300b3410 0x7f85301f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.120+0000 7f852ed9d700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8530152470 0x7f85300c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f852dd9b700 1 -- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85300b3410 msgr2=0x7f85301f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f852dd9b700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85300b3410 0x7f85301f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f852dd9b700 1 -- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8530152470 msgr2=0x7f85300c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f852dd9b700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8530152470 0x7f85300c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f852dd9b700 1 -- 172.21.15.152:0/1149082044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524009550 con 0x7f85300cb8d0 2023-10-16T20:07:49.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f852dd9b700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 0x7f8530155740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8524000c00 tx=0x7f8524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524004540 con 0x7f85300cb8d0 2023-10-16T20:07:49.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85240036a0 con 0x7f85300cb8d0 2023-10-16T20:07:49.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300c65e0 con 0x7f85300cb8d0 2023-10-16T20:07:49.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524003a30 con 0x7f85300cb8d0 2023-10-16T20:07:49.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.121+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85300c6ba0 con 0x7f85300cb8d0 2023-10-16T20:07:49.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.122+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8530152850 con 0x7f85300cb8d0 2023-10-16T20:07:49.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.122+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8524021070 con 0x7f85300cb8d0 2023-10-16T20:07:49.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.123+0000 7f851effd700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f851006af00 0x7f851006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.123+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f852408ab50 con 0x7f85300cb8d0 2023-10-16T20:07:49.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.123+0000 7f852e59c700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f851006af00 0x7f851006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.123+0000 7f852e59c700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f851006af00 0x7f851006d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85300ca5e0 tx=0x7f8520009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.127+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8524055e20 con 0x7f85300cb8d0 2023-10-16T20:07:49.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.317+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f853004ebb0 con 0x7f85300cb8d0 2023-10-16T20:07:49.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.318+0000 7f851effd700 1 -- 172.21.15.152:0/1149082044 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13098 (secure 0 0 0) 0x7f8524059440 con 0x7f85300cb8d0 2023-10-16T20:07:49.320 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":37,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:45.995042+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:49.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f851006af00 msgr2=0x7f851006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f851006af00 0x7f851006d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85300ca5e0 tx=0x7f8520009040 comp rx=0 tx=0).stop 2023-10-16T20:07:49.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 msgr2=0x7f8530155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 0x7f8530155740 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8524000c00 tx=0x7f8524004750 comp rx=0 tx=0).stop 2023-10-16T20:07:49.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 shutdown_connections 2023-10-16T20:07:49.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f851006af00 0x7f851006d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f85300b3410 0x7f85301f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8530152470 0x7f85300c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 --2- 172.21.15.152:0/1149082044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85300cb8d0 0x7f8530155740 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 >> 172.21.15.152:0/1149082044 conn(0x7f85300cdd00 msgr2=0x7f85300d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:49.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 shutdown_connections 2023-10-16T20:07:49.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.320+0000 7f8534886700 1 -- 172.21.15.152:0/1149082044 wait complete. 2023-10-16T20:07:49.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T20:06:18.806968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T20:07:49.335 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T20:07:49.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.457+0000 7f70315a0700 1 Processor -- start 2023-10-16T20:07:49.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.457+0000 7f70315a0700 1 -- start start 2023-10-16T20:07:49.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f70315a0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f70315a0700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f702c0b3430 0x7f702c161250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f70315a0700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0d17a0 con 0x7f702c0cf6d0 2023-10-16T20:07:49.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f70315a0700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c0d0ee0 con 0x7f702c0b3430 2023-10-16T20:07:49.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f70315a0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0d1150 con 0x7f702c0cf2f0 2023-10-16T20:07:49.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f702c0b3430 0x7f702c161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f702c0b3430 0x7f702c161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60716/0 (socket says 172.21.15.152:60716) 2023-10-16T20:07:49.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 -- 172.21.15.152:0/1849557038 learned_addr learned my addr 172.21.15.152:0/1849557038 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:49.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702affd700 1 --2- 172.21.15.152:0/1849557038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 -- 172.21.15.152:0/1849557038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 msgr2=0x7f702c0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:49.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 --2- 172.21.15.152:0/1849557038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 -- 172.21.15.152:0/1849557038 >> v1:172.21.15.163:6789/0 conn(0x7f702c0cf6d0 legacy=0x7f702c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 -- 172.21.15.152:0/1849557038 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0d1430 con 0x7f702c0b3430 2023-10-16T20:07:49.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f702b7fe700 1 --2- 172.21.15.152:0/1849557038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c161250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7024009e80 tx=0x7f702400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2c33661917d0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f7029ffb700 1 -- 172.21.15.152:0/1849557038 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400e070 con 0x7f702c0b3430 2023-10-16T20:07:49.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f7029ffb700 1 -- 172.21.15.152:0/1849557038 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400b980 con 0x7f702c0b3430 2023-10-16T20:07:49.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.458+0000 7f7029ffb700 1 -- 172.21.15.152:0/1849557038 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400bd30 con 0x7f702c0b3430 2023-10-16T20:07:49.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 -- 172.21.15.152:0/1849557038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 msgr2=0x7f702c161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 --2- 172.21.15.152:0/1849557038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c161250 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7024009e80 tx=0x7f702400b330 comp rx=0 tx=0).stop 2023-10-16T20:07:49.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 -- 172.21.15.152:0/1849557038 shutdown_connections 2023-10-16T20:07:49.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 --2- 172.21.15.152:0/1849557038 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 --2- 172.21.15.152:0/1849557038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c161250 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 -- 172.21.15.152:0/1849557038 >> 172.21.15.152:0/1849557038 conn(0x7f702c06a820 msgr2=0x7f702c06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:49.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 -- 172.21.15.152:0/1849557038 shutdown_connections 2023-10-16T20:07:49.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.459+0000 7f70315a0700 1 -- 172.21.15.152:0/1849557038 wait complete. 2023-10-16T20:07:49.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.460+0000 7f70315a0700 1 Processor -- start 2023-10-16T20:07:49.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.460+0000 7f70315a0700 1 -- start start 2023-10-16T20:07:49.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f70315a0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f70315a0700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c1f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f70315a0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f702c15cc70 0x7f702c1f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f70315a0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0c7f70 con 0x7f702c0b3430 2023-10-16T20:07:49.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f70315a0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0ad2d0 con 0x7f702c15cc70 2023-10-16T20:07:49.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f70315a0700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0ad520 con 0x7f702c0cf2f0 2023-10-16T20:07:49.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c0c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60718/0 (socket says 172.21.15.152:60718) 2023-10-16T20:07:49.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 -- 172.21.15.152:0/2671087662 learned_addr learned my addr 172.21.15.152:0/2671087662 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:49.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702b7fe700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f702c15cc70 0x7f702c1f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 -- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 msgr2=0x7f702c1f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702a7fc700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c1f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c1f6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 -- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f702c15cc70 msgr2=0x7f702c1f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f702c15cc70 0x7f702c1f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702affd700 1 -- 172.21.15.152:0/2671087662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009b30 con 0x7f702c0b3430 2023-10-16T20:07:49.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.461+0000 7f702b7fe700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f702c15cc70 0x7f702c1f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:49.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.462+0000 7f702affd700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c0c7a30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f701c00e840 tx=0x7f701c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.462+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c013610 con 0x7f702c0b3430 2023-10-16T20:07:49.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.462+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c013770 con 0x7f702c0b3430 2023-10-16T20:07:49.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.462+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c0ad800 con 0x7f702c0b3430 2023-10-16T20:07:49.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.462+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c013b20 con 0x7f702c0b3430 2023-10-16T20:07:49.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.462+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c0addc0 con 0x7f702c0b3430 2023-10-16T20:07:49.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.463+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c04ebb0 con 0x7f702c0b3430 2023-10-16T20:07:49.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.463+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f701c013c80 con 0x7f702c0b3430 2023-10-16T20:07:49.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.464+0000 7f70137fe700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f701806af00 0x7f701806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.464+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f701c088fe0 con 0x7f702c0b3430 2023-10-16T20:07:49.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.464+0000 7f702a7fc700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f701806af00 0x7f701806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.464+0000 7f702a7fc700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f701806af00 0x7f701806d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7020000f60 tx=0x7f7020009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.468+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f701c054330 con 0x7f702c0b3430 2023-10-16T20:07:49.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.656+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f702c0b7200 con 0x7f702c0b3430 2023-10-16T20:07:49.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.657+0000 7f70137fe700 1 -- 172.21.15.152:0/2671087662 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f701c057950 con 0x7f702c0b3430 2023-10-16T20:07:49.659 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-10-16T20:07:49.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f701806af00 msgr2=0x7f701806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f701806af00 0x7f701806d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7020000f60 tx=0x7f7020009040 comp rx=0 tx=0).stop 2023-10-16T20:07:49.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 msgr2=0x7f702c0c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c0c7a30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f701c00e840 tx=0x7f701c00ec00 comp rx=0 tx=0).stop 2023-10-16T20:07:49.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 shutdown_connections 2023-10-16T20:07:49.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f701806af00 0x7f701806d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f702c15cc70 0x7f702c1f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f702c0b3430 0x7f702c0c7a30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 --2- 172.21.15.152:0/2671087662 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f702c0cf2f0 0x7f702c1f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 >> 172.21.15.152:0/2671087662 conn(0x7f702c06a820 msgr2=0x7f702c0cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:49.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 shutdown_connections 2023-10-16T20:07:49.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.659+0000 7f70315a0700 1 -- 172.21.15.152:0/2671087662 wait complete. 2023-10-16T20:07:49.673 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T20:07:49.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.791+0000 7f9a2acfd700 1 Processor -- start 2023-10-16T20:07:49.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.791+0000 7f9a2acfd700 1 -- start start 2023-10-16T20:07:49.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a2acfd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9a240b3410 0x7f9a240cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a2acfd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a24070d70 con 0x7f9a240cb8d0 2023-10-16T20:07:49.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a2acfd700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2415c990 con 0x7f9a24152470 2023-10-16T20:07:49.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a2acfd700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a24071200 con 0x7f9a240b3410 2023-10-16T20:07:49.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a2929a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9a240cb8d0 0x7f9a240b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40928/0 (socket says 172.21.15.152:40928) 2023-10-16T20:07:49.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a2929a700 1 -- 172.21.15.152:0/3670486697 learned_addr learned my addr 172.21.15.152:0/3670486697 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:49.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630687149 0 0) 0x7f9a24070d70 con 0x7f9a240cb8d0 2023-10-16T20:07:49.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a23fff700 1 --2- 172.21.15.152:0/3670486697 >> v2:172.21.15.163:3300/0 conn(0x7f9a240b3410 0x7f9a240cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.792+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a140035b0 con 0x7f9a240cb8d0 2023-10-16T20:07:49.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4228563373 0 0) 0x7f9a140035b0 con 0x7f9a240cb8d0 2023-10-16T20:07:49.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 >> v2:172.21.15.163:3300/0 conn(0x7f9a240b3410 msgr2=0x7f9a240cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:49.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 --2- 172.21.15.152:0/3670486697 >> v2:172.21.15.163:3300/0 conn(0x7f9a240b3410 0x7f9a240cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 >> v1:172.21.15.163:6789/0 conn(0x7f9a24152470 legacy=0x7f9a240b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24070440 con 0x7f9a240cb8d0 2023-10-16T20:07:49.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f9a1c0019f0 con 0x7f9a240cb8d0 2023-10-16T20:07:49.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 >> v1:172.21.15.152:6789/0 conn(0x7f9a240cb8d0 legacy=0x7f9a240b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a14003a00 0x7f9a14003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a14004850 0x7f9a14004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a1400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a24071200 con 0x7f9a14005210 2023-10-16T20:07:49.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1400c160 con 0x7f9a14004850 2023-10-16T20:07:49.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1400c320 con 0x7f9a14003a00 2023-10-16T20:07:49.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a1400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a23fff700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a14004850 0x7f9a14004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a28a99700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a14003a00 0x7f9a14003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 -- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a14003a00 msgr2=0x7f9a14003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:49.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a14003a00 0x7f9a14003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 -- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a14004850 msgr2=0x7f9a14004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:49.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a14004850 0x7f9a14004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 -- 172.21.15.152:0/3670486697 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140035b0 con 0x7f9a14005210 2023-10-16T20:07:49.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 -- 172.21.15.152:0/3670486697 reap_dead start 2023-10-16T20:07:49.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.793+0000 7f9a2929a700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a1400ba10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00a840 tx=0x7f9a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb50d36881c16b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c012600 con 0x7f9a14005210 2023-10-16T20:07:49.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c012760 con 0x7f9a14005210 2023-10-16T20:07:49.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a237fe700 1 -- 172.21.15.152:0/3670486697 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c012af0 con 0x7f9a14005210 2023-10-16T20:07:49.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 -- 172.21.15.152:0/3670486697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 msgr2=0x7f9a1400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a1400ba10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00a840 tx=0x7f9a14005880 comp rx=0 tx=0).stop 2023-10-16T20:07:49.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 -- 172.21.15.152:0/3670486697 shutdown_connections 2023-10-16T20:07:49.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/3670486697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a1400ba10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 -- 172.21.15.152:0/3670486697 >> 172.21.15.152:0/3670486697 conn(0x7f9a240cdd00 msgr2=0x7f9a240ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:49.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 -- 172.21.15.152:0/3670486697 shutdown_connections 2023-10-16T20:07:49.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.794+0000 7f9a2acfd700 1 -- 172.21.15.152:0/3670486697 wait complete. 2023-10-16T20:07:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.795+0000 7f9a2acfd700 1 Processor -- start 2023-10-16T20:07:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.795+0000 7f9a2acfd700 1 -- start start 2023-10-16T20:07:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a2acfd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a240c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a2acfd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a240b6df0 0x7f9a2414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a2acfd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a2415dd80 0x7f9a2415e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a2acfd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240c9700 con 0x7f9a14005210 2023-10-16T20:07:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a2acfd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415e740 con 0x7f9a240b6df0 2023-10-16T20:07:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a2acfd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240b6600 con 0x7f9a2415dd80 2023-10-16T20:07:49.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a28a99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a240c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a28a99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a240c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60738/0 (socket says 172.21.15.152:60738) 2023-10-16T20:07:49.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a28a99700 1 -- 172.21.15.152:0/594524438 learned_addr learned my addr 172.21.15.152:0/594524438 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:49.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.796+0000 7f9a23fff700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a240b6df0 0x7f9a2414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a2929a700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a2415dd80 0x7f9a2415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a28a99700 1 -- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a2415dd80 msgr2=0x7f9a2415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a28a99700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a2415dd80 0x7f9a2415e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a28a99700 1 -- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a240b6df0 msgr2=0x7f9a2414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a28a99700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a240b6df0 0x7f9a2414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:49.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a28a99700 1 -- 172.21.15.152:0/594524438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240c7660 con 0x7f9a14005210 2023-10-16T20:07:49.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a23fff700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a240b6df0 0x7f9a2414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:49.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a28a99700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a240c6f60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800e830 tx=0x7f9a1800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180052e0 con 0x7f9a14005210 2023-10-16T20:07:49.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18005440 con 0x7f9a14005210 2023-10-16T20:07:49.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a240c8d60 con 0x7f9a14005210 2023-10-16T20:07:49.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180038c0 con 0x7f9a14005210 2023-10-16T20:07:49.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.797+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a240c9320 con 0x7f9a14005210 2023-10-16T20:07:49.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.798+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a240c9840 con 0x7f9a14005210 2023-10-16T20:07:49.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.798+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a18003a20 con 0x7f9a14005210 2023-10-16T20:07:49.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.799+0000 7f9a217fa700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9a0806af00 0x7f9a0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:49.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.799+0000 7f9a23fff700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9a0806af00 0x7f9a0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:49.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.799+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9a18088fe0 con 0x7f9a14005210 2023-10-16T20:07:49.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.799+0000 7f9a23fff700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9a0806af00 0x7f9a0806d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a240b1f30 tx=0x7f9a10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:49.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.803+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a240c9840 con 0x7f9a14005210 2023-10-16T20:07:49.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.993+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9a240c9840 con 0x7f9a14005210 2023-10-16T20:07:49.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.994+0000 7f9a217fa700 1 -- 172.21.15.152:0/594524438 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9a18057dc0 con 0x7f9a14005210 2023-10-16T20:07:49.996 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:49.997 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2023-10-16T20:07:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2023-10-16T20:07:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2023-10-16T20:07:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2023-10-16T20:07:49.997 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-10-16T20:07:49.998 INFO:teuthology.orchestra.run.smithi152.stdout:] 2023-10-16T20:07:49.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9a0806af00 msgr2=0x7f9a0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9a0806af00 0x7f9a0806d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9a240b1f30 tx=0x7f9a10008040 comp rx=0 tx=0).stop 2023-10-16T20:07:49.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 msgr2=0x7f9a240c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:49.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a240c6f60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800e830 tx=0x7f9a1800ebf0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 shutdown_connections 2023-10-16T20:07:50.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9a0806af00 0x7f9a0806d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9a2415dd80 0x7f9a2415e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a14005210 0x7f9a240c6f60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 --2- 172.21.15.152:0/594524438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a240b6df0 0x7f9a2414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.000 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 >> 172.21.15.152:0/594524438 conn(0x7f9a240cdd00 msgr2=0x7f9a240b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:50.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 shutdown_connections 2023-10-16T20:07:50.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:49.996+0000 7f9a2acfd700 1 -- 172.21.15.152:0/594524438 wait complete. 2023-10-16T20:07:50.010 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-16T20:07:50.011 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-16T20:07:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.134+0000 7f7c54c85700 1 Processor -- start 2023-10-16T20:07:50.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.134+0000 7f7c54c85700 1 -- start start 2023-10-16T20:07:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c54c85700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7c500b9060 0x7f7c500ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c54c85700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500ce5e0 con 0x7f7c5015d760 2023-10-16T20:07:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c54c85700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500cf420 con 0x7f7c5006b7e0 2023-10-16T20:07:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c54c85700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c500b94c0 con 0x7f7c500b9060 2023-10-16T20:07:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4e59c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7c5015d760 0x7f7c500cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40944/0 (socket says 172.21.15.152:40944) 2023-10-16T20:07:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4e59c700 1 -- 172.21.15.152:0/1285222401 learned_addr learned my addr 172.21.15.152:0/1285222401 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:50.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4dd9b700 1 --2- 172.21.15.152:0/1285222401 >> v2:172.21.15.163:3300/0 conn(0x7f7c500b9060 0x7f7c500ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060835433 0 0) 0x7f7c500ce5e0 con 0x7f7c5015d760 2023-10-16T20:07:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c3c0035b0 con 0x7f7c5015d760 2023-10-16T20:07:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1123309774 0 0) 0x7f7c3c0035b0 con 0x7f7c5015d760 2023-10-16T20:07:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 >> v2:172.21.15.163:3300/0 conn(0x7f7c500b9060 msgr2=0x7f7c500ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:50.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 --2- 172.21.15.152:0/1285222401 >> v2:172.21.15.163:3300/0 conn(0x7f7c500b9060 0x7f7c500ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 >> v1:172.21.15.163:6789/0 conn(0x7f7c5006b7e0 legacy=0x7f7c500b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500ce810 con 0x7f7c5015d760 2023-10-16T20:07:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f7c400019f0 con 0x7f7c5015d760 2023-10-16T20:07:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 >> v1:172.21.15.152:6789/0 conn(0x7f7c5015d760 legacy=0x7f7c500cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:50.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c3c003a00 0x7f7c3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c004400 0x7f7c3c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c3c0050d0 0x7f7c3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500b94c0 con 0x7f7c3c003a00 2023-10-16T20:07:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c00bf80 con 0x7f7c3c004400 2023-10-16T20:07:50.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c00c140 con 0x7f7c3c0050d0 2023-10-16T20:07:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c3c003a00 0x7f7c3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.135+0000 7f7c4dd9b700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c004400 0x7f7c3c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4ed9d700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c3c0050d0 0x7f7c3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4e59c700 1 -- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c3c0050d0 msgr2=0x7f7c3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:50.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c3c0050d0 0x7f7c3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4e59c700 1 -- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c004400 msgr2=0x7f7c3c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:50.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c004400 0x7f7c3c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4ed9d700 1 -- 172.21.15.152:0/1285222401 reap_dead start 2023-10-16T20:07:50.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4e59c700 1 -- 172.21.15.152:0/1285222401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0035b0 con 0x7f7c3c003a00 2023-10-16T20:07:50.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c3c003a00 0x7f7c3c003de0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000a840 tx=0x7f7c3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d5a12a8b3d14b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:50.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40012600 con 0x7f7c3c003a00 2023-10-16T20:07:50.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40012760 con 0x7f7c3c003a00 2023-10-16T20:07:50.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c4d59a700 1 -- 172.21.15.152:0/1285222401 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40012af0 con 0x7f7c3c003a00 2023-10-16T20:07:50.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c54c85700 1 -- 172.21.15.152:0/1285222401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c3c003a00 msgr2=0x7f7c3c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:50.146 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.136+0000 7f7c54c85700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c3c003a00 0x7f7c3c003de0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000a840 tx=0x7f7c3c005880 comp rx=0 tx=0).stop 2023-10-16T20:07:50.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.137+0000 7f7c54c85700 1 -- 172.21.15.152:0/1285222401 shutdown_connections 2023-10-16T20:07:50.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.137+0000 7f7c54c85700 1 --2- 172.21.15.152:0/1285222401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c3c003a00 0x7f7c3c003de0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.137+0000 7f7c54c85700 1 -- 172.21.15.152:0/1285222401 >> 172.21.15.152:0/1285222401 conn(0x7f7c50072340 msgr2=0x7f7c50072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:50.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.137+0000 7f7c54c85700 1 -- 172.21.15.152:0/1285222401 shutdown_connections 2023-10-16T20:07:50.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.137+0000 7f7c54c85700 1 -- 172.21.15.152:0/1285222401 wait complete. 2023-10-16T20:07:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.138+0000 7f7c54c85700 1 Processor -- start 2023-10-16T20:07:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.138+0000 7f7c54c85700 1 -- start start 2023-10-16T20:07:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c54c85700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c003a00 0x7f7c5015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c54c85700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c500b8090 0x7f7c50149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c54c85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 0x7f7c500c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c54c85700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50149e90 con 0x7f7c500cd100 2023-10-16T20:07:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c54c85700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5014a2a0 con 0x7f7c3c003a00 2023-10-16T20:07:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c54c85700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5014a540 con 0x7f7c500b8090 2023-10-16T20:07:50.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 0x7f7c500c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 0x7f7c500c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60762/0 (socket says 172.21.15.152:60762) 2023-10-16T20:07:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 -- 172.21.15.152:0/4055884830 learned_addr learned my addr 172.21.15.152:0/4055884830 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4dd9b700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c500b8090 0x7f7c50149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c003a00 0x7f7c5015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 -- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c500b8090 msgr2=0x7f7c50149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c500b8090 0x7f7c50149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 -- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c003a00 msgr2=0x7f7c5015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:50.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c003a00 0x7f7c5015db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 -- 172.21.15.152:0/4055884830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5014a820 con 0x7f7c500cd100 2023-10-16T20:07:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c4ed9d700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 0x7f7c500c7080 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7c5008c6a0 tx=0x7f7c4800e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800eeb0 con 0x7f7c500cd100 2023-10-16T20:07:50.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.139+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480050d0 con 0x7f7c500cd100 2023-10-16T20:07:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.140+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5014ab00 con 0x7f7c500cd100 2023-10-16T20:07:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.140+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48005480 con 0x7f7c500cd100 2023-10-16T20:07:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.140+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c500cd580 con 0x7f7c500cd100 2023-10-16T20:07:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.141+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c500cd7a0 con 0x7f7c500cd100 2023-10-16T20:07:50.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.141+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c48003680 con 0x7f7c500cd100 2023-10-16T20:07:50.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.141+0000 7f7c46ffd700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3006af00 0x7f7c3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:50.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.141+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7c48088800 con 0x7f7c500cd100 2023-10-16T20:07:50.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.141+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3006af00 0x7f7c3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:50.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.142+0000 7f7c4e59c700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3006af00 0x7f7c3006d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c40000f80 tx=0x7f7c40010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:50.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.146+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c48053b50 con 0x7f7c500cd100 2023-10-16T20:07:50.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:50.340+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7c5004ebb0 con 0x7f7c500cd100 2023-10-16T20:07:51.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.012+0000 7f7c46ffd700 1 -- 172.21.15.152:0/4055884830 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v38) v1 ==== 148+0+0 (secure 0 0 0) 0x7f7c48019020 con 0x7f7c500cd100 2023-10-16T20:07:51.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.015+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3006af00 msgr2=0x7f7c3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:51.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.015+0000 7f7c54c85700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3006af00 0x7f7c3006d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c40000f80 tx=0x7f7c40010000 comp rx=0 tx=0).stop 2023-10-16T20:07:51.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.015+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 msgr2=0x7f7c500c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:51.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.015+0000 7f7c54c85700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 0x7f7c500c7080 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7c5008c6a0 tx=0x7f7c4800e6e0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 shutdown_connections 2023-10-16T20:07:51.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c3006af00 0x7f7c3006d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c500cd100 0x7f7c500c7080 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c3c003a00 0x7f7c5015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 --2- 172.21.15.152:0/4055884830 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c500b8090 0x7f7c50149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 >> 172.21.15.152:0/4055884830 conn(0x7f7c50072340 msgr2=0x7f7c5015c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:51.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.016+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 shutdown_connections 2023-10-16T20:07:51.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.017+0000 7f7c54c85700 1 -- 172.21.15.152:0/4055884830 wait complete. 2023-10-16T20:07:51.025 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'testcephfs1_metadata' created 2023-10-16T20:07:51.036 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T20:07:51.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.167+0000 7ff5b79dd700 1 Processor -- start 2023-10-16T20:07:51.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.167+0000 7ff5b79dd700 1 -- start start 2023-10-16T20:07:51.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b79dd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff5b00cd540 0x7ff5b015da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:51.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b79dd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5b0146490 0x7ff5b0146900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b79dd700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b015df70 con 0x7ff5b00cd920 2023-10-16T20:07:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b79dd700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b006bc80 con 0x7ff5b0146490 2023-10-16T20:07:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b79dd700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b006b070 con 0x7ff5b00cd540 2023-10-16T20:07:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5b0146490 0x7ff5b0146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:51.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff5b0146490 0x7ff5b0146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60770/0 (socket says 172.21.15.152:60770) 2023-10-16T20:07:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 -- 172.21.15.152:0/2463156700 learned_addr learned my addr 172.21.15.152:0/2463156700 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5779700 1 --2- 172.21.15.152:0/2463156700 >> v2:172.21.15.163:3300/0 conn(0x7ff5b00cd540 0x7ff5b015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 -- 172.21.15.152:0/2463156700 >> v2:172.21.15.163:3300/0 conn(0x7ff5b00cd540 msgr2=0x7ff5b015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 --2- 172.21.15.152:0/2463156700 >> v2:172.21.15.163:3300/0 conn(0x7ff5b00cd540 0x7ff5b015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 -- 172.21.15.152:0/2463156700 >> v1:172.21.15.163:6789/0 conn(0x7ff5b00cd920 legacy=0x7ff5b006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 -- 172.21.15.152:0/2463156700 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b006b350 con 0x7ff5b0146490 2023-10-16T20:07:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5b5f7a700 1 --2- 172.21.15.152:0/2463156700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b0146490 0x7ff5b0146900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006c380 tx=0x7ff5a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a94653d1eb62662 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.168+0000 7ff5a7fff700 1 -- 172.21.15.152:0/2463156700 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800e070 con 0x7ff5b0146490 2023-10-16T20:07:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5a7fff700 1 -- 172.21.15.152:0/2463156700 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a800b9c0 con 0x7ff5b0146490 2023-10-16T20:07:51.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5a7fff700 1 -- 172.21.15.152:0/2463156700 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800bd70 con 0x7ff5b0146490 2023-10-16T20:07:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 -- 172.21.15.152:0/2463156700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b0146490 msgr2=0x7ff5b0146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/2463156700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b0146490 0x7ff5b0146900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006c380 tx=0x7ff5a800b330 comp rx=0 tx=0).stop 2023-10-16T20:07:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 -- 172.21.15.152:0/2463156700 shutdown_connections 2023-10-16T20:07:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/2463156700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b0146490 0x7ff5b0146900 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/2463156700 >> v2:172.21.15.163:3300/0 conn(0x7ff5b00cd540 0x7ff5b015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 -- 172.21.15.152:0/2463156700 >> 172.21.15.152:0/2463156700 conn(0x7ff5b00b1460 msgr2=0x7ff5b00b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 -- 172.21.15.152:0/2463156700 shutdown_connections 2023-10-16T20:07:51.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.169+0000 7ff5b79dd700 1 -- 172.21.15.152:0/2463156700 wait complete. 2023-10-16T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.170+0000 7ff5b79dd700 1 Processor -- start 2023-10-16T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.170+0000 7ff5b79dd700 1 -- start start 2023-10-16T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b79dd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 0x7ff5b00c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b79dd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cd920 0x7ff5b0155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b79dd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b0146490 0x7ff5b01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b79dd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00c63c0 con 0x7ff5b00cd540 2023-10-16T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b79dd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00b0630 con 0x7ff5b0146490 2023-10-16T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b79dd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00b0910 con 0x7ff5b00cd920 2023-10-16T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 0x7ff5b00c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 0x7ff5b00c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60772/0 (socket says 172.21.15.152:60772) 2023-10-16T20:07:51.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 -- 172.21.15.152:0/1259015919 learned_addr learned my addr 172.21.15.152:0/1259015919 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:51.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b4f78700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cd920 0x7ff5b0155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:51.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5f7a700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b0146490 0x7ff5b01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:51.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 -- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cd920 msgr2=0x7ff5b0155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:51.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cd920 0x7ff5b0155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 -- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b0146490 msgr2=0x7ff5b01532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:51.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b0146490 0x7ff5b01532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:51.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.171+0000 7ff5b5779700 1 -- 172.21.15.152:0/1259015919 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009b30 con 0x7ff5b00cd540 2023-10-16T20:07:51.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.172+0000 7ff5b5779700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 0x7ff5b00c5e80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000e810 tx=0x7ff5a000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:51.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.172+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000c070 con 0x7ff5b00cd540 2023-10-16T20:07:51.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.172+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0013610 con 0x7ff5b00cd540 2023-10-16T20:07:51.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.172+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b00b0bf0 con 0x7ff5b00cd540 2023-10-16T20:07:51.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.172+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00139c0 con 0x7ff5b00cd540 2023-10-16T20:07:51.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.172+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b0157280 con 0x7ff5b00cd540 2023-10-16T20:07:51.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.173+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b006e8e0 con 0x7ff5b00cd540 2023-10-16T20:07:51.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.173+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff5a0013b20 con 0x7ff5b00cd540 2023-10-16T20:07:51.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.174+0000 7ff5a5ffb700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff59406af00 0x7ff59406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:51.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.174+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5552+0+0 (secure 0 0 0) 0x7ff5a0089240 con 0x7ff5b00cd540 2023-10-16T20:07:51.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.174+0000 7ff5b4f78700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff59406af00 0x7ff59406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:51.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.174+0000 7ff5b4f78700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff59406af00 0x7ff59406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00ce5e0 tx=0x7ff5ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:51.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.178+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5a00543a0 con 0x7ff5b00cd540 2023-10-16T20:07:51.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:51.368+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff5b004ebb0 con 0x7ff5b00cd540 2023-10-16T20:07:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.017+0000 7ff5a5ffb700 1 -- 172.21.15.152:0/1259015919 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v39) v1 ==== 180+0+0 (secure 0 0 0) 0x7ff5a00579c0 con 0x7ff5b00cd540 2023-10-16T20:07:52.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff59406af00 msgr2=0x7ff59406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:52.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff59406af00 0x7ff59406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00ce5e0 tx=0x7ff5ac009040 comp rx=0 tx=0).stop 2023-10-16T20:07:52.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 msgr2=0x7ff5b00c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:52.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 0x7ff5b00c5e80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000e810 tx=0x7ff5a000eb20 comp rx=0 tx=0).stop 2023-10-16T20:07:52.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 shutdown_connections 2023-10-16T20:07:52.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff59406af00 0x7ff59406d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b0146490 0x7ff5b01532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5b00cd540 0x7ff5b00c5e80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 --2- 172.21.15.152:0/1259015919 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff5b00cd920 0x7ff5b0155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 >> 172.21.15.152:0/1259015919 conn(0x7ff5b00b1460 msgr2=0x7ff5b006cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:52.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 shutdown_connections 2023-10-16T20:07:52.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.024+0000 7ff5b79dd700 1 -- 172.21.15.152:0/1259015919 wait complete. 2023-10-16T20:07:52.039 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'testcephfs1_data' created 2023-10-16T20:07:52.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-16T20:07:52.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.178+0000 7fecfc733700 1 Processor -- start 2023-10-16T20:07:52.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.178+0000 7fecfc733700 1 -- start start 2023-10-16T20:07:52.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfc733700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fecf40c9720 0x7fecf406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:52.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfc733700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf4071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:52.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfc733700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf4071d50 con 0x7fecf40b0bc0 2023-10-16T20:07:52.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfc733700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf4072260 con 0x7fecf40c9720 2023-10-16T20:07:52.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfc733700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4071f80 con 0x7fecf4159cf0 2023-10-16T20:07:52.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecf9cce700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf4071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:52.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfa4cf700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fecf40c9720 0x7fecf406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:52.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecf9cce700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf4071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:49432/0 (socket says 172.21.15.152:49432) 2023-10-16T20:07:52.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecfacd0700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fecf40b0bc0 0x7fecf40c9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:56160/0 (socket says 172.21.15.152:56160) 2023-10-16T20:07:52.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.179+0000 7fecf9cce700 1 -- 172.21.15.152:0/293969371 learned_addr learned my addr 172.21.15.152:0/293969371 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:52.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf9cce700 1 -- 172.21.15.152:0/293969371 >> v2:172.21.15.163:3300/0 conn(0x7fecf40c9720 msgr2=0x7fecf406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:52.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf9cce700 1 --2- 172.21.15.152:0/293969371 >> v2:172.21.15.163:3300/0 conn(0x7fecf40c9720 0x7fecf406ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf9cce700 1 -- 172.21.15.152:0/293969371 >> v1:172.21.15.163:6789/0 conn(0x7fecf40b0bc0 legacy=0x7fecf40c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:52.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf9cce700 1 -- 172.21.15.152:0/293969371 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40cd170 con 0x7fecf4159cf0 2023-10-16T20:07:52.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecfa4cf700 1 --2- 172.21.15.152:0/293969371 >> v2:172.21.15.163:3300/0 conn(0x7fecf40c9720 0x7fecf406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:07:52.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf9cce700 1 --2- 172.21.15.152:0/293969371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf4071810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009920 tx=0x7fecf0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2bcda98ae76f44b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:52.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf94cd700 1 -- 172.21.15.152:0/293969371 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0011830 con 0x7fecf4159cf0 2023-10-16T20:07:52.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf94cd700 1 -- 172.21.15.152:0/293969371 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0011990 con 0x7fecf4159cf0 2023-10-16T20:07:52.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.180+0000 7fecf94cd700 1 -- 172.21.15.152:0/293969371 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0011d20 con 0x7fecf4159cf0 2023-10-16T20:07:52.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 -- 172.21.15.152:0/293969371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 msgr2=0x7fecf4071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 --2- 172.21.15.152:0/293969371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf4071810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009920 tx=0x7fecf0009c30 comp rx=0 tx=0).stop 2023-10-16T20:07:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 -- 172.21.15.152:0/293969371 shutdown_connections 2023-10-16T20:07:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 --2- 172.21.15.152:0/293969371 >> v2:172.21.15.163:3300/0 conn(0x7fecf40c9720 0x7fecf406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 --2- 172.21.15.152:0/293969371 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf4071810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 -- 172.21.15.152:0/293969371 >> 172.21.15.152:0/293969371 conn(0x7fecf40cbb50 msgr2=0x7fecf40cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:52.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 -- 172.21.15.152:0/293969371 shutdown_connections 2023-10-16T20:07:52.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.181+0000 7fecfc733700 1 -- 172.21.15.152:0/293969371 wait complete. 2023-10-16T20:07:52.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.182+0000 7fecfc733700 1 Processor -- start 2023-10-16T20:07:52.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.182+0000 7fecfc733700 1 -- start start 2023-10-16T20:07:52.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecf40b0bc0 0x7fecf40b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:52.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 0x7fecf40c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:52.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf413d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:52.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40c6740 con 0x7fecf40c9720 2023-10-16T20:07:52.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf413dbc0 con 0x7fecf40b0bc0 2023-10-16T20:07:52.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40c86d0 con 0x7fecf4159cf0 2023-10-16T20:07:52.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 0x7fecf40c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:52.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 0x7fecf40c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60786/0 (socket says 172.21.15.152:60786) 2023-10-16T20:07:52.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 -- 172.21.15.152:0/3246779774 learned_addr learned my addr 172.21.15.152:0/3246779774 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:52.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfa4cf700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecf40b0bc0 0x7fecf40b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:52.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfacd0700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf413d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:52.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 -- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 msgr2=0x7fecf413d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:52.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf413d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 -- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecf40b0bc0 msgr2=0x7fecf40b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:52.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecf40b0bc0 0x7fecf40b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:52.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 -- 172.21.15.152:0/3246779774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece40094a0 con 0x7fecf40c9720 2023-10-16T20:07:52.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecf9cce700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 0x7fecf40c8b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecf0014040 tx=0x7fecf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:52.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0004240 con 0x7fecf40c9720 2023-10-16T20:07:52.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf001f070 con 0x7fecf40c9720 2023-10-16T20:07:52.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0009550 con 0x7fecf40c9720 2023-10-16T20:07:52.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00045e0 con 0x7fecf40c9720 2023-10-16T20:07:52.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.183+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf40b4b20 con 0x7fecf40c9720 2023-10-16T20:07:52.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.184+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf404ebb0 con 0x7fecf40c9720 2023-10-16T20:07:52.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.185+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fecf0021030 con 0x7fecf40c9720 2023-10-16T20:07:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.185+0000 7feceaffd700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fecd806af00 0x7fecd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.185+0000 7fecfa4cf700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fecd806af00 0x7fecd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.185+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fecf008a920 con 0x7fecf40c9720 2023-10-16T20:07:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.186+0000 7fecfa4cf700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fecd806af00 0x7fecd806d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fece4009d70 tx=0x7fece4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:52.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.190+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fecf0055970 con 0x7fecf40c9720 2023-10-16T20:07:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:52.421+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fecf406cb30 con 0x7fecf40c9720 2023-10-16T20:07:53.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.034+0000 7feceaffd700 1 -- 172.21.15.152:0/3246779774 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 5 and data pool 6 v15) v1 ==== 187+0+0 (secure 0 0 0) 0x7fecf0058f90 con 0x7fecf40c9720 2023-10-16T20:07:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.039+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fecd806af00 msgr2=0x7fecd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.039+0000 7fecfc733700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fecd806af00 0x7fecd806d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fece4009d70 tx=0x7fece4009210 comp rx=0 tx=0).stop 2023-10-16T20:07:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.039+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 msgr2=0x7fecf40c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.039+0000 7fecfc733700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 0x7fecf40c8b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecf0014040 tx=0x7fecf0004750 comp rx=0 tx=0).stop 2023-10-16T20:07:53.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 shutdown_connections 2023-10-16T20:07:53.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fecd806af00 0x7fecd806d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fecf4159cf0 0x7fecf413d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecf40b0bc0 0x7fecf40b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 --2- 172.21.15.152:0/3246779774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fecf40c9720 0x7fecf40c8b60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 >> 172.21.15.152:0/3246779774 conn(0x7fecf40cbb50 msgr2=0x7fecf406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:53.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 shutdown_connections 2023-10-16T20:07:53.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.040+0000 7fecfc733700 1 -- 172.21.15.152:0/3246779774 wait complete. 2023-10-16T20:07:53.044 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 5 and data pool 6 2023-10-16T20:07:53.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:53.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.183+0000 7f45fbafa700 1 Processor -- start 2023-10-16T20:07:53.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.183+0000 7f45fbafa700 1 -- start start 2023-10-16T20:07:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.184+0000 7f45fbafa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.184+0000 7f45fbafa700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f4070d70 con 0x7f45f40cb8d0 2023-10-16T20:07:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.184+0000 7f45fbafa700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f415c990 con 0x7f45f40b3410 2023-10-16T20:07:53.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.184+0000 7f45fbafa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4071200 con 0x7f45f4152470 2023-10-16T20:07:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.184+0000 7f45f9095700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f45f40cb8d0 0x7f45f40b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41010/0 (socket says 172.21.15.152:41010) 2023-10-16T20:07:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.184+0000 7f45f9095700 1 -- 172.21.15.152:0/1198590678 learned_addr learned my addr 172.21.15.152:0/1198590678 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f9896700 1 --2- 172.21.15.152:0/1198590678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177438586 0 0) 0x7f45f4070d70 con 0x7f45f40cb8d0 2023-10-16T20:07:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e00035b0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793455503 0 0) 0x7f45f415c990 con 0x7f45f40b3410 2023-10-16T20:07:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f4070d70 con 0x7f45f40b3410 2023-10-16T20:07:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f9896700 1 -- 172.21.15.152:0/1198590678 >> v1:172.21.15.163:6789/0 conn(0x7f45f40b3410 legacy=0x7f45f40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f9896700 1 -- 172.21.15.152:0/1198590678 >> v1:172.21.15.152:6789/0 conn(0x7f45f40cb8d0 legacy=0x7f45f40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706240409 0 0) 0x7f45e00035b0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f9896700 1 -- 172.21.15.152:0/1198590678 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4070440 con 0x7f45f4152470 2023-10-16T20:07:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f9896700 1 --2- 172.21.15.152:0/1198590678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f40cd570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=163ed9f117b1ab22 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4001670 con 0x7f45f4152470 2023-10-16T20:07:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0004030 con 0x7f45f4152470 2023-10-16T20:07:53.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.185+0000 7f45f8894700 1 -- 172.21.15.152:0/1198590678 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00043a0 con 0x7f45f4152470 2023-10-16T20:07:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 -- 172.21.15.152:0/1198590678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 msgr2=0x7f45f40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 --2- 172.21.15.152:0/1198590678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f40cd570 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f0009b80 comp rx=0 tx=0).stop 2023-10-16T20:07:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 -- 172.21.15.152:0/1198590678 shutdown_connections 2023-10-16T20:07:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 --2- 172.21.15.152:0/1198590678 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f40cd570 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 -- 172.21.15.152:0/1198590678 >> 172.21.15.152:0/1198590678 conn(0x7f45f40cdd00 msgr2=0x7f45f40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 -- 172.21.15.152:0/1198590678 shutdown_connections 2023-10-16T20:07:53.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.186+0000 7f45fbafa700 1 -- 172.21.15.152:0/1198590678 wait complete. 2023-10-16T20:07:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.188+0000 7f45fbafa700 1 Processor -- start 2023-10-16T20:07:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.188+0000 7f45fbafa700 1 -- start start 2023-10-16T20:07:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.188+0000 7f45fbafa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f40b3410 0x7f45f41f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.188+0000 7f45fbafa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 0x7f45f40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.188+0000 7f45fbafa700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45fbafa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c77b0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45fbafa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4145ba0 con 0x7f45f40b3410 2023-10-16T20:07:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45fbafa700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c6f10 con 0x7f45f4152470 2023-10-16T20:07:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 0x7f45f40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 0x7f45f40c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60816/0 (socket says 172.21.15.152:60816) 2023-10-16T20:07:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 -- 172.21.15.152:0/516479265 learned_addr learned my addr 172.21.15.152:0/516479265 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9896700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f40b3410 0x7f45f41f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45fa097700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 -- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 msgr2=0x7f45f4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f4152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 -- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f40b3410 msgr2=0x7f45f41f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f40b3410 0x7f45f41f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 -- 172.21.15.152:0/516479265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00094a0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45f9095700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 0x7f45f40c6810 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c750 tx=0x7f45e400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4004c80 con 0x7f45f40cb8d0 2023-10-16T20:07:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4004de0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40c71f0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4007310 con 0x7f45f40cb8d0 2023-10-16T20:07:53.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.189+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40c8e70 con 0x7f45f40cb8d0 2023-10-16T20:07:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.190+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f40c8cd0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.191+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45e4007470 con 0x7f45f40cb8d0 2023-10-16T20:07:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.191+0000 7f45ea7fc700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f45d806af00 0x7f45d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.191+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f45e40895e0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.191+0000 7f45f9896700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f45d806af00 0x7f45d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.191+0000 7f45f9896700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f45d806af00 0x7f45d806d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f45f00090b0 tx=0x7f45f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.196+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45f40c8cd0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.384+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45f40c8cd0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.386+0000 7f45ea7fc700 1 -- 172.21.15.152:0/516479265 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16843 (secure 0 0 0) 0x7f45f40c8cd0 con 0x7f45f40cb8d0 2023-10-16T20:07:53.388 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:53.389 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":40,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:52.422883+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T20:07:50.358578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T20:07:51.386644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:53.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f45d806af00 msgr2=0x7f45d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f45d806af00 0x7f45d806d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f45f00090b0 tx=0x7f45f0008030 comp rx=0 tx=0).stop 2023-10-16T20:07:53.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 msgr2=0x7f45f40c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 0x7f45f40c6810 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c750 tx=0x7f45e400cb10 comp rx=0 tx=0).stop 2023-10-16T20:07:53.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 shutdown_connections 2023-10-16T20:07:53.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f45d806af00 0x7f45d806d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f45f4152470 0x7f45f4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45f40b3410 0x7f45f41f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 --2- 172.21.15.152:0/516479265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45f40cb8d0 0x7f45f40c6810 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 >> 172.21.15.152:0/516479265 conn(0x7f45f40cdd00 msgr2=0x7f45f40b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:53.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 shutdown_connections 2023-10-16T20:07:53.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.388+0000 7f45fbafa700 1 -- 172.21.15.152:0/516479265 wait complete. 2023-10-16T20:07:53.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:53.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.523+0000 7f5cffd3c700 1 Processor -- start 2023-10-16T20:07:53.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.523+0000 7f5cffd3c700 1 -- start start 2023-10-16T20:07:53.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cffd3c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf81428c0 0x7f5cf80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cffd3c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5cf815e560 0x7f5cf815a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cffd3c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80b36a0 con 0x7f5cf80b3240 2023-10-16T20:07:53.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cffd3c700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf815ebc0 con 0x7f5cf815e560 2023-10-16T20:07:53.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cffd3c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8161ce0 con 0x7f5cf81428c0 2023-10-16T20:07:53.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfd2d7700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5cf80b3240 0x7f5cf815de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41020/0 (socket says 172.21.15.152:41020) 2023-10-16T20:07:53.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfd2d7700 1 -- 172.21.15.152:0/3105069389 learned_addr learned my addr 172.21.15.152:0/3105069389 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:53.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfe2d9700 1 --2- 172.21.15.152:0/3105069389 >> v2:172.21.15.163:3300/0 conn(0x7f5cf815e560 0x7f5cf815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfdad8700 1 --2- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf81428c0 0x7f5cf80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfcad6700 1 -- 172.21.15.152:0/3105069389 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736843657 0 0) 0x7f5cf80b36a0 con 0x7f5cf80b3240 2023-10-16T20:07:53.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfcad6700 1 -- 172.21.15.152:0/3105069389 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ce40035b0 con 0x7f5cf80b3240 2023-10-16T20:07:53.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfe2d9700 1 -- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf81428c0 msgr2=0x7f5cf80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:53.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfe2d9700 1 --2- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf81428c0 0x7f5cf80b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfe2d9700 1 -- 172.21.15.152:0/3105069389 >> v1:172.21.15.152:6789/0 conn(0x7f5cf80b3240 legacy=0x7f5cf815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.524+0000 7f5cfe2d9700 1 -- 172.21.15.152:0/3105069389 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8162170 con 0x7f5cf815e560 2023-10-16T20:07:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cfe2d9700 1 --2- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf815e560 0x7f5cf815a860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009d90 tx=0x7f5cf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bc57a8b14cd3a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cfcad6700 1 -- 172.21.15.152:0/3105069389 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000e070 con 0x7f5cf815e560 2023-10-16T20:07:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cfcad6700 1 -- 172.21.15.152:0/3105069389 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf000bb20 con 0x7f5cf815e560 2023-10-16T20:07:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cfcad6700 1 -- 172.21.15.152:0/3105069389 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0012430 con 0x7f5cf815e560 2023-10-16T20:07:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 -- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf815e560 msgr2=0x7f5cf815a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf815e560 0x7f5cf815a860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009d90 tx=0x7f5cf000b330 comp rx=0 tx=0).stop 2023-10-16T20:07:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 -- 172.21.15.152:0/3105069389 shutdown_connections 2023-10-16T20:07:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf81428c0 0x7f5cf80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/3105069389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf815e560 0x7f5cf815a860 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 -- 172.21.15.152:0/3105069389 >> 172.21.15.152:0/3105069389 conn(0x7f5cf80cdd00 msgr2=0x7f5cf80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:53.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 -- 172.21.15.152:0/3105069389 shutdown_connections 2023-10-16T20:07:53.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.525+0000 7f5cffd3c700 1 -- 172.21.15.152:0/3105069389 wait complete. 2023-10-16T20:07:53.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 Processor -- start 2023-10-16T20:07:53.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 -- start start 2023-10-16T20:07:53.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 0x7f5cf815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf81428c0 0x7f5cf80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf815e560 0x7f5cf80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf815cd60 con 0x7f5cf80b3240 2023-10-16T20:07:53.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c5960 con 0x7f5cf81428c0 2023-10-16T20:07:53.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cffd3c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c4d90 con 0x7f5cf815e560 2023-10-16T20:07:53.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cfdad8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 0x7f5cf815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cfdad8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 0x7f5cf815c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60828/0 (socket says 172.21.15.152:60828) 2023-10-16T20:07:53.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.527+0000 7f5cfdad8700 1 -- 172.21.15.152:0/195117524 learned_addr learned my addr 172.21.15.152:0/195117524 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:53.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfd2d7700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf81428c0 0x7f5cf80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfdad8700 1 -- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf815e560 msgr2=0x7f5cf80c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfdad8700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf815e560 0x7f5cf80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfdad8700 1 -- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf81428c0 msgr2=0x7f5cf80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfdad8700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf81428c0 0x7f5cf80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfdad8700 1 -- 172.21.15.152:0/195117524 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009a70 con 0x7f5cf80b3240 2023-10-16T20:07:53.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cfdad8700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 0x7f5cf815c820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400e9e0 tx=0x7f5cf400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4009710 con 0x7f5cf80b3240 2023-10-16T20:07:53.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf400c850 con 0x7f5cf80b3240 2023-10-16T20:07:53.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf80c5030 con 0x7f5cf80b3240 2023-10-16T20:07:53.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400cbc0 con 0x7f5cf80b3240 2023-10-16T20:07:53.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.528+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf80c55f0 con 0x7f5cf80b3240 2023-10-16T20:07:53.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.529+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf80c9f30 con 0x7f5cf80b3240 2023-10-16T20:07:53.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.530+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5cf400cd20 con 0x7f5cf80b3240 2023-10-16T20:07:53.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.531+0000 7f5cee7fc700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5cdc06af00 0x7f5cdc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.531+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5cf408a090 con 0x7f5cf80b3240 2023-10-16T20:07:53.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.531+0000 7f5cfd2d7700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5cdc06af00 0x7f5cdc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.531+0000 7f5cfd2d7700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5cdc06af00 0x7f5cdc06d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8140de0 tx=0x7f5ce8007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.558 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.535+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cf4054f30 con 0x7f5cf80b3240 2023-10-16T20:07:53.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.726+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cf804ebb0 con 0x7f5cf80b3240 2023-10-16T20:07:53.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.727+0000 7f5cee7fc700 1 -- 172.21.15.152:0/195117524 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16843 (secure 0 0 0) 0x7f5cf4021090 con 0x7f5cf80b3240 2023-10-16T20:07:53.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:53.730 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":40,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:52.422883+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T20:07:50.358578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T20:07:51.386644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:53.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5cdc06af00 msgr2=0x7f5cdc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5cdc06af00 0x7f5cdc06d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8140de0 tx=0x7f5ce8007dc0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 msgr2=0x7f5cf815c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 0x7f5cf815c820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400e9e0 tx=0x7f5cf400ecf0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 shutdown_connections 2023-10-16T20:07:53.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5cdc06af00 0x7f5cdc06d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5cf815e560 0x7f5cf80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cf80b3240 0x7f5cf815c820 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 --2- 172.21.15.152:0/195117524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cf81428c0 0x7f5cf80b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 >> 172.21.15.152:0/195117524 conn(0x7f5cf80cdd00 msgr2=0x7f5cf806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:53.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 shutdown_connections 2023-10-16T20:07:53.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.729+0000 7f5cffd3c700 1 -- 172.21.15.152:0/195117524 wait complete. 2023-10-16T20:07:53.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-16T20:07:53.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.867+0000 7f76686fd700 1 Processor -- start 2023-10-16T20:07:53.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.867+0000 7f76686fd700 1 -- start start 2023-10-16T20:07:53.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f76686fd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f766015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f76686fd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7660161360 con 0x7f76600cdd30 2023-10-16T20:07:53.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f76686fd700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766006b750 con 0x7f766006a820 2023-10-16T20:07:53.873 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f76686fd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766006dcc0 con 0x7f766006b370 2023-10-16T20:07:53.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f7666c9a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76600cdd30 0x7f76601617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41034/0 (socket says 172.21.15.152:41034) 2023-10-16T20:07:53.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f7666c9a700 1 -- 172.21.15.152:0/2363421597 learned_addr learned my addr 172.21.15.152:0/2363421597 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:53.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f7666499700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f766015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838496962 0 0) 0x7f7660161360 con 0x7f76600cdd30 2023-10-16T20:07:53.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.868+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f764c0035b0 con 0x7f76600cdd30 2023-10-16T20:07:53.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 693012072 0 0) 0x7f764c0035b0 con 0x7f76600cdd30 2023-10-16T20:07:53.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 msgr2=0x7f766015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:53.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f766015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 >> v1:172.21.15.163:6789/0 conn(0x7f766006a820 legacy=0x7f766006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766015e300 con 0x7f76600cdd30 2023-10-16T20:07:53.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f76580019f0 con 0x7f76600cdd30 2023-10-16T20:07:53.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 >> v1:172.21.15.152:6789/0 conn(0x7f76600cdd30 legacy=0x7f76601617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f764c003a30 0x7f764c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f764c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f764c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766006dcc0 con 0x7f764c0043e0 2023-10-16T20:07:53.876 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c00ba10 con 0x7f764c003a30 2023-10-16T20:07:53.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c00bbd0 con 0x7f766006b370 2023-10-16T20:07:53.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f764c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7666499700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f764c003a30 0x7f764c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7666c9a700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f764c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 -- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 msgr2=0x7f764c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:53.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f764c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 -- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f764c003a30 msgr2=0x7f764c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:53.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f764c003a30 0x7f764c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 -- 172.21.15.152:0/2363421597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0035b0 con 0x7f764c0043e0 2023-10-16T20:07:53.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7666c9a700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f766006b370 0x7f764c005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:53.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7666499700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f764c003a30 0x7f764c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:53.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665c98700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f764c0048b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f765c0018b0 tx=0x7f764c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9279fe094444ad0a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c001370 con 0x7f764c0043e0 2023-10-16T20:07:53.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c00c6b0 con 0x7f764c0043e0 2023-10-16T20:07:53.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.869+0000 7f7665497700 1 -- 172.21.15.152:0/2363421597 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00ca60 con 0x7f764c0043e0 2023-10-16T20:07:53.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f76686fd700 1 -- 172.21.15.152:0/2363421597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 msgr2=0x7f764c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f76686fd700 1 --2- 172.21.15.152:0/2363421597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f764c0048b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f765c0018b0 tx=0x7f764c005880 comp rx=0 tx=0).stop 2023-10-16T20:07:53.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f7666c9a700 1 -- 172.21.15.152:0/2363421597 reap_dead start 2023-10-16T20:07:53.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f76686fd700 1 -- 172.21.15.152:0/2363421597 shutdown_connections 2023-10-16T20:07:53.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f76686fd700 1 -- 172.21.15.152:0/2363421597 >> 172.21.15.152:0/2363421597 conn(0x7f76600ccbe0 msgr2=0x7f76600ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:53.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f76686fd700 1 -- 172.21.15.152:0/2363421597 shutdown_connections 2023-10-16T20:07:53.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.870+0000 7f76686fd700 1 -- 172.21.15.152:0/2363421597 wait complete. 2023-10-16T20:07:53.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.871+0000 7f76686fd700 1 Processor -- start 2023-10-16T20:07:53.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.871+0000 7f76686fd700 1 -- start start 2023-10-16T20:07:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f76686fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f76600b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f76686fd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76600b3750 0x7f76600c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f76686fd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76600c61a0 0x7f7660155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f76686fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b4000 con 0x7f764c0043e0 2023-10-16T20:07:53.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f76686fd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b45c0 con 0x7f76600b3750 2023-10-16T20:07:53.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f76686fd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b4f90 con 0x7f76600c61a0 2023-10-16T20:07:53.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f76600b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f76600b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60848/0 (socket says 172.21.15.152:60848) 2023-10-16T20:07:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 -- 172.21.15.152:0/2087840368 learned_addr learned my addr 172.21.15.152:0/2087840368 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666c9a700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76600c61a0 0x7f7660155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7665c98700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76600b3750 0x7f76600c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 -- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76600c61a0 msgr2=0x7f7660155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76600c61a0 0x7f7660155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 -- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76600b3750 msgr2=0x7f76600c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:53.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76600b3750 0x7f76600c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:53.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 -- 172.21.15.152:0/2087840368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600c44f0 con 0x7f764c0043e0 2023-10-16T20:07:53.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666c9a700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76600c61a0 0x7f7660155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:53.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7665c98700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76600b3750 0x7f76600c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:53.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.872+0000 7f7666499700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f76600b4a50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7650011900 tx=0x7f7650011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.873+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650004220 con 0x7f764c0043e0 2023-10-16T20:07:53.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.873+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650004380 con 0x7f764c0043e0 2023-10-16T20:07:53.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.873+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600c47d0 con 0x7f764c0043e0 2023-10-16T20:07:53.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.873+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500036a0 con 0x7f764c0043e0 2023-10-16T20:07:53.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.873+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600c4100 con 0x7f764c0043e0 2023-10-16T20:07:53.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.874+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660072d10 con 0x7f764c0043e0 2023-10-16T20:07:53.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.874+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7650003800 con 0x7f764c0043e0 2023-10-16T20:07:53.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.874+0000 7f7656ffd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f764406af30 0x7f764406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:53.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.874+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7650089b90 con 0x7f764c0043e0 2023-10-16T20:07:53.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.874+0000 7f7665c98700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f764406af30 0x7f764406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:53.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.875+0000 7f7665c98700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f764406af30 0x7f764406d3f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f766015ddd0 tx=0x7f765c005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:53.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:53.879+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7650054ae0 con 0x7f764c0043e0 2023-10-16T20:07:54.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:54.117+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f76600b5ed0 con 0x7f764c0043e0 2023-10-16T20:07:55.007 INFO:tasks.ceph.mds.a.smithi152.stderr:2023-10-16T20:07:55.004+0000 7f4d7e772700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T20:07:55.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.048+0000 7f7656ffd700 1 -- 172.21.15.152:0/2087840368 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7650022020 con 0x7f764c0043e0 2023-10-16T20:07:55.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f764406af30 msgr2=0x7f764406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:55.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f764406af30 0x7f764406d3f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f766015ddd0 tx=0x7f765c005040 comp rx=0 tx=0).stop 2023-10-16T20:07:55.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 msgr2=0x7f76600b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:55.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f76600b4a50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7650011900 tx=0x7f7650011cc0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 shutdown_connections 2023-10-16T20:07:55.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f764406af30 0x7f764406d3f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76600c61a0 0x7f7660155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764c0043e0 0x7f76600b4a50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 --2- 172.21.15.152:0/2087840368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76600b3750 0x7f76600c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 >> 172.21.15.152:0/2087840368 conn(0x7f76600ccbe0 msgr2=0x7f7660157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:55.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 shutdown_connections 2023-10-16T20:07:55.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.051+0000 7f76686fd700 1 -- 172.21.15.152:0/2087840368 wait complete. 2023-10-16T20:07:55.067 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T20:07:55.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-16T20:07:55.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.196+0000 7f190dfde700 1 Processor -- start 2023-10-16T20:07:55.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.196+0000 7f190dfde700 1 -- start start 2023-10-16T20:07:55.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f190dfde700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f190806bd30 0x7f19080cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:55.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f190dfde700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f19080ce280 0x7f19080ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:55.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f190dfde700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1908159f30 con 0x7f1908159b50 2023-10-16T20:07:55.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f190dfde700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190806c1e0 con 0x7f190806bd30 2023-10-16T20:07:55.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f190dfde700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080ce6d0 con 0x7f19080ce280 2023-10-16T20:07:55.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f190806bd30 0x7f19080cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:55.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f190806bd30 0x7f19080cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60858/0 (socket says 172.21.15.152:60858) 2023-10-16T20:07:55.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 -- 172.21.15.152:0/180673313 learned_addr learned my addr 172.21.15.152:0/180673313 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:55.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1907fff700 1 --2- 172.21.15.152:0/180673313 >> v2:172.21.15.163:3300/0 conn(0x7f19080ce280 0x7f19080ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:55.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 -- 172.21.15.152:0/180673313 >> v2:172.21.15.163:3300/0 conn(0x7f19080ce280 msgr2=0x7f19080ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:55.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 --2- 172.21.15.152:0/180673313 >> v2:172.21.15.163:3300/0 conn(0x7f19080ce280 0x7f19080ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 -- 172.21.15.152:0/180673313 >> v1:172.21.15.163:6789/0 conn(0x7f1908159b50 legacy=0x7f190806e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:55.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 -- 172.21.15.152:0/180673313 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190806ea20 con 0x7f190806bd30 2023-10-16T20:07:55.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1907fff700 1 --2- 172.21.15.152:0/180673313 >> v2:172.21.15.163:3300/0 conn(0x7f19080ce280 0x7f19080ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:55.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f1906ffd700 1 --2- 172.21.15.152:0/180673313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190806bd30 0x7f19080cdd40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f19080cd570 tx=0x7f18f800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746b8c1b2fca521d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:55.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.197+0000 7f19067fc700 1 -- 172.21.15.152:0/180673313 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800dbe0 con 0x7f190806bd30 2023-10-16T20:07:55.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f19067fc700 1 -- 172.21.15.152:0/180673313 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800dd40 con 0x7f190806bd30 2023-10-16T20:07:55.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f19067fc700 1 -- 172.21.15.152:0/180673313 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8004270 con 0x7f190806bd30 2023-10-16T20:07:55.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 -- 172.21.15.152:0/180673313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190806bd30 msgr2=0x7f19080cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:55.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 --2- 172.21.15.152:0/180673313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190806bd30 0x7f19080cdd40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f19080cd570 tx=0x7f18f800be70 comp rx=0 tx=0).stop 2023-10-16T20:07:55.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 -- 172.21.15.152:0/180673313 shutdown_connections 2023-10-16T20:07:55.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 --2- 172.21.15.152:0/180673313 >> v2:172.21.15.163:3300/0 conn(0x7f19080ce280 0x7f19080ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 --2- 172.21.15.152:0/180673313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f190806bd30 0x7f19080cdd40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 -- 172.21.15.152:0/180673313 >> 172.21.15.152:0/180673313 conn(0x7f19080b13e0 msgr2=0x7f19080b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:55.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 -- 172.21.15.152:0/180673313 shutdown_connections 2023-10-16T20:07:55.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.198+0000 7f190dfde700 1 -- 172.21.15.152:0/180673313 wait complete. 2023-10-16T20:07:55.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.199+0000 7f190dfde700 1 Processor -- start 2023-10-16T20:07:55.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 -- start start 2023-10-16T20:07:55.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f190806bd30 0x7f190815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:55.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19080ce280 0x7f19081528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:55.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 0x7f19081ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:55.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908152e00 con 0x7f1908159b50 2023-10-16T20:07:55.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19081530a0 con 0x7f190806bd30 2023-10-16T20:07:55.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f190dfde700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908153380 con 0x7f19080ce280 2023-10-16T20:07:55.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f1907fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 0x7f19081ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:55.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f1907fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 0x7f19081ee4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60866/0 (socket says 172.21.15.152:60866) 2023-10-16T20:07:55.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.200+0000 7f1907fff700 1 -- 172.21.15.152:0/1223529972 learned_addr learned my addr 172.21.15.152:0/1223529972 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:55.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f19077fe700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f190806bd30 0x7f190815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:55.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1907fff700 1 -- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19080ce280 msgr2=0x7f19081528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:55.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1906ffd700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19080ce280 0x7f19081528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:55.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1907fff700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19080ce280 0x7f19081528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1907fff700 1 -- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f190806bd30 msgr2=0x7f190815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:55.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1907fff700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f190806bd30 0x7f190815c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1907fff700 1 -- 172.21.15.152:0/1223529972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f800b7f0 con 0x7f1908159b50 2023-10-16T20:07:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f19077fe700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f190806bd30 0x7f190815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f1907fff700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 0x7f19081ee4d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f190000cef0 tx=0x7f190000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190000ae50 con 0x7f1908159b50 2023-10-16T20:07:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900015440 con 0x7f1908159b50 2023-10-16T20:07:55.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190815a160 con 0x7f1908159b50 2023-10-16T20:07:55.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000157f0 con 0x7f1908159b50 2023-10-16T20:07:55.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.201+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190815a720 con 0x7f1908159b50 2023-10-16T20:07:55.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.202+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190815a910 con 0x7f1908159b50 2023-10-16T20:07:55.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.202+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f190000d430 con 0x7f1908159b50 2023-10-16T20:07:55.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.203+0000 7f18effff700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f18f406af30 0x7f18f406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:55.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.203+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f1900089d10 con 0x7f1908159b50 2023-10-16T20:07:55.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.203+0000 7f19077fe700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f18f406af30 0x7f18f406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:55.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.203+0000 7f19077fe700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f18f406af30 0x7f18f406d3f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006fd0 tx=0x7f18fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:55.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.207+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1900054c60 con 0x7f1908159b50 2023-10-16T20:07:55.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:55.443+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f190804ebb0 con 0x7f1908159b50 2023-10-16T20:07:56.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.049+0000 7f18effff700 1 -- 172.21.15.152:0/1223529972 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 127+0+0 (secure 0 0 0) 0x7f190001a020 con 0x7f1908159b50 2023-10-16T20:07:56.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.051+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f18f406af30 msgr2=0x7f18f406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.051+0000 7f190dfde700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f18f406af30 0x7f18f406d3f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006fd0 tx=0x7f18fc008040 comp rx=0 tx=0).stop 2023-10-16T20:07:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.051+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 msgr2=0x7f19081ee4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.051+0000 7f190dfde700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 0x7f19081ee4d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f190000cef0 tx=0x7f190000a340 comp rx=0 tx=0).stop 2023-10-16T20:07:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 shutdown_connections 2023-10-16T20:07:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f18f406af30 0x7f18f406d3f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1908159b50 0x7f19081ee4d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f190806bd30 0x7f190815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 --2- 172.21.15.152:0/1223529972 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f19080ce280 0x7f19081528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 >> 172.21.15.152:0/1223529972 conn(0x7f19080b13e0 msgr2=0x7f190806d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 shutdown_connections 2023-10-16T20:07:56.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.052+0000 7f190dfde700 1 -- 172.21.15.152:0/1223529972 wait complete. 2023-10-16T20:07:56.068 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-16T20:07:56.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:07:56.193 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.192+0000 7f6b6ef70700 1 Processor -- start 2023-10-16T20:07:56.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.192+0000 7f6b6ef70700 1 -- start start 2023-10-16T20:07:56.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.192+0000 7f6b6ef70700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b6806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.192+0000 7f6b6ef70700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b680cb3b0 con 0x7f6b680ce960 2023-10-16T20:07:56.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.192+0000 7f6b6ef70700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b680cb690 con 0x7f6b6815dea0 2023-10-16T20:07:56.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.192+0000 7f6b6ef70700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680cb970 con 0x7f6b680ced40 2023-10-16T20:07:56.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6b680ce960 0x7f6b680cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41068/0 (socket says 172.21.15.152:41068) 2023-10-16T20:07:56.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 -- 172.21.15.152:0/712756046 learned_addr learned my addr 172.21.15.152:0/712756046 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:56.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842109332 0 0) 0x7f6b680cb3b0 con 0x7f6b680ce960 2023-10-16T20:07:56.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b67fff700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b6806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b580057c0 con 0x7f6b680ce960 2023-10-16T20:07:56.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406949008 0 0) 0x7f6b580057c0 con 0x7f6b680ce960 2023-10-16T20:07:56.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 msgr2=0x7f6b6806e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:56.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b6806e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 >> v1:172.21.15.163:6789/0 conn(0x7f6b6815dea0 legacy=0x7f6b68157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.200 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680cbc50 con 0x7f6b680ce960 2023-10-16T20:07:56.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f6b5c001670 con 0x7f6b680ce960 2023-10-16T20:07:56.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 >> v1:172.21.15.152:6789/0 conn(0x7f6b680ce960 legacy=0x7f6b680cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b58005c40 0x7f6b58006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b58006a60 0x7f6b58006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b58007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680cb970 con 0x7f6b58005c40 2023-10-16T20:07:56.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5800dcd0 con 0x7f6b58006a60 2023-10-16T20:07:56.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5800de90 con 0x7f6b680ced40 2023-10-16T20:07:56.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b58005c40 0x7f6b58006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b67fff700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b58006a60 0x7f6b58006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6d50d700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b58007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 -- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 msgr2=0x7f6b58007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:56.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b58007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 -- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b58006a60 msgr2=0x7f6b58006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:56.203 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b58006a60 0x7f6b58006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.193+0000 7f6b6cd0c700 1 -- 172.21.15.152:0/712756046 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580057c0 con 0x7f6b58005c40 2023-10-16T20:07:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b67fff700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b58006a60 0x7f6b58006ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6d50d700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b680ced40 0x7f6b58007420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b58005c40 0x7f6b58006060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c270 tx=0x7f6b58007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e02f18fae77eaa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.204 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c007c10 con 0x7f6b58005c40 2023-10-16T20:07:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c00cdb0 con 0x7f6b58005c40 2023-10-16T20:07:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b677fe700 1 -- 172.21.15.152:0/712756046 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c005ba0 con 0x7f6b58005c40 2023-10-16T20:07:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6ef70700 1 -- 172.21.15.152:0/712756046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b58005c40 msgr2=0x7f6b58006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/712756046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b58005c40 0x7f6b58006060 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c270 tx=0x7f6b58007a90 comp rx=0 tx=0).stop 2023-10-16T20:07:56.205 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6d50d700 1 -- 172.21.15.152:0/712756046 reap_dead start 2023-10-16T20:07:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6ef70700 1 -- 172.21.15.152:0/712756046 shutdown_connections 2023-10-16T20:07:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6ef70700 1 -- 172.21.15.152:0/712756046 >> 172.21.15.152:0/712756046 conn(0x7f6b680cfcd0 msgr2=0x7f6b680d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6ef70700 1 -- 172.21.15.152:0/712756046 shutdown_connections 2023-10-16T20:07:56.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.194+0000 7f6b6ef70700 1 -- 172.21.15.152:0/712756046 wait complete. 2023-10-16T20:07:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.196+0000 7f6b6ef70700 1 Processor -- start 2023-10-16T20:07:56.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.196+0000 7f6b6ef70700 1 -- start start 2023-10-16T20:07:56.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.196+0000 7f6b6ef70700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b58005c40 0x7f6b680b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.196+0000 7f6b6ef70700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b680b0c00 0x7f6b6815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6ef70700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 0x7f6b680c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6ef70700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6815c7b0 con 0x7f6b6815c330 2023-10-16T20:07:56.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6ef70700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680af3e0 con 0x7f6b680b0c00 2023-10-16T20:07:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6ef70700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680af680 con 0x7f6b58005c40 2023-10-16T20:07:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 0x7f6b680c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 0x7f6b680c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60886/0 (socket says 172.21.15.152:60886) 2023-10-16T20:07:56.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 -- 172.21.15.152:0/586429002 learned_addr learned my addr 172.21.15.152:0/586429002 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b58005c40 0x7f6b680b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 -- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b58005c40 msgr2=0x7f6b680b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b67fff700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b680b0c00 0x7f6b6815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b58005c40 0x7f6b680b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 -- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b680b0c00 msgr2=0x7f6b6815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b680b0c00 0x7f6b6815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 -- 172.21.15.152:0/586429002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680af960 con 0x7f6b6815c330 2023-10-16T20:07:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6d50d700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 0x7f6b680c3410 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000f80 tx=0x7f6b6000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60003c10 con 0x7f6b6815c330 2023-10-16T20:07:56.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60003d90 con 0x7f6b6815c330 2023-10-16T20:07:56.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b680afc40 con 0x7f6b6815c330 2023-10-16T20:07:56.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60005310 con 0x7f6b6815c330 2023-10-16T20:07:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.197+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b680b1370 con 0x7f6b6815c330 2023-10-16T20:07:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.198+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b680afe30 con 0x7f6b6815c330 2023-10-16T20:07:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.199+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b60005470 con 0x7f6b6815c330 2023-10-16T20:07:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.199+0000 7f6b657fa700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6b4c06af00 0x7f6b4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.199+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6b60089710 con 0x7f6b6815c330 2023-10-16T20:07:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.199+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6b4c06af00 0x7f6b4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.200+0000 7f6b6cd0c700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6b4c06af00 0x7f6b4c06d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c015040 tx=0x7f6b5c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.204+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b60054690 con 0x7f6b6815c330 2023-10-16T20:07:56.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.433+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b6804ebb0 con 0x7f6b6815c330 2023-10-16T20:07:56.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.434+0000 7f6b657fa700 1 -- 172.21.15.152:0/586429002 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f6b60057cb0 con 0x7f6b6815c330 2023-10-16T20:07:56.436 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:56.436 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2930592275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2930592275},{"type":"v1","addr":"172.21.15.163:6834","nonce":2930592275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/3404226802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":3404226802},{"type":"v1","addr":"172.21.15.163:6835","nonce":3404226802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2105247281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2105247281},{"type":"v1","addr":"172.21.15.152:6835","nonce":2105247281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:07:52.423205+0000","modified":"2023-10-16T20:07:55.444012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6837/829949938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":829949938},{"type":"v1","addr":"172.21.15.152:6837","nonce":829949938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T20:07:56.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6b4c06af00 msgr2=0x7f6b4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6b4c06af00 0x7f6b4c06d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c015040 tx=0x7f6b5c007000 comp rx=0 tx=0).stop 2023-10-16T20:07:56.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 msgr2=0x7f6b680c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 0x7f6b680c3410 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000f80 tx=0x7f6b6000ee00 comp rx=0 tx=0).stop 2023-10-16T20:07:56.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 shutdown_connections 2023-10-16T20:07:56.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6b4c06af00 0x7f6b4c06d3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6b58005c40 0x7f6b680b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b6815c330 0x7f6b680c3410 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 --2- 172.21.15.152:0/586429002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b680b0c00 0x7f6b6815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 >> 172.21.15.152:0/586429002 conn(0x7f6b680cfcd0 msgr2=0x7f6b6806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:56.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 shutdown_connections 2023-10-16T20:07:56.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.436+0000 7f6b6ef70700 1 -- 172.21.15.152:0/586429002 wait complete. 2023-10-16T20:07:56.441 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 19 2023-10-16T20:07:56.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:07:56.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.569+0000 7faa5bcd9700 1 Processor -- start 2023-10-16T20:07:56.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.570+0000 7faa5bcd9700 1 -- start start 2023-10-16T20:07:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5bcd9700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faa5406dfc0 0x7faa540717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5bcd9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa54071d20 0x7faa540ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5bcd9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5406f270 con 0x7faa5415a650 2023-10-16T20:07:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5bcd9700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5406e470 con 0x7faa5406dfc0 2023-10-16T20:07:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5bcd9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540721b0 con 0x7faa54071d20 2023-10-16T20:07:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59274700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faa5406dfc0 0x7faa540717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59a75700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7faa5415a650 0x7faa5415b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41088/0 (socket says 172.21.15.152:41088) 2023-10-16T20:07:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59a75700 1 -- 172.21.15.152:0/121920458 learned_addr learned my addr 172.21.15.152:0/121920458 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5a276700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa54071d20 0x7faa540ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59274700 1 -- 172.21.15.152:0/121920458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa54071d20 msgr2=0x7faa540ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:56.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59274700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa54071d20 0x7faa540ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59274700 1 -- 172.21.15.152:0/121920458 >> v1:172.21.15.152:6789/0 conn(0x7faa5415a650 legacy=0x7faa5415b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59274700 1 -- 172.21.15.152:0/121920458 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5415aa30 con 0x7faa5406dfc0 2023-10-16T20:07:56.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa58a73700 1 -- 172.21.15.152:0/121920458 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168722979 0 0) 0x7faa5406f270 con 0x7faa5415a650 2023-10-16T20:07:56.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa5a276700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa54071d20 0x7faa540ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa59274700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa5406dfc0 0x7faa540717e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faa5000bb10 tx=0x7faa5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974d6cbedb0992f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa58a73700 1 -- 172.21.15.152:0/121920458 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000dcf0 con 0x7faa5406dfc0 2023-10-16T20:07:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa58a73700 1 -- 172.21.15.152:0/121920458 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5000de50 con 0x7faa5406dfc0 2023-10-16T20:07:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.571+0000 7faa58a73700 1 -- 172.21.15.152:0/121920458 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50010690 con 0x7faa5406dfc0 2023-10-16T20:07:56.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 -- 172.21.15.152:0/121920458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa5406dfc0 msgr2=0x7faa540717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa5406dfc0 0x7faa540717e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faa5000bb10 tx=0x7faa5000be20 comp rx=0 tx=0).stop 2023-10-16T20:07:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 -- 172.21.15.152:0/121920458 shutdown_connections 2023-10-16T20:07:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa54071d20 0x7faa540ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/121920458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa5406dfc0 0x7faa540717e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 -- 172.21.15.152:0/121920458 >> 172.21.15.152:0/121920458 conn(0x7faa540d0180 msgr2=0x7faa540d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:56.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 -- 172.21.15.152:0/121920458 shutdown_connections 2023-10-16T20:07:56.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.572+0000 7faa5bcd9700 1 -- 172.21.15.152:0/121920458 wait complete. 2023-10-16T20:07:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.573+0000 7faa5bcd9700 1 Processor -- start 2023-10-16T20:07:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.573+0000 7faa5bcd9700 1 -- start start 2023-10-16T20:07:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5bcd9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa5406dfc0 0x7faa540b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5bcd9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 0x7faa540cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5bcd9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa5415a650 0x7faa540cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5bcd9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541f4120 con 0x7faa54071d20 2023-10-16T20:07:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5bcd9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415c200 con 0x7faa5406dfc0 2023-10-16T20:07:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5bcd9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415c4e0 con 0x7faa5415a650 2023-10-16T20:07:56.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 0x7faa540cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 0x7faa540cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60896/0 (socket says 172.21.15.152:60896) 2023-10-16T20:07:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 -- 172.21.15.152:0/2563345361 learned_addr learned my addr 172.21.15.152:0/2563345361 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa5a276700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa5415a650 0x7faa540cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59a75700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa5406dfc0 0x7faa540b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 -- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa5415a650 msgr2=0x7faa540cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa5415a650 0x7faa540cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 -- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa5406dfc0 msgr2=0x7faa540b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa5406dfc0 0x7faa540b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59274700 1 -- 172.21.15.152:0/2563345361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5000b740 con 0x7faa54071d20 2023-10-16T20:07:56.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.574+0000 7faa59a75700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa5406dfc0 0x7faa540b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:56.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.575+0000 7faa59274700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 0x7faa540cb660 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faa5000b2c0 tx=0x7faa500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.575+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50023630 con 0x7faa54071d20 2023-10-16T20:07:56.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.575+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50023790 con 0x7faa54071d20 2023-10-16T20:07:56.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.575+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50023b40 con 0x7faa54071d20 2023-10-16T20:07:56.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.575+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5415c7c0 con 0x7faa54071d20 2023-10-16T20:07:56.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.575+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540b5be0 con 0x7faa54071d20 2023-10-16T20:07:56.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.576+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5406f6e0 con 0x7faa54071d20 2023-10-16T20:07:56.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.576+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faa50019400 con 0x7faa54071d20 2023-10-16T20:07:56.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.576+0000 7faa4a7fc700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faa3806af00 0x7faa3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.576+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7faa5008b280 con 0x7faa54071d20 2023-10-16T20:07:56.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.576+0000 7faa59a75700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faa3806af00 0x7faa3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.577+0000 7faa59a75700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faa3806af00 0x7faa3806d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa44000f60 tx=0x7faa44007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.581+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa50056260 con 0x7faa54071d20 2023-10-16T20:07:56.772 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.771+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa5415cc80 con 0x7faa54071d20 2023-10-16T20:07:56.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.772+0000 7faa4a7fc700 1 -- 172.21.15.152:0/2563345361 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16830 (secure 0 0 0) 0x7faa50059880 con 0x7faa54071d20 2023-10-16T20:07:56.774 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:56.774 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":41,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:54.019774+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T20:07:50.358578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T20:07:51.386644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:07:56.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faa3806af00 msgr2=0x7faa3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faa3806af00 0x7faa3806d3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa44000f60 tx=0x7faa44007d30 comp rx=0 tx=0).stop 2023-10-16T20:07:56.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 msgr2=0x7faa540cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 0x7faa540cb660 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faa5000b2c0 tx=0x7faa500047c0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 shutdown_connections 2023-10-16T20:07:56.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7faa3806af00 0x7faa3806d3c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7faa5415a650 0x7faa540cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faa5406dfc0 0x7faa540b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 --2- 172.21.15.152:0/2563345361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa54071d20 0x7faa540cb660 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 >> 172.21.15.152:0/2563345361 conn(0x7faa540d0180 msgr2=0x7faa5415e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:56.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 shutdown_connections 2023-10-16T20:07:56.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.774+0000 7faa5bcd9700 1 -- 172.21.15.152:0/2563345361 wait complete. 2023-10-16T20:07:56.788 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T20:07:56.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:07:56.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.908+0000 7f9f5ad08700 1 Processor -- start 2023-10-16T20:07:56.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.908+0000 7f9f5ad08700 1 -- start start 2023-10-16T20:07:56.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f5ad08700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f5415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f5ad08700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9f540cdc90 0x7f9f54161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f5ad08700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f5406a820 0x7f9f5406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f5ad08700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5406b1f0 con 0x7f9f5406a820 2023-10-16T20:07:56.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f5ad08700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5415ecf0 con 0x7f9f540cdc90 2023-10-16T20:07:56.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f5ad08700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5415e320 con 0x7f9f54161780 2023-10-16T20:07:56.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f5406a820 0x7f9f5406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f5406a820 0x7f9f5406acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60908/0 (socket says 172.21.15.152:60908) 2023-10-16T20:07:56.915 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 -- 172.21.15.152:0/256904099 learned_addr learned my addr 172.21.15.152:0/256904099 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:56.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f53fff700 1 --2- 172.21.15.152:0/256904099 >> v2:172.21.15.163:3300/0 conn(0x7f9f540cdc90 0x7f9f54161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f58aa4700 1 --2- 172.21.15.152:0/256904099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f5415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 -- 172.21.15.152:0/256904099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 msgr2=0x7f9f5415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:56.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 --2- 172.21.15.152:0/256904099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f5415e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 -- 172.21.15.152:0/256904099 >> v2:172.21.15.163:3300/0 conn(0x7f9f540cdc90 msgr2=0x7f9f54161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:56.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 --2- 172.21.15.152:0/256904099 >> v2:172.21.15.163:3300/0 conn(0x7f9f540cdc90 0x7f9f54161b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 -- 172.21.15.152:0/256904099 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f540c3a20 con 0x7f9f5406a820 2023-10-16T20:07:56.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f592a5700 1 --2- 172.21.15.152:0/256904099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f5406acb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f5406b350 tx=0x7f9f4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be78e800edb0f46 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.909+0000 7f9f537fe700 1 -- 172.21.15.152:0/256904099 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00e070 con 0x7f9f5406a820 2023-10-16T20:07:56.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f537fe700 1 -- 172.21.15.152:0/256904099 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00b9c0 con 0x7f9f5406a820 2023-10-16T20:07:56.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f537fe700 1 -- 172.21.15.152:0/256904099 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00bd70 con 0x7f9f5406a820 2023-10-16T20:07:56.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 -- 172.21.15.152:0/256904099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 msgr2=0x7f9f5406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/256904099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f5406acb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f5406b350 tx=0x7f9f4c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:56.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 -- 172.21.15.152:0/256904099 shutdown_connections 2023-10-16T20:07:56.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/256904099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f5415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/256904099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f5406acb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/256904099 >> v2:172.21.15.163:3300/0 conn(0x7f9f540cdc90 0x7f9f54161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 -- 172.21.15.152:0/256904099 >> 172.21.15.152:0/256904099 conn(0x7f9f5406bd50 msgr2=0x7f9f5406c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:56.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 -- 172.21.15.152:0/256904099 shutdown_connections 2023-10-16T20:07:56.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.910+0000 7f9f5ad08700 1 -- 172.21.15.152:0/256904099 wait complete. 2023-10-16T20:07:56.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.911+0000 7f9f5ad08700 1 Processor -- start 2023-10-16T20:07:56.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.911+0000 7f9f5ad08700 1 -- start start 2023-10-16T20:07:56.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f5ad08700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f54152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f5ad08700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f540cdc90 0x7f9f540ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f5ad08700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f540ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f5ad08700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54153010 con 0x7f9f5406a820 2023-10-16T20:07:56.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f5ad08700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540ace00 con 0x7f9f540cdc90 2023-10-16T20:07:56.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f5ad08700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540c6370 con 0x7f9f54161780 2023-10-16T20:07:56.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f58aa4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f54152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f58aa4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f54152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60910/0 (socket says 172.21.15.152:60910) 2023-10-16T20:07:56.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.912+0000 7f9f58aa4700 1 -- 172.21.15.152:0/1974923036 learned_addr learned my addr 172.21.15.152:0/1974923036 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:56.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f592a5700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f540ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f53fff700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f540cdc90 0x7f9f540ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f58aa4700 1 -- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 msgr2=0x7f9f540ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f58aa4700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f540ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f58aa4700 1 -- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f540cdc90 msgr2=0x7f9f540ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:56.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f58aa4700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f540cdc90 0x7f9f540ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:56.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f58aa4700 1 -- 172.21.15.152:0/1974923036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c009b30 con 0x7f9f5406a820 2023-10-16T20:07:56.926 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f53fff700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f540cdc90 0x7f9f540ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:07:56.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f58aa4700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f54152ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800c7f0 tx=0x7f9f4800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011800 con 0x7f9f5406a820 2023-10-16T20:07:56.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48011960 con 0x7f9f5406a820 2023-10-16T20:07:56.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f540c6630 con 0x7f9f5406a820 2023-10-16T20:07:56.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48011d10 con 0x7f9f5406a820 2023-10-16T20:07:56.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.913+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5415bd50 con 0x7f9f5406a820 2023-10-16T20:07:56.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.914+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f540c6b50 con 0x7f9f5406a820 2023-10-16T20:07:56.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.914+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9f48018360 con 0x7f9f5406a820 2023-10-16T20:07:56.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.915+0000 7f9f517fa700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9f3806af00 0x7f9f3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:56.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.915+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9f480896d0 con 0x7f9f5406a820 2023-10-16T20:07:56.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.915+0000 7f9f53fff700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9f3806af00 0x7f9f3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:56.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.915+0000 7f9f53fff700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9f3806af00 0x7f9f3806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f40006fd0 tx=0x7f9f40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:56.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:56.919+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f48054620 con 0x7f9f5406a820 2023-10-16T20:07:57.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.107+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f540ce250 con 0x7f9f3806af00 2023-10-16T20:07:57.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.115+0000 7f9f517fa700 1 -- 172.21.15.152:0/1974923036 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286288 (secure 0 0 0) 0x7f9f4000c040 con 0x7f9f3806af00 2023-10-16T20:07:57.120 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9f3806af00 msgr2=0x7f9f3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9f3806af00 0x7f9f3806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f40006fd0 tx=0x7f9f40008040 comp rx=0 tx=0).stop 2023-10-16T20:07:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 msgr2=0x7f9f54152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.123 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f54152ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800c7f0 tx=0x7f9f4800cbb0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 shutdown_connections 2023-10-16T20:07:57.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9f3806af00 0x7f9f3806d3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9f54161780 0x7f9f540ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f5406a820 0x7f9f54152ad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 --2- 172.21.15.152:0/1974923036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f540cdc90 0x7f9f540ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 >> 172.21.15.152:0/1974923036 conn(0x7f9f5406bd50 msgr2=0x7f9f5406c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:57.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 shutdown_connections 2023-10-16T20:07:57.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.118+0000 7f9f5ad08700 1 -- 172.21.15.152:0/1974923036 wait complete. 2023-10-16T20:07:57.125 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:07:57.132 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-10-16T20:07:56.785115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220896,"kb_used_data":4700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753824,"statfs":{"total":773094113280,"available":772867915776,"internally_reserved":0,"allocated":4812800,"data_stored":2712352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771237"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031007+0000","last_change":"2023-10-16T20:07:52.031007+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031007+0000","last_undegraded":"2023-10-16T20:07:52.031007+0000","last_fullsized":"2023-10-16T20:07:52.031007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031533+0000","last_change":"2023-10-16T20:07:52.031533+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031533+0000","last_undegraded":"2023-10-16T20:07:52.031533+0000","last_fullsized":"2023-10-16T20:07:52.031533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030317+0000","last_change":"2023-10-16T20:07:52.030317+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030317+0000","last_undegraded":"2023-10-16T20:07:52.030317+0000","last_fullsized":"2023-10-16T20:07:52.030317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026758+0000","last_change":"2023-10-16T20:07:52.026758+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026758+0000","last_undegraded":"2023-10-16T20:07:52.026758+0000","last_fullsized":"2023-10-16T20:07:52.026758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023238+0000","last_change":"2023-10-16T20:07:52.023238+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023238+0000","last_undegraded":"2023-10-16T20:07:52.023238+0000","last_fullsized":"2023-10-16T20:07:52.023238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024221+0000","last_change":"2023-10-16T20:07:52.024221+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024221+0000","last_undegraded":"2023-10-16T20:07:52.024221+0000","last_fullsized":"2023-10-16T20:07:52.024221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057581+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:53.057581+0000","last_peered":"2023-10-16T20:07:53.057581+0000","last_clean":"2023-10-16T20:07:53.057581+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:53.057581+0000","last_undegraded":"2023-10-16T20:07:53.057581+0000","last_fullsized":"2023-10-16T20:07:53.057581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029110+0000","last_change":"2023-10-16T20:07:52.029110+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029110+0000","last_undegraded":"2023-10-16T20:07:52.029110+0000","last_fullsized":"2023-10-16T20:07:52.029110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029061+0000","last_change":"2023-10-16T20:07:52.029061+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029061+0000","last_undegraded":"2023-10-16T20:07:52.029061+0000","last_fullsized":"2023-10-16T20:07:52.029061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054548+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:53.054548+0000","last_peered":"2023-10-16T20:07:53.054548+0000","last_clean":"2023-10-16T20:07:53.054548+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:53.054548+0000","last_undegraded":"2023-10-16T20:07:53.054548+0000","last_fullsized":"2023-10-16T20:07:53.054548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049101+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:53.049101+0000","last_peered":"2023-10-16T20:07:53.049101+0000","last_clean":"2023-10-16T20:07:53.049101+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:53.049101+0000","last_undegraded":"2023-10-16T20:07:53.049101+0000","last_fullsized":"2023-10-16T20:07:53.049101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.028894+0000","last_change":"2023-10-16T20:07:52.028894+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.028894+0000","last_undegraded":"2023-10-16T20:07:52.028894+0000","last_fullsized":"2023-10-16T20:07:52.028894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059021+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:53.059021+0000","last_peered":"2023-10-16T20:07:53.059021+0000","last_clean":"2023-10-16T20:07:53.059021+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:53.059021+0000","last_undegraded":"2023-10-16T20:07:53.059021+0000","last_fullsized":"2023-10-16T20:07:53.059021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:32.233089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046639+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:53.046639+0000","last_peered":"2023-10-16T20:07:53.046639+0000","last_clean":"2023-10-16T20:07:53.046639+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:53.046639+0000","last_undegraded":"2023-10-16T20:07:53.046639+0000","last_fullsized":"2023-10-16T20:07:53.046639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:43.628385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057625+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:53.057625+0000","last_peered":"2023-10-16T20:07:53.057625+0000","last_clean":"2023-10-16T20:07:53.057625+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:53.057625+0000","last_undegraded":"2023-10-16T20:07:53.057625+0000","last_fullsized":"2023-10-16T20:07:53.057625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061105+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:53.061105+0000","last_peered":"2023-10-16T20:07:53.061105+0000","last_clean":"2023-10-16T20:07:53.061105+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:53.061105+0000","last_undegraded":"2023-10-16T20:07:53.061105+0000","last_fullsized":"2023-10-16T20:07:53.061105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058587+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:53.058587+0000","last_peered":"2023-10-16T20:07:53.058587+0000","last_clean":"2023-10-16T20:07:53.058587+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:53.058587+0000","last_undegraded":"2023-10-16T20:07:53.058587+0000","last_fullsized":"2023-10-16T20:07:53.058587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044053+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:53.044053+0000","last_peered":"2023-10-16T20:07:53.044053+0000","last_clean":"2023-10-16T20:07:53.044053+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:53.044053+0000","last_undegraded":"2023-10-16T20:07:53.044053+0000","last_fullsized":"2023-10-16T20:07:53.044053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022817+0000","last_change":"2023-10-16T20:07:52.022817+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022817+0000","last_undegraded":"2023-10-16T20:07:52.022817+0000","last_fullsized":"2023-10-16T20:07:52.022817+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043928+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:53.043928+0000","last_peered":"2023-10-16T20:07:53.043928+0000","last_clean":"2023-10-16T20:07:53.043928+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:53.043928+0000","last_undegraded":"2023-10-16T20:07:53.043928+0000","last_fullsized":"2023-10-16T20:07:53.043928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047542+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:53.047542+0000","last_peered":"2023-10-16T20:07:53.047542+0000","last_clean":"2023-10-16T20:07:53.047542+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:53.047542+0000","last_undegraded":"2023-10-16T20:07:53.047542+0000","last_fullsized":"2023-10-16T20:07:53.047542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044878+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:53.044878+0000","last_peered":"2023-10-16T20:07:53.044878+0000","last_clean":"2023-10-16T20:07:53.044878+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:53.044878+0000","last_undegraded":"2023-10-16T20:07:53.044878+0000","last_fullsized":"2023-10-16T20:07:53.044878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058371+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:53.058371+0000","last_peered":"2023-10-16T20:07:53.058371+0000","last_clean":"2023-10-16T20:07:53.058371+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:53.058371+0000","last_undegraded":"2023-10-16T20:07:53.058371+0000","last_fullsized":"2023-10-16T20:07:53.058371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022950+0000","last_change":"2023-10-16T20:07:52.022950+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022950+0000","last_undegraded":"2023-10-16T20:07:52.022950+0000","last_fullsized":"2023-10-16T20:07:52.022950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048316+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:53.048316+0000","last_peered":"2023-10-16T20:07:53.048316+0000","last_clean":"2023-10-16T20:07:53.048316+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:53.048316+0000","last_undegraded":"2023-10-16T20:07:53.048316+0000","last_fullsized":"2023-10-16T20:07:53.048316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023649+0000","last_change":"2023-10-16T20:07:52.023649+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023649+0000","last_undegraded":"2023-10-16T20:07:52.023649+0000","last_fullsized":"2023-10-16T20:07:52.023649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044088+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:53.044088+0000","last_peered":"2023-10-16T20:07:53.044088+0000","last_clean":"2023-10-16T20:07:53.044088+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:53.044088+0000","last_undegraded":"2023-10-16T20:07:53.044088+0000","last_fullsized":"2023-10-16T20:07:53.044088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:04.826839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053823+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:53.053823+0000","last_peered":"2023-10-16T20:07:53.053823+0000","last_clean":"2023-10-16T20:07:53.053823+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:53.053823+0000","last_undegraded":"2023-10-16T20:07:53.053823+0000","last_fullsized":"2023-10-16T20:07:53.053823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039648+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:53.039648+0000","last_peered":"2023-10-16T20:07:53.039648+0000","last_clean":"2023-10-16T20:07:53.039648+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:53.039648+0000","last_undegraded":"2023-10-16T20:07:53.039648+0000","last_fullsized":"2023-10-16T20:07:53.039648+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046439+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:53.046439+0000","last_peered":"2023-10-16T20:07:53.046439+0000","last_clean":"2023-10-16T20:07:53.046439+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:53.046439+0000","last_undegraded":"2023-10-16T20:07:53.046439+0000","last_fullsized":"2023-10-16T20:07:53.046439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:19.669427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058280+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:53.058280+0000","last_peered":"2023-10-16T20:07:53.058280+0000","last_clean":"2023-10-16T20:07:53.058280+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:53.058280+0000","last_undegraded":"2023-10-16T20:07:53.058280+0000","last_fullsized":"2023-10-16T20:07:53.058280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:55.937988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023468+0000","last_change":"2023-10-16T20:07:52.023468+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023468+0000","last_undegraded":"2023-10-16T20:07:52.023468+0000","last_fullsized":"2023-10-16T20:07:52.023468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058965+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:53.058965+0000","last_peered":"2023-10-16T20:07:53.058965+0000","last_clean":"2023-10-16T20:07:53.058965+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:53.058965+0000","last_undegraded":"2023-10-16T20:07:53.058965+0000","last_fullsized":"2023-10-16T20:07:53.058965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053642+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.053642+0000","last_peered":"2023-10-16T20:07:53.053642+0000","last_clean":"2023-10-16T20:07:53.053642+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.053642+0000","last_undegraded":"2023-10-16T20:07:53.053642+0000","last_fullsized":"2023-10-16T20:07:53.053642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024074+0000","last_change":"2023-10-16T20:07:52.024074+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024074+0000","last_undegraded":"2023-10-16T20:07:52.024074+0000","last_fullsized":"2023-10-16T20:07:52.024074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042127+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:52.042127+0000","last_peered":"2023-10-16T20:07:52.042127+0000","last_clean":"2023-10-16T20:07:52.042127+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:52.042127+0000","last_undegraded":"2023-10-16T20:07:52.042127+0000","last_fullsized":"2023-10-16T20:07:52.042127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043820+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:53.043820+0000","last_peered":"2023-10-16T20:07:53.043820+0000","last_clean":"2023-10-16T20:07:53.043820+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:53.043820+0000","last_undegraded":"2023-10-16T20:07:53.043820+0000","last_fullsized":"2023-10-16T20:07:53.043820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:08.472229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041828+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:52.041828+0000","last_peered":"2023-10-16T20:07:52.041828+0000","last_clean":"2023-10-16T20:07:52.041828+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:52.041828+0000","last_undegraded":"2023-10-16T20:07:52.041828+0000","last_fullsized":"2023-10-16T20:07:52.041828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:34.051850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029761+0000","last_change":"2023-10-16T20:07:52.029761+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029761+0000","last_undegraded":"2023-10-16T20:07:52.029761+0000","last_fullsized":"2023-10-16T20:07:52.029761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054959+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.054959+0000","last_peered":"2023-10-16T20:07:53.054959+0000","last_clean":"2023-10-16T20:07:53.054959+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.054959+0000","last_undegraded":"2023-10-16T20:07:53.054959+0000","last_fullsized":"2023-10-16T20:07:53.054959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029609+0000","last_change":"2023-10-16T20:07:52.029609+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029609+0000","last_undegraded":"2023-10-16T20:07:52.029609+0000","last_fullsized":"2023-10-16T20:07:52.029609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059229+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.059229+0000","last_peered":"2023-10-16T20:07:53.059229+0000","last_clean":"2023-10-16T20:07:53.059229+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.059229+0000","last_undegraded":"2023-10-16T20:07:53.059229+0000","last_fullsized":"2023-10-16T20:07:53.059229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057603+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:53.057603+0000","last_peered":"2023-10-16T20:07:53.057603+0000","last_clean":"2023-10-16T20:07:53.057603+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:53.057603+0000","last_undegraded":"2023-10-16T20:07:53.057603+0000","last_fullsized":"2023-10-16T20:07:53.057603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056263+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.056263+0000","last_peered":"2023-10-16T20:07:53.056263+0000","last_clean":"2023-10-16T20:07:53.056263+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.056263+0000","last_undegraded":"2023-10-16T20:07:53.056263+0000","last_fullsized":"2023-10-16T20:07:53.056263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044858+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:53.044858+0000","last_peered":"2023-10-16T20:07:53.044858+0000","last_clean":"2023-10-16T20:07:53.044858+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:53.044858+0000","last_undegraded":"2023-10-16T20:07:53.044858+0000","last_fullsized":"2023-10-16T20:07:53.044858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042945+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:52.042945+0000","last_peered":"2023-10-16T20:07:52.042945+0000","last_clean":"2023-10-16T20:07:52.042945+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:52.042945+0000","last_undegraded":"2023-10-16T20:07:52.042945+0000","last_fullsized":"2023-10-16T20:07:52.042945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:05.950966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030529+0000","last_change":"2023-10-16T20:07:52.030529+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030529+0000","last_undegraded":"2023-10-16T20:07:52.030529+0000","last_fullsized":"2023-10-16T20:07:52.030529+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026881+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.026881+0000","last_peered":"2023-10-16T20:07:53.026881+0000","last_clean":"2023-10-16T20:07:53.026881+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.026881+0000","last_undegraded":"2023-10-16T20:07:53.026881+0000","last_fullsized":"2023-10-16T20:07:53.026881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026213+0000","last_change":"2023-10-16T20:07:52.026213+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026213+0000","last_undegraded":"2023-10-16T20:07:52.026213+0000","last_fullsized":"2023-10-16T20:07:52.026213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047820+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:52.047820+0000","last_peered":"2023-10-16T20:07:52.047820+0000","last_clean":"2023-10-16T20:07:52.047820+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:52.047820+0000","last_undegraded":"2023-10-16T20:07:52.047820+0000","last_fullsized":"2023-10-16T20:07:52.047820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:08.428897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051679+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:53.051679+0000","last_peered":"2023-10-16T20:07:53.051679+0000","last_clean":"2023-10-16T20:07:53.051679+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:53.051679+0000","last_undegraded":"2023-10-16T20:07:53.051679+0000","last_fullsized":"2023-10-16T20:07:53.051679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.033944+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.033944+0000","last_peered":"2023-10-16T20:07:53.033944+0000","last_clean":"2023-10-16T20:07:53.033944+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.033944+0000","last_undegraded":"2023-10-16T20:07:53.033944+0000","last_fullsized":"2023-10-16T20:07:53.033944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026682+0000","last_change":"2023-10-16T20:07:52.026682+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026682+0000","last_undegraded":"2023-10-16T20:07:52.026682+0000","last_fullsized":"2023-10-16T20:07:52.026682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059565+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.059565+0000","last_peered":"2023-10-16T20:07:53.059565+0000","last_clean":"2023-10-16T20:07:53.059565+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.059565+0000","last_undegraded":"2023-10-16T20:07:53.059565+0000","last_fullsized":"2023-10-16T20:07:53.059565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.040882+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:53.040882+0000","last_peered":"2023-10-16T20:07:53.040882+0000","last_clean":"2023-10-16T20:07:53.040882+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:53.040882+0000","last_undegraded":"2023-10-16T20:07:53.040882+0000","last_fullsized":"2023-10-16T20:07:53.040882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:50:27.554553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041965+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:52.041965+0000","last_peered":"2023-10-16T20:07:52.041965+0000","last_clean":"2023-10-16T20:07:52.041965+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:52.041965+0000","last_undegraded":"2023-10-16T20:07:52.041965+0000","last_fullsized":"2023-10-16T20:07:52.041965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031459+0000","last_change":"2023-10-16T20:07:52.031459+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031459+0000","last_undegraded":"2023-10-16T20:07:52.031459+0000","last_fullsized":"2023-10-16T20:07:52.031459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041928+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:52.041928+0000","last_peered":"2023-10-16T20:07:52.041928+0000","last_clean":"2023-10-16T20:07:52.041928+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:52.041928+0000","last_undegraded":"2023-10-16T20:07:52.041928+0000","last_fullsized":"2023-10-16T20:07:52.041928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030508+0000","last_change":"2023-10-16T20:07:52.030508+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030508+0000","last_undegraded":"2023-10-16T20:07:52.030508+0000","last_fullsized":"2023-10-16T20:07:52.030508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042918+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:52.042918+0000","last_peered":"2023-10-16T20:07:52.042918+0000","last_clean":"2023-10-16T20:07:52.042918+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:52.042918+0000","last_undegraded":"2023-10-16T20:07:52.042918+0000","last_fullsized":"2023-10-16T20:07:52.042918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:15:03.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058375+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:53.058375+0000","last_peered":"2023-10-16T20:07:53.058375+0000","last_clean":"2023-10-16T20:07:53.058375+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:53.058375+0000","last_undegraded":"2023-10-16T20:07:53.058375+0000","last_fullsized":"2023-10-16T20:07:53.058375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.030393+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.030393+0000","last_peered":"2023-10-16T20:07:53.030393+0000","last_clean":"2023-10-16T20:07:53.030393+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.030393+0000","last_undegraded":"2023-10-16T20:07:53.030393+0000","last_fullsized":"2023-10-16T20:07:53.030393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031776+0000","last_change":"2023-10-16T20:07:52.031776+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031776+0000","last_undegraded":"2023-10-16T20:07:52.031776+0000","last_fullsized":"2023-10-16T20:07:52.031776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058435+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.058435+0000","last_peered":"2023-10-16T20:07:53.058435+0000","last_clean":"2023-10-16T20:07:53.058435+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.058435+0000","last_undegraded":"2023-10-16T20:07:53.058435+0000","last_fullsized":"2023-10-16T20:07:53.058435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030964+0000","last_change":"2023-10-16T20:07:52.030964+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030964+0000","last_undegraded":"2023-10-16T20:07:52.030964+0000","last_fullsized":"2023-10-16T20:07:52.030964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059421+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.059421+0000","last_peered":"2023-10-16T20:07:53.059421+0000","last_clean":"2023-10-16T20:07:53.059421+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.059421+0000","last_undegraded":"2023-10-16T20:07:53.059421+0000","last_fullsized":"2023-10-16T20:07:53.059421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049131+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:53.049131+0000","last_peered":"2023-10-16T20:07:53.049131+0000","last_clean":"2023-10-16T20:07:53.049131+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:53.049131+0000","last_undegraded":"2023-10-16T20:07:53.049131+0000","last_fullsized":"2023-10-16T20:07:53.049131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059748+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.059748+0000","last_peered":"2023-10-16T20:07:53.059748+0000","last_clean":"2023-10-16T20:07:53.059748+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.059748+0000","last_undegraded":"2023-10-16T20:07:53.059748+0000","last_fullsized":"2023-10-16T20:07:53.059748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.035583+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:53.035583+0000","last_peered":"2023-10-16T20:07:53.035583+0000","last_clean":"2023-10-16T20:07:53.035583+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:53.035583+0000","last_undegraded":"2023-10-16T20:07:53.035583+0000","last_fullsized":"2023-10-16T20:07:53.035583+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:46.637846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.046676+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:52.046676+0000","last_peered":"2023-10-16T20:07:52.046676+0000","last_clean":"2023-10-16T20:07:52.046676+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:52.046676+0000","last_undegraded":"2023-10-16T20:07:52.046676+0000","last_fullsized":"2023-10-16T20:07:52.046676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.338270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022700+0000","last_change":"2023-10-16T20:07:52.022700+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022700+0000","last_undegraded":"2023-10-16T20:07:52.022700+0000","last_fullsized":"2023-10-16T20:07:52.022700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042882+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:52.042882+0000","last_peered":"2023-10-16T20:07:52.042882+0000","last_clean":"2023-10-16T20:07:52.042882+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:52.042882+0000","last_undegraded":"2023-10-16T20:07:52.042882+0000","last_fullsized":"2023-10-16T20:07:52.042882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:40:45.795652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061085+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:53.061085+0000","last_peered":"2023-10-16T20:07:53.061085+0000","last_clean":"2023-10-16T20:07:53.061085+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:53.061085+0000","last_undegraded":"2023-10-16T20:07:53.061085+0000","last_fullsized":"2023-10-16T20:07:53.061085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.045283+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:52.045283+0000","last_peered":"2023-10-16T20:07:52.045283+0000","last_clean":"2023-10-16T20:07:52.045283+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:52.045283+0000","last_undegraded":"2023-10-16T20:07:52.045283+0000","last_fullsized":"2023-10-16T20:07:52.045283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:51:54.049368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026256+0000","last_change":"2023-10-16T20:07:52.026256+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026256+0000","last_undegraded":"2023-10-16T20:07:52.026256+0000","last_fullsized":"2023-10-16T20:07:52.026256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.036592+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:52.036592+0000","last_peered":"2023-10-16T20:07:52.036592+0000","last_clean":"2023-10-16T20:07:52.036592+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:52.036592+0000","last_undegraded":"2023-10-16T20:07:52.036592+0000","last_fullsized":"2023-10-16T20:07:52.036592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:37.418051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047612+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:53.047612+0000","last_peered":"2023-10-16T20:07:53.047612+0000","last_clean":"2023-10-16T20:07:53.047612+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:53.047612+0000","last_undegraded":"2023-10-16T20:07:53.047612+0000","last_fullsized":"2023-10-16T20:07:53.047612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039862+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.039862+0000","last_peered":"2023-10-16T20:07:53.039862+0000","last_clean":"2023-10-16T20:07:53.039862+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.039862+0000","last_undegraded":"2023-10-16T20:07:53.039862+0000","last_fullsized":"2023-10-16T20:07:53.039862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031403+0000","last_change":"2023-10-16T20:07:52.031403+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031403+0000","last_undegraded":"2023-10-16T20:07:52.031403+0000","last_fullsized":"2023-10-16T20:07:52.031403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047948+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:52.047948+0000","last_peered":"2023-10-16T20:07:52.047948+0000","last_clean":"2023-10-16T20:07:52.047948+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:52.047948+0000","last_undegraded":"2023-10-16T20:07:52.047948+0000","last_fullsized":"2023-10-16T20:07:52.047948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:19.523829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.025011+0000","last_change":"2023-10-16T20:07:52.025011+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.025011+0000","last_undegraded":"2023-10-16T20:07:52.025011+0000","last_fullsized":"2023-10-16T20:07:52.025011+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059407+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.059407+0000","last_peered":"2023-10-16T20:07:53.059407+0000","last_clean":"2023-10-16T20:07:53.059407+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.059407+0000","last_undegraded":"2023-10-16T20:07:53.059407+0000","last_fullsized":"2023-10-16T20:07:53.059407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051703+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:53.051703+0000","last_peered":"2023-10-16T20:07:53.051703+0000","last_clean":"2023-10-16T20:07:53.051703+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:53.051703+0000","last_undegraded":"2023-10-16T20:07:53.051703+0000","last_fullsized":"2023-10-16T20:07:53.051703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.048004+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:52.048004+0000","last_peered":"2023-10-16T20:07:52.048004+0000","last_clean":"2023-10-16T20:07:52.048004+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:52.048004+0000","last_undegraded":"2023-10-16T20:07:52.048004+0000","last_fullsized":"2023-10-16T20:07:52.048004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:31.854394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031171+0000","last_change":"2023-10-16T20:07:52.031171+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031171+0000","last_undegraded":"2023-10-16T20:07:52.031171+0000","last_fullsized":"2023-10-16T20:07:52.031171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042471+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:52.042471+0000","last_peered":"2023-10-16T20:07:52.042471+0000","last_clean":"2023-10-16T20:07:52.042471+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:52.042471+0000","last_undegraded":"2023-10-16T20:07:52.042471+0000","last_fullsized":"2023-10-16T20:07:52.042471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:52.002355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029979+0000","last_change":"2023-10-16T20:07:52.029979+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029979+0000","last_undegraded":"2023-10-16T20:07:52.029979+0000","last_fullsized":"2023-10-16T20:07:52.029979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.038234+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:52.038234+0000","last_peered":"2023-10-16T20:07:52.038234+0000","last_clean":"2023-10-16T20:07:52.038234+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:52.038234+0000","last_undegraded":"2023-10-16T20:07:52.038234+0000","last_fullsized":"2023-10-16T20:07:52.038234+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:31.838414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023892+0000","last_change":"2023-10-16T20:07:52.023892+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023892+0000","last_undegraded":"2023-10-16T20:07:52.023892+0000","last_fullsized":"2023-10-16T20:07:52.023892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.031280+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.031280+0000","last_peered":"2023-10-16T20:07:53.031280+0000","last_clean":"2023-10-16T20:07:53.031280+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.031280+0000","last_undegraded":"2023-10-16T20:07:53.031280+0000","last_fullsized":"2023-10-16T20:07:53.031280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051483+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:53.051483+0000","last_peered":"2023-10-16T20:07:53.051483+0000","last_clean":"2023-10-16T20:07:53.051483+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:53.051483+0000","last_undegraded":"2023-10-16T20:07:53.051483+0000","last_fullsized":"2023-10-16T20:07:53.051483+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027052+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.027052+0000","last_peered":"2023-10-16T20:07:53.027052+0000","last_clean":"2023-10-16T20:07:53.027052+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.027052+0000","last_undegraded":"2023-10-16T20:07:53.027052+0000","last_fullsized":"2023-10-16T20:07:53.027052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057204+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:53.057204+0000","last_peered":"2023-10-16T20:07:53.057204+0000","last_clean":"2023-10-16T20:07:53.057204+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:53.057204+0000","last_undegraded":"2023-10-16T20:07:53.057204+0000","last_fullsized":"2023-10-16T20:07:53.057204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047791+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:52.047791+0000","last_peered":"2023-10-16T20:07:52.047791+0000","last_clean":"2023-10-16T20:07:52.047791+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:52.047791+0000","last_undegraded":"2023-10-16T20:07:52.047791+0000","last_fullsized":"2023-10-16T20:07:52.047791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:36.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053686+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:53.053686+0000","last_peered":"2023-10-16T20:07:53.053686+0000","last_clean":"2023-10-16T20:07:53.053686+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:53.053686+0000","last_undegraded":"2023-10-16T20:07:53.053686+0000","last_fullsized":"2023-10-16T20:07:53.053686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.038910+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.038910+0000","last_peered":"2023-10-16T20:07:53.038910+0000","last_clean":"2023-10-16T20:07:53.038910+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.038910+0000","last_undegraded":"2023-10-16T20:07:53.038910+0000","last_fullsized":"2023-10-16T20:07:53.038910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.032672+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:52.032672+0000","last_peered":"2023-10-16T20:07:52.032672+0000","last_clean":"2023-10-16T20:07:52.032672+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:52.032672+0000","last_undegraded":"2023-10-16T20:07:52.032672+0000","last_fullsized":"2023-10-16T20:07:52.032672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":786692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.441}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.52800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.438}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.624}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.75},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":777885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.317},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.47099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.246}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.26300000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.77100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.315}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.375},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68600000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":195246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.5}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.379}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:07:57.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:07:57.293 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.291+0000 7f7c47eb1700 1 Processor -- start 2023-10-16T20:07:57.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.291+0000 7f7c47eb1700 1 -- start start 2023-10-16T20:07:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c47eb1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4015daa0 0x7f7c400af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c47eb1700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c400af560 0x7f7c40071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c47eb1700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4015ed10 con 0x7f7c40071d90 2023-10-16T20:07:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c47eb1700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c40072200 con 0x7f7c400af560 2023-10-16T20:07:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c47eb1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4015de80 con 0x7f7c4015daa0 2023-10-16T20:07:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c4544c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c400af560 0x7f7c40071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c4544c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c400af560 0x7f7c40071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60918/0 (socket says 172.21.15.152:60918) 2023-10-16T20:07:57.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.292+0000 7f7c4544c700 1 -- 172.21.15.152:0/224849557 learned_addr learned my addr 172.21.15.152:0/224849557 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:57.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c45c4d700 1 --2- 172.21.15.152:0/224849557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4015daa0 0x7f7c400af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c4544c700 1 -- 172.21.15.152:0/224849557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4015daa0 msgr2=0x7f7c400af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:57.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c4544c700 1 --2- 172.21.15.152:0/224849557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4015daa0 0x7f7c400af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c4544c700 1 -- 172.21.15.152:0/224849557 >> v1:172.21.15.163:6789/0 conn(0x7f7c40071d90 legacy=0x7f7c400ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c4544c700 1 -- 172.21.15.152:0/224849557 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4015e100 con 0x7f7c400af560 2023-10-16T20:07:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c4544c700 1 --2- 172.21.15.152:0/224849557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c400af560 0x7f7c40071850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0098f0 tx=0x7f7c3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11eb419690ce556 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c44c4b700 1 -- 172.21.15.152:0/224849557 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011830 con 0x7f7c400af560 2023-10-16T20:07:57.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c44c4b700 1 -- 172.21.15.152:0/224849557 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c011990 con 0x7f7c400af560 2023-10-16T20:07:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.293+0000 7f7c44c4b700 1 -- 172.21.15.152:0/224849557 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c011d20 con 0x7f7c400af560 2023-10-16T20:07:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 -- 172.21.15.152:0/224849557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c400af560 msgr2=0x7f7c40071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/224849557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c400af560 0x7f7c40071850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0098f0 tx=0x7f7c3c009c00 comp rx=0 tx=0).stop 2023-10-16T20:07:57.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 -- 172.21.15.152:0/224849557 shutdown_connections 2023-10-16T20:07:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/224849557 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c4015daa0 0x7f7c400af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/224849557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c400af560 0x7f7c40071850 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 -- 172.21.15.152:0/224849557 >> 172.21.15.152:0/224849557 conn(0x7f7c400d0180 msgr2=0x7f7c400d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 -- 172.21.15.152:0/224849557 shutdown_connections 2023-10-16T20:07:57.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.294+0000 7f7c47eb1700 1 -- 172.21.15.152:0/224849557 wait complete. 2023-10-16T20:07:57.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.295+0000 7f7c47eb1700 1 Processor -- start 2023-10-16T20:07:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.295+0000 7f7c47eb1700 1 -- start start 2023-10-16T20:07:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 0x7f7c400b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c400af560 0x7f7c400b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4015daa0 0x7f7c400b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400c4740 con 0x7f7c40071d90 2023-10-16T20:07:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400c4a20 con 0x7f7c4015daa0 2023-10-16T20:07:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400c4d00 con 0x7f7c400af560 2023-10-16T20:07:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 0x7f7c400b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 0x7f7c400b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60924/0 (socket says 172.21.15.152:60924) 2023-10-16T20:07:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 -- 172.21.15.152:0/824464024 learned_addr learned my addr 172.21.15.152:0/824464024 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c4544c700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c400af560 0x7f7c400b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c4644e700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4015daa0 0x7f7c400b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 -- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c400af560 msgr2=0x7f7c400b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c400af560 0x7f7c400b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 -- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4015daa0 msgr2=0x7f7c400b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4015daa0 0x7f7c400b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 -- 172.21.15.152:0/824464024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c009550 con 0x7f7c40071d90 2023-10-16T20:07:57.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c45c4d700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 0x7f7c400b18d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000e870 tx=0x7f7c3000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:57.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30009590 con 0x7f7c40071d90 2023-10-16T20:07:57.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30013680 con 0x7f7c40071d90 2023-10-16T20:07:57.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c400c4fe0 con 0x7f7c40071d90 2023-10-16T20:07:57.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300139f0 con 0x7f7c40071d90 2023-10-16T20:07:57.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.296+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c400c8300 con 0x7f7c40071d90 2023-10-16T20:07:57.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.297+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c400c86e0 con 0x7f7c40071d90 2023-10-16T20:07:57.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.298+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c30013b50 con 0x7f7c40071d90 2023-10-16T20:07:57.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.298+0000 7f7c367fc700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c2406af00 0x7f7c2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.298+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7c30089520 con 0x7f7c40071d90 2023-10-16T20:07:57.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.298+0000 7f7c4544c700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c2406af00 0x7f7c2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.298+0000 7f7c4544c700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c2406af00 0x7f7c2406d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009c40 tx=0x7f7c3c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:57.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.302+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c30054500 con 0x7f7c40071d90 2023-10-16T20:07:57.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.488+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c400c8550 con 0x7f7c2406af00 2023-10-16T20:07:57.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.496+0000 7f7c367fc700 1 -- 172.21.15.152:0/824464024 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286288 (secure 0 0 0) 0x7f7c400c8550 con 0x7f7c2406af00 2023-10-16T20:07:57.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:57.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c2406af00 msgr2=0x7f7c2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c2406af00 0x7f7c2406d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009c40 tx=0x7f7c3c008030 comp rx=0 tx=0).stop 2023-10-16T20:07:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 msgr2=0x7f7c400b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 0x7f7c400b18d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000e870 tx=0x7f7c3000eb80 comp rx=0 tx=0).stop 2023-10-16T20:07:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 shutdown_connections 2023-10-16T20:07:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f7c2406af00 0x7f7c2406d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c4015daa0 0x7f7c400b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c40071d90 0x7f7c400b18d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 --2- 172.21.15.152:0/824464024 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f7c400af560 0x7f7c400b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 >> 172.21.15.152:0/824464024 conn(0x7f7c400d0180 msgr2=0x7f7c400ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:57.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 shutdown_connections 2023-10-16T20:07:57.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.499+0000 7f7c47eb1700 1 -- 172.21.15.152:0/824464024 wait complete. 2023-10-16T20:07:57.506 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:07:57.513 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-10-16T20:07:56.785115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220896,"kb_used_data":4700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753824,"statfs":{"total":773094113280,"available":772867915776,"internally_reserved":0,"allocated":4812800,"data_stored":2712352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771237"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031007+0000","last_change":"2023-10-16T20:07:52.031007+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031007+0000","last_undegraded":"2023-10-16T20:07:52.031007+0000","last_fullsized":"2023-10-16T20:07:52.031007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031533+0000","last_change":"2023-10-16T20:07:52.031533+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031533+0000","last_undegraded":"2023-10-16T20:07:52.031533+0000","last_fullsized":"2023-10-16T20:07:52.031533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030317+0000","last_change":"2023-10-16T20:07:52.030317+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030317+0000","last_undegraded":"2023-10-16T20:07:52.030317+0000","last_fullsized":"2023-10-16T20:07:52.030317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026758+0000","last_change":"2023-10-16T20:07:52.026758+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026758+0000","last_undegraded":"2023-10-16T20:07:52.026758+0000","last_fullsized":"2023-10-16T20:07:52.026758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023238+0000","last_change":"2023-10-16T20:07:52.023238+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023238+0000","last_undegraded":"2023-10-16T20:07:52.023238+0000","last_fullsized":"2023-10-16T20:07:52.023238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024221+0000","last_change":"2023-10-16T20:07:52.024221+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024221+0000","last_undegraded":"2023-10-16T20:07:52.024221+0000","last_fullsized":"2023-10-16T20:07:52.024221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057581+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:53.057581+0000","last_peered":"2023-10-16T20:07:53.057581+0000","last_clean":"2023-10-16T20:07:53.057581+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:53.057581+0000","last_undegraded":"2023-10-16T20:07:53.057581+0000","last_fullsized":"2023-10-16T20:07:53.057581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029110+0000","last_change":"2023-10-16T20:07:52.029110+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029110+0000","last_undegraded":"2023-10-16T20:07:52.029110+0000","last_fullsized":"2023-10-16T20:07:52.029110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029061+0000","last_change":"2023-10-16T20:07:52.029061+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029061+0000","last_undegraded":"2023-10-16T20:07:52.029061+0000","last_fullsized":"2023-10-16T20:07:52.029061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054548+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:53.054548+0000","last_peered":"2023-10-16T20:07:53.054548+0000","last_clean":"2023-10-16T20:07:53.054548+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:53.054548+0000","last_undegraded":"2023-10-16T20:07:53.054548+0000","last_fullsized":"2023-10-16T20:07:53.054548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049101+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:53.049101+0000","last_peered":"2023-10-16T20:07:53.049101+0000","last_clean":"2023-10-16T20:07:53.049101+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:53.049101+0000","last_undegraded":"2023-10-16T20:07:53.049101+0000","last_fullsized":"2023-10-16T20:07:53.049101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.028894+0000","last_change":"2023-10-16T20:07:52.028894+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.028894+0000","last_undegraded":"2023-10-16T20:07:52.028894+0000","last_fullsized":"2023-10-16T20:07:52.028894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059021+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:53.059021+0000","last_peered":"2023-10-16T20:07:53.059021+0000","last_clean":"2023-10-16T20:07:53.059021+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:53.059021+0000","last_undegraded":"2023-10-16T20:07:53.059021+0000","last_fullsized":"2023-10-16T20:07:53.059021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:32.233089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046639+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:53.046639+0000","last_peered":"2023-10-16T20:07:53.046639+0000","last_clean":"2023-10-16T20:07:53.046639+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:53.046639+0000","last_undegraded":"2023-10-16T20:07:53.046639+0000","last_fullsized":"2023-10-16T20:07:53.046639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:43.628385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057625+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:53.057625+0000","last_peered":"2023-10-16T20:07:53.057625+0000","last_clean":"2023-10-16T20:07:53.057625+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:53.057625+0000","last_undegraded":"2023-10-16T20:07:53.057625+0000","last_fullsized":"2023-10-16T20:07:53.057625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061105+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:53.061105+0000","last_peered":"2023-10-16T20:07:53.061105+0000","last_clean":"2023-10-16T20:07:53.061105+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:53.061105+0000","last_undegraded":"2023-10-16T20:07:53.061105+0000","last_fullsized":"2023-10-16T20:07:53.061105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058587+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:53.058587+0000","last_peered":"2023-10-16T20:07:53.058587+0000","last_clean":"2023-10-16T20:07:53.058587+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:53.058587+0000","last_undegraded":"2023-10-16T20:07:53.058587+0000","last_fullsized":"2023-10-16T20:07:53.058587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044053+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:53.044053+0000","last_peered":"2023-10-16T20:07:53.044053+0000","last_clean":"2023-10-16T20:07:53.044053+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:53.044053+0000","last_undegraded":"2023-10-16T20:07:53.044053+0000","last_fullsized":"2023-10-16T20:07:53.044053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022817+0000","last_change":"2023-10-16T20:07:52.022817+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022817+0000","last_undegraded":"2023-10-16T20:07:52.022817+0000","last_fullsized":"2023-10-16T20:07:52.022817+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043928+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:53.043928+0000","last_peered":"2023-10-16T20:07:53.043928+0000","last_clean":"2023-10-16T20:07:53.043928+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:53.043928+0000","last_undegraded":"2023-10-16T20:07:53.043928+0000","last_fullsized":"2023-10-16T20:07:53.043928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047542+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:53.047542+0000","last_peered":"2023-10-16T20:07:53.047542+0000","last_clean":"2023-10-16T20:07:53.047542+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:53.047542+0000","last_undegraded":"2023-10-16T20:07:53.047542+0000","last_fullsized":"2023-10-16T20:07:53.047542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044878+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:53.044878+0000","last_peered":"2023-10-16T20:07:53.044878+0000","last_clean":"2023-10-16T20:07:53.044878+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:53.044878+0000","last_undegraded":"2023-10-16T20:07:53.044878+0000","last_fullsized":"2023-10-16T20:07:53.044878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058371+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:53.058371+0000","last_peered":"2023-10-16T20:07:53.058371+0000","last_clean":"2023-10-16T20:07:53.058371+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:53.058371+0000","last_undegraded":"2023-10-16T20:07:53.058371+0000","last_fullsized":"2023-10-16T20:07:53.058371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022950+0000","last_change":"2023-10-16T20:07:52.022950+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022950+0000","last_undegraded":"2023-10-16T20:07:52.022950+0000","last_fullsized":"2023-10-16T20:07:52.022950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048316+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:53.048316+0000","last_peered":"2023-10-16T20:07:53.048316+0000","last_clean":"2023-10-16T20:07:53.048316+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:53.048316+0000","last_undegraded":"2023-10-16T20:07:53.048316+0000","last_fullsized":"2023-10-16T20:07:53.048316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023649+0000","last_change":"2023-10-16T20:07:52.023649+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023649+0000","last_undegraded":"2023-10-16T20:07:52.023649+0000","last_fullsized":"2023-10-16T20:07:52.023649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044088+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:53.044088+0000","last_peered":"2023-10-16T20:07:53.044088+0000","last_clean":"2023-10-16T20:07:53.044088+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:53.044088+0000","last_undegraded":"2023-10-16T20:07:53.044088+0000","last_fullsized":"2023-10-16T20:07:53.044088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:04.826839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053823+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:53.053823+0000","last_peered":"2023-10-16T20:07:53.053823+0000","last_clean":"2023-10-16T20:07:53.053823+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:53.053823+0000","last_undegraded":"2023-10-16T20:07:53.053823+0000","last_fullsized":"2023-10-16T20:07:53.053823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039648+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:53.039648+0000","last_peered":"2023-10-16T20:07:53.039648+0000","last_clean":"2023-10-16T20:07:53.039648+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:53.039648+0000","last_undegraded":"2023-10-16T20:07:53.039648+0000","last_fullsized":"2023-10-16T20:07:53.039648+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046439+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:53.046439+0000","last_peered":"2023-10-16T20:07:53.046439+0000","last_clean":"2023-10-16T20:07:53.046439+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:53.046439+0000","last_undegraded":"2023-10-16T20:07:53.046439+0000","last_fullsized":"2023-10-16T20:07:53.046439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:19.669427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058280+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:53.058280+0000","last_peered":"2023-10-16T20:07:53.058280+0000","last_clean":"2023-10-16T20:07:53.058280+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:53.058280+0000","last_undegraded":"2023-10-16T20:07:53.058280+0000","last_fullsized":"2023-10-16T20:07:53.058280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:55.937988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023468+0000","last_change":"2023-10-16T20:07:52.023468+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023468+0000","last_undegraded":"2023-10-16T20:07:52.023468+0000","last_fullsized":"2023-10-16T20:07:52.023468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058965+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:53.058965+0000","last_peered":"2023-10-16T20:07:53.058965+0000","last_clean":"2023-10-16T20:07:53.058965+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:53.058965+0000","last_undegraded":"2023-10-16T20:07:53.058965+0000","last_fullsized":"2023-10-16T20:07:53.058965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053642+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.053642+0000","last_peered":"2023-10-16T20:07:53.053642+0000","last_clean":"2023-10-16T20:07:53.053642+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.053642+0000","last_undegraded":"2023-10-16T20:07:53.053642+0000","last_fullsized":"2023-10-16T20:07:53.053642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024074+0000","last_change":"2023-10-16T20:07:52.024074+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024074+0000","last_undegraded":"2023-10-16T20:07:52.024074+0000","last_fullsized":"2023-10-16T20:07:52.024074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042127+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:52.042127+0000","last_peered":"2023-10-16T20:07:52.042127+0000","last_clean":"2023-10-16T20:07:52.042127+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:52.042127+0000","last_undegraded":"2023-10-16T20:07:52.042127+0000","last_fullsized":"2023-10-16T20:07:52.042127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043820+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:53.043820+0000","last_peered":"2023-10-16T20:07:53.043820+0000","last_clean":"2023-10-16T20:07:53.043820+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:53.043820+0000","last_undegraded":"2023-10-16T20:07:53.043820+0000","last_fullsized":"2023-10-16T20:07:53.043820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:08.472229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041828+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:52.041828+0000","last_peered":"2023-10-16T20:07:52.041828+0000","last_clean":"2023-10-16T20:07:52.041828+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:52.041828+0000","last_undegraded":"2023-10-16T20:07:52.041828+0000","last_fullsized":"2023-10-16T20:07:52.041828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:34.051850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029761+0000","last_change":"2023-10-16T20:07:52.029761+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029761+0000","last_undegraded":"2023-10-16T20:07:52.029761+0000","last_fullsized":"2023-10-16T20:07:52.029761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054959+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.054959+0000","last_peered":"2023-10-16T20:07:53.054959+0000","last_clean":"2023-10-16T20:07:53.054959+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.054959+0000","last_undegraded":"2023-10-16T20:07:53.054959+0000","last_fullsized":"2023-10-16T20:07:53.054959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029609+0000","last_change":"2023-10-16T20:07:52.029609+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029609+0000","last_undegraded":"2023-10-16T20:07:52.029609+0000","last_fullsized":"2023-10-16T20:07:52.029609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059229+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.059229+0000","last_peered":"2023-10-16T20:07:53.059229+0000","last_clean":"2023-10-16T20:07:53.059229+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.059229+0000","last_undegraded":"2023-10-16T20:07:53.059229+0000","last_fullsized":"2023-10-16T20:07:53.059229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057603+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:53.057603+0000","last_peered":"2023-10-16T20:07:53.057603+0000","last_clean":"2023-10-16T20:07:53.057603+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:53.057603+0000","last_undegraded":"2023-10-16T20:07:53.057603+0000","last_fullsized":"2023-10-16T20:07:53.057603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056263+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.056263+0000","last_peered":"2023-10-16T20:07:53.056263+0000","last_clean":"2023-10-16T20:07:53.056263+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.056263+0000","last_undegraded":"2023-10-16T20:07:53.056263+0000","last_fullsized":"2023-10-16T20:07:53.056263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044858+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:53.044858+0000","last_peered":"2023-10-16T20:07:53.044858+0000","last_clean":"2023-10-16T20:07:53.044858+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:53.044858+0000","last_undegraded":"2023-10-16T20:07:53.044858+0000","last_fullsized":"2023-10-16T20:07:53.044858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042945+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:52.042945+0000","last_peered":"2023-10-16T20:07:52.042945+0000","last_clean":"2023-10-16T20:07:52.042945+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:52.042945+0000","last_undegraded":"2023-10-16T20:07:52.042945+0000","last_fullsized":"2023-10-16T20:07:52.042945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:05.950966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030529+0000","last_change":"2023-10-16T20:07:52.030529+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030529+0000","last_undegraded":"2023-10-16T20:07:52.030529+0000","last_fullsized":"2023-10-16T20:07:52.030529+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026881+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.026881+0000","last_peered":"2023-10-16T20:07:53.026881+0000","last_clean":"2023-10-16T20:07:53.026881+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.026881+0000","last_undegraded":"2023-10-16T20:07:53.026881+0000","last_fullsized":"2023-10-16T20:07:53.026881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026213+0000","last_change":"2023-10-16T20:07:52.026213+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026213+0000","last_undegraded":"2023-10-16T20:07:52.026213+0000","last_fullsized":"2023-10-16T20:07:52.026213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047820+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:52.047820+0000","last_peered":"2023-10-16T20:07:52.047820+0000","last_clean":"2023-10-16T20:07:52.047820+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:52.047820+0000","last_undegraded":"2023-10-16T20:07:52.047820+0000","last_fullsized":"2023-10-16T20:07:52.047820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:08.428897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051679+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:53.051679+0000","last_peered":"2023-10-16T20:07:53.051679+0000","last_clean":"2023-10-16T20:07:53.051679+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:53.051679+0000","last_undegraded":"2023-10-16T20:07:53.051679+0000","last_fullsized":"2023-10-16T20:07:53.051679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.033944+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.033944+0000","last_peered":"2023-10-16T20:07:53.033944+0000","last_clean":"2023-10-16T20:07:53.033944+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.033944+0000","last_undegraded":"2023-10-16T20:07:53.033944+0000","last_fullsized":"2023-10-16T20:07:53.033944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026682+0000","last_change":"2023-10-16T20:07:52.026682+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026682+0000","last_undegraded":"2023-10-16T20:07:52.026682+0000","last_fullsized":"2023-10-16T20:07:52.026682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059565+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.059565+0000","last_peered":"2023-10-16T20:07:53.059565+0000","last_clean":"2023-10-16T20:07:53.059565+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.059565+0000","last_undegraded":"2023-10-16T20:07:53.059565+0000","last_fullsized":"2023-10-16T20:07:53.059565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.040882+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:53.040882+0000","last_peered":"2023-10-16T20:07:53.040882+0000","last_clean":"2023-10-16T20:07:53.040882+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:53.040882+0000","last_undegraded":"2023-10-16T20:07:53.040882+0000","last_fullsized":"2023-10-16T20:07:53.040882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:50:27.554553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041965+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:52.041965+0000","last_peered":"2023-10-16T20:07:52.041965+0000","last_clean":"2023-10-16T20:07:52.041965+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:52.041965+0000","last_undegraded":"2023-10-16T20:07:52.041965+0000","last_fullsized":"2023-10-16T20:07:52.041965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031459+0000","last_change":"2023-10-16T20:07:52.031459+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031459+0000","last_undegraded":"2023-10-16T20:07:52.031459+0000","last_fullsized":"2023-10-16T20:07:52.031459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041928+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:52.041928+0000","last_peered":"2023-10-16T20:07:52.041928+0000","last_clean":"2023-10-16T20:07:52.041928+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:52.041928+0000","last_undegraded":"2023-10-16T20:07:52.041928+0000","last_fullsized":"2023-10-16T20:07:52.041928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030508+0000","last_change":"2023-10-16T20:07:52.030508+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030508+0000","last_undegraded":"2023-10-16T20:07:52.030508+0000","last_fullsized":"2023-10-16T20:07:52.030508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042918+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:52.042918+0000","last_peered":"2023-10-16T20:07:52.042918+0000","last_clean":"2023-10-16T20:07:52.042918+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:52.042918+0000","last_undegraded":"2023-10-16T20:07:52.042918+0000","last_fullsized":"2023-10-16T20:07:52.042918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:15:03.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058375+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:53.058375+0000","last_peered":"2023-10-16T20:07:53.058375+0000","last_clean":"2023-10-16T20:07:53.058375+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:53.058375+0000","last_undegraded":"2023-10-16T20:07:53.058375+0000","last_fullsized":"2023-10-16T20:07:53.058375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.030393+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.030393+0000","last_peered":"2023-10-16T20:07:53.030393+0000","last_clean":"2023-10-16T20:07:53.030393+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.030393+0000","last_undegraded":"2023-10-16T20:07:53.030393+0000","last_fullsized":"2023-10-16T20:07:53.030393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031776+0000","last_change":"2023-10-16T20:07:52.031776+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031776+0000","last_undegraded":"2023-10-16T20:07:52.031776+0000","last_fullsized":"2023-10-16T20:07:52.031776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058435+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.058435+0000","last_peered":"2023-10-16T20:07:53.058435+0000","last_clean":"2023-10-16T20:07:53.058435+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.058435+0000","last_undegraded":"2023-10-16T20:07:53.058435+0000","last_fullsized":"2023-10-16T20:07:53.058435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030964+0000","last_change":"2023-10-16T20:07:52.030964+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030964+0000","last_undegraded":"2023-10-16T20:07:52.030964+0000","last_fullsized":"2023-10-16T20:07:52.030964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059421+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.059421+0000","last_peered":"2023-10-16T20:07:53.059421+0000","last_clean":"2023-10-16T20:07:53.059421+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.059421+0000","last_undegraded":"2023-10-16T20:07:53.059421+0000","last_fullsized":"2023-10-16T20:07:53.059421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049131+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:53.049131+0000","last_peered":"2023-10-16T20:07:53.049131+0000","last_clean":"2023-10-16T20:07:53.049131+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:53.049131+0000","last_undegraded":"2023-10-16T20:07:53.049131+0000","last_fullsized":"2023-10-16T20:07:53.049131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059748+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.059748+0000","last_peered":"2023-10-16T20:07:53.059748+0000","last_clean":"2023-10-16T20:07:53.059748+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.059748+0000","last_undegraded":"2023-10-16T20:07:53.059748+0000","last_fullsized":"2023-10-16T20:07:53.059748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.035583+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:53.035583+0000","last_peered":"2023-10-16T20:07:53.035583+0000","last_clean":"2023-10-16T20:07:53.035583+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:53.035583+0000","last_undegraded":"2023-10-16T20:07:53.035583+0000","last_fullsized":"2023-10-16T20:07:53.035583+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:46.637846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.046676+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:52.046676+0000","last_peered":"2023-10-16T20:07:52.046676+0000","last_clean":"2023-10-16T20:07:52.046676+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:52.046676+0000","last_undegraded":"2023-10-16T20:07:52.046676+0000","last_fullsized":"2023-10-16T20:07:52.046676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.338270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022700+0000","last_change":"2023-10-16T20:07:52.022700+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022700+0000","last_undegraded":"2023-10-16T20:07:52.022700+0000","last_fullsized":"2023-10-16T20:07:52.022700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042882+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:52.042882+0000","last_peered":"2023-10-16T20:07:52.042882+0000","last_clean":"2023-10-16T20:07:52.042882+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:52.042882+0000","last_undegraded":"2023-10-16T20:07:52.042882+0000","last_fullsized":"2023-10-16T20:07:52.042882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:40:45.795652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061085+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:53.061085+0000","last_peered":"2023-10-16T20:07:53.061085+0000","last_clean":"2023-10-16T20:07:53.061085+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:53.061085+0000","last_undegraded":"2023-10-16T20:07:53.061085+0000","last_fullsized":"2023-10-16T20:07:53.061085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.045283+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:52.045283+0000","last_peered":"2023-10-16T20:07:52.045283+0000","last_clean":"2023-10-16T20:07:52.045283+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:52.045283+0000","last_undegraded":"2023-10-16T20:07:52.045283+0000","last_fullsized":"2023-10-16T20:07:52.045283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:51:54.049368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026256+0000","last_change":"2023-10-16T20:07:52.026256+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026256+0000","last_undegraded":"2023-10-16T20:07:52.026256+0000","last_fullsized":"2023-10-16T20:07:52.026256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.036592+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:52.036592+0000","last_peered":"2023-10-16T20:07:52.036592+0000","last_clean":"2023-10-16T20:07:52.036592+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:52.036592+0000","last_undegraded":"2023-10-16T20:07:52.036592+0000","last_fullsized":"2023-10-16T20:07:52.036592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:37.418051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047612+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:53.047612+0000","last_peered":"2023-10-16T20:07:53.047612+0000","last_clean":"2023-10-16T20:07:53.047612+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:53.047612+0000","last_undegraded":"2023-10-16T20:07:53.047612+0000","last_fullsized":"2023-10-16T20:07:53.047612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039862+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.039862+0000","last_peered":"2023-10-16T20:07:53.039862+0000","last_clean":"2023-10-16T20:07:53.039862+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.039862+0000","last_undegraded":"2023-10-16T20:07:53.039862+0000","last_fullsized":"2023-10-16T20:07:53.039862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031403+0000","last_change":"2023-10-16T20:07:52.031403+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031403+0000","last_undegraded":"2023-10-16T20:07:52.031403+0000","last_fullsized":"2023-10-16T20:07:52.031403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047948+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:52.047948+0000","last_peered":"2023-10-16T20:07:52.047948+0000","last_clean":"2023-10-16T20:07:52.047948+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:52.047948+0000","last_undegraded":"2023-10-16T20:07:52.047948+0000","last_fullsized":"2023-10-16T20:07:52.047948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:19.523829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.025011+0000","last_change":"2023-10-16T20:07:52.025011+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.025011+0000","last_undegraded":"2023-10-16T20:07:52.025011+0000","last_fullsized":"2023-10-16T20:07:52.025011+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059407+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.059407+0000","last_peered":"2023-10-16T20:07:53.059407+0000","last_clean":"2023-10-16T20:07:53.059407+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.059407+0000","last_undegraded":"2023-10-16T20:07:53.059407+0000","last_fullsized":"2023-10-16T20:07:53.059407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051703+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:53.051703+0000","last_peered":"2023-10-16T20:07:53.051703+0000","last_clean":"2023-10-16T20:07:53.051703+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:53.051703+0000","last_undegraded":"2023-10-16T20:07:53.051703+0000","last_fullsized":"2023-10-16T20:07:53.051703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.048004+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:52.048004+0000","last_peered":"2023-10-16T20:07:52.048004+0000","last_clean":"2023-10-16T20:07:52.048004+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:52.048004+0000","last_undegraded":"2023-10-16T20:07:52.048004+0000","last_fullsized":"2023-10-16T20:07:52.048004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:31.854394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031171+0000","last_change":"2023-10-16T20:07:52.031171+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031171+0000","last_undegraded":"2023-10-16T20:07:52.031171+0000","last_fullsized":"2023-10-16T20:07:52.031171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042471+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:52.042471+0000","last_peered":"2023-10-16T20:07:52.042471+0000","last_clean":"2023-10-16T20:07:52.042471+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:52.042471+0000","last_undegraded":"2023-10-16T20:07:52.042471+0000","last_fullsized":"2023-10-16T20:07:52.042471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:52.002355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029979+0000","last_change":"2023-10-16T20:07:52.029979+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029979+0000","last_undegraded":"2023-10-16T20:07:52.029979+0000","last_fullsized":"2023-10-16T20:07:52.029979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.038234+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:52.038234+0000","last_peered":"2023-10-16T20:07:52.038234+0000","last_clean":"2023-10-16T20:07:52.038234+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:52.038234+0000","last_undegraded":"2023-10-16T20:07:52.038234+0000","last_fullsized":"2023-10-16T20:07:52.038234+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:31.838414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023892+0000","last_change":"2023-10-16T20:07:52.023892+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023892+0000","last_undegraded":"2023-10-16T20:07:52.023892+0000","last_fullsized":"2023-10-16T20:07:52.023892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.031280+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.031280+0000","last_peered":"2023-10-16T20:07:53.031280+0000","last_clean":"2023-10-16T20:07:53.031280+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.031280+0000","last_undegraded":"2023-10-16T20:07:53.031280+0000","last_fullsized":"2023-10-16T20:07:53.031280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051483+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:53.051483+0000","last_peered":"2023-10-16T20:07:53.051483+0000","last_clean":"2023-10-16T20:07:53.051483+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:53.051483+0000","last_undegraded":"2023-10-16T20:07:53.051483+0000","last_fullsized":"2023-10-16T20:07:53.051483+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027052+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.027052+0000","last_peered":"2023-10-16T20:07:53.027052+0000","last_clean":"2023-10-16T20:07:53.027052+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.027052+0000","last_undegraded":"2023-10-16T20:07:53.027052+0000","last_fullsized":"2023-10-16T20:07:53.027052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057204+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:53.057204+0000","last_peered":"2023-10-16T20:07:53.057204+0000","last_clean":"2023-10-16T20:07:53.057204+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:53.057204+0000","last_undegraded":"2023-10-16T20:07:53.057204+0000","last_fullsized":"2023-10-16T20:07:53.057204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047791+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:52.047791+0000","last_peered":"2023-10-16T20:07:52.047791+0000","last_clean":"2023-10-16T20:07:52.047791+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:52.047791+0000","last_undegraded":"2023-10-16T20:07:52.047791+0000","last_fullsized":"2023-10-16T20:07:52.047791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:36.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053686+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:53.053686+0000","last_peered":"2023-10-16T20:07:53.053686+0000","last_clean":"2023-10-16T20:07:53.053686+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:53.053686+0000","last_undegraded":"2023-10-16T20:07:53.053686+0000","last_fullsized":"2023-10-16T20:07:53.053686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.038910+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.038910+0000","last_peered":"2023-10-16T20:07:53.038910+0000","last_clean":"2023-10-16T20:07:53.038910+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.038910+0000","last_undegraded":"2023-10-16T20:07:53.038910+0000","last_fullsized":"2023-10-16T20:07:53.038910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.032672+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:52.032672+0000","last_peered":"2023-10-16T20:07:52.032672+0000","last_clean":"2023-10-16T20:07:52.032672+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:52.032672+0000","last_undegraded":"2023-10-16T20:07:52.032672+0000","last_fullsized":"2023-10-16T20:07:52.032672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":786692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.441}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.52800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.438}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.624}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.75},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":777885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.317},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.47099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.246}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.26300000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.77100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.315}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.375},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68600000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":195246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.5}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.379}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:07:57.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:07:57.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.672+0000 7f5b69440700 1 Processor -- start 2023-10-16T20:07:57.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.672+0000 7f5b69440700 1 -- start start 2023-10-16T20:07:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b69440700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b640b5700 0x7f5b640cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b69440700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5b640b9000 0x7f5b640ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b69440700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b640b94b0 con 0x7f5b64160b50 2023-10-16T20:07:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b69440700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b640d0010 con 0x7f5b640b9000 2023-10-16T20:07:57.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b69440700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640d02f0 con 0x7f5b640b5700 2023-10-16T20:07:57.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5b640b9000 0x7f5b640ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5b640b9000 0x7f5b640ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60936/0 (socket says 172.21.15.152:60936) 2023-10-16T20:07:57.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 -- 172.21.15.152:0/4075789649 learned_addr learned my addr 172.21.15.152:0/4075789649 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:57.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b627fc700 1 --2- 172.21.15.152:0/4075789649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b640b5700 0x7f5b640cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 -- 172.21.15.152:0/4075789649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b640b5700 msgr2=0x7f5b640cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:57.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 --2- 172.21.15.152:0/4075789649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b640b5700 0x7f5b640cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 -- 172.21.15.152:0/4075789649 >> v1:172.21.15.163:6789/0 conn(0x7f5b64160b50 legacy=0x7f5b640b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:57.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 -- 172.21.15.152:0/4075789649 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640d05d0 con 0x7f5b640b9000 2023-10-16T20:07:57.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b637fe700 1 --2- 172.21.15.152:0/4075789649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640ce680 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009e50 tx=0x7f5b5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d25cc09645a61a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:57.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.673+0000 7f5b61ffb700 1 -- 172.21.15.152:0/4075789649 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00e070 con 0x7f5b640b9000 2023-10-16T20:07:57.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b61ffb700 1 -- 172.21.15.152:0/4075789649 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c003a20 con 0x7f5b640b9000 2023-10-16T20:07:57.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b61ffb700 1 -- 172.21.15.152:0/4075789649 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c003dd0 con 0x7f5b640b9000 2023-10-16T20:07:57.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 -- 172.21.15.152:0/4075789649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 msgr2=0x7f5b640ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 --2- 172.21.15.152:0/4075789649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640ce680 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009e50 tx=0x7f5b5c00b330 comp rx=0 tx=0).stop 2023-10-16T20:07:57.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 -- 172.21.15.152:0/4075789649 shutdown_connections 2023-10-16T20:07:57.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 --2- 172.21.15.152:0/4075789649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640ce680 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 --2- 172.21.15.152:0/4075789649 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b640b5700 0x7f5b640cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 -- 172.21.15.152:0/4075789649 >> 172.21.15.152:0/4075789649 conn(0x7f5b6406bc70 msgr2=0x7f5b6406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:57.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 -- 172.21.15.152:0/4075789649 shutdown_connections 2023-10-16T20:07:57.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.674+0000 7f5b69440700 1 -- 172.21.15.152:0/4075789649 wait complete. 2023-10-16T20:07:57.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.675+0000 7f5b69440700 1 Processor -- start 2023-10-16T20:07:57.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 -- start start 2023-10-16T20:07:57.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b640b5700 0x7f5b6415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b64160b50 0x7f5b640c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640d1d60 con 0x7f5b640b9000 2023-10-16T20:07:57.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6415b2c0 con 0x7f5b640b5700 2023-10-16T20:07:57.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b69440700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6415b5a0 con 0x7f5b64160b50 2023-10-16T20:07:57.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b627fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b627fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640d1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60940/0 (socket says 172.21.15.152:60940) 2023-10-16T20:07:57.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.676+0000 7f5b627fc700 1 -- 172.21.15.152:0/3431134599 learned_addr learned my addr 172.21.15.152:0/3431134599 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:57.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b627fc700 1 -- 172.21.15.152:0/3431134599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b64160b50 msgr2=0x7f5b640c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b627fc700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b64160b50 0x7f5b640c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b627fc700 1 -- 172.21.15.152:0/3431134599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b640b5700 msgr2=0x7f5b6415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b627fc700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b640b5700 0x7f5b6415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b627fc700 1 -- 172.21.15.152:0/3431134599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009b30 con 0x7f5b640b9000 2023-10-16T20:07:57.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b627fc700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640d1820 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400c7f0 tx=0x7f5b5400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:57.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011800 con 0x7f5b640b9000 2023-10-16T20:07:57.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b54011960 con 0x7f5b640b9000 2023-10-16T20:07:57.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6415b880 con 0x7f5b640b9000 2023-10-16T20:07:57.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011cf0 con 0x7f5b640b9000 2023-10-16T20:07:57.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.677+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6415be40 con 0x7f5b640b9000 2023-10-16T20:07:57.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.678+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6415c060 con 0x7f5b640b9000 2023-10-16T20:07:57.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.678+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5b54018360 con 0x7f5b640b9000 2023-10-16T20:07:57.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.679+0000 7f5b4b7fe700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5b5006af00 0x7f5b5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:57.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.679+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5b54089720 con 0x7f5b640b9000 2023-10-16T20:07:57.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.679+0000 7f5b62ffd700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5b5006af00 0x7f5b5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:57.689 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.679+0000 7f5b62ffd700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5b5006af00 0x7f5b5006d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5b580096f0 tx=0x7f5b58006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:57.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.683+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b54054680 con 0x7f5b640b9000 2023-10-16T20:07:57.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.868+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b64160f30 con 0x7f5b5006af00 2023-10-16T20:07:57.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.875+0000 7f5b4b7fe700 1 -- 172.21.15.152:0/3431134599 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286288 (secure 0 0 0) 0x7f5b58009390 con 0x7f5b5006af00 2023-10-16T20:07:57.881 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:57.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5b5006af00 msgr2=0x7f5b5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5b5006af00 0x7f5b5006d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5b580096f0 tx=0x7f5b58006c50 comp rx=0 tx=0).stop 2023-10-16T20:07:57.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 msgr2=0x7f5b640d1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640d1820 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400c7f0 tx=0x7f5b5400cbb0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 shutdown_connections 2023-10-16T20:07:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5b5006af00 0x7f5b5006d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f5b64160b50 0x7f5b640c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b640b5700 0x7f5b6415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 --2- 172.21.15.152:0/3431134599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b640b9000 0x7f5b640d1820 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 >> 172.21.15.152:0/3431134599 conn(0x7f5b6406bc70 msgr2=0x7f5b6406c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 shutdown_connections 2023-10-16T20:07:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:57.879+0000 7f5b69440700 1 -- 172.21.15.152:0/3431134599 wait complete. 2023-10-16T20:07:57.885 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:07:57.893 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-10-16T20:07:56.785115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220896,"kb_used_data":4700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753824,"statfs":{"total":773094113280,"available":772867915776,"internally_reserved":0,"allocated":4812800,"data_stored":2712352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771237"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031007+0000","last_change":"2023-10-16T20:07:52.031007+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031007+0000","last_undegraded":"2023-10-16T20:07:52.031007+0000","last_fullsized":"2023-10-16T20:07:52.031007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031533+0000","last_change":"2023-10-16T20:07:52.031533+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031533+0000","last_undegraded":"2023-10-16T20:07:52.031533+0000","last_fullsized":"2023-10-16T20:07:52.031533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030317+0000","last_change":"2023-10-16T20:07:52.030317+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030317+0000","last_undegraded":"2023-10-16T20:07:52.030317+0000","last_fullsized":"2023-10-16T20:07:52.030317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026758+0000","last_change":"2023-10-16T20:07:52.026758+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026758+0000","last_undegraded":"2023-10-16T20:07:52.026758+0000","last_fullsized":"2023-10-16T20:07:52.026758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023238+0000","last_change":"2023-10-16T20:07:52.023238+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023238+0000","last_undegraded":"2023-10-16T20:07:52.023238+0000","last_fullsized":"2023-10-16T20:07:52.023238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024221+0000","last_change":"2023-10-16T20:07:52.024221+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024221+0000","last_undegraded":"2023-10-16T20:07:52.024221+0000","last_fullsized":"2023-10-16T20:07:52.024221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057581+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:53.057581+0000","last_peered":"2023-10-16T20:07:53.057581+0000","last_clean":"2023-10-16T20:07:53.057581+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:53.057581+0000","last_undegraded":"2023-10-16T20:07:53.057581+0000","last_fullsized":"2023-10-16T20:07:53.057581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029110+0000","last_change":"2023-10-16T20:07:52.029110+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029110+0000","last_undegraded":"2023-10-16T20:07:52.029110+0000","last_fullsized":"2023-10-16T20:07:52.029110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029061+0000","last_change":"2023-10-16T20:07:52.029061+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029061+0000","last_undegraded":"2023-10-16T20:07:52.029061+0000","last_fullsized":"2023-10-16T20:07:52.029061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054548+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:53.054548+0000","last_peered":"2023-10-16T20:07:53.054548+0000","last_clean":"2023-10-16T20:07:53.054548+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:53.054548+0000","last_undegraded":"2023-10-16T20:07:53.054548+0000","last_fullsized":"2023-10-16T20:07:53.054548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049101+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:53.049101+0000","last_peered":"2023-10-16T20:07:53.049101+0000","last_clean":"2023-10-16T20:07:53.049101+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:53.049101+0000","last_undegraded":"2023-10-16T20:07:53.049101+0000","last_fullsized":"2023-10-16T20:07:53.049101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.028894+0000","last_change":"2023-10-16T20:07:52.028894+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.028894+0000","last_undegraded":"2023-10-16T20:07:52.028894+0000","last_fullsized":"2023-10-16T20:07:52.028894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059021+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:53.059021+0000","last_peered":"2023-10-16T20:07:53.059021+0000","last_clean":"2023-10-16T20:07:53.059021+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:53.059021+0000","last_undegraded":"2023-10-16T20:07:53.059021+0000","last_fullsized":"2023-10-16T20:07:53.059021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:32.233089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046639+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:53.046639+0000","last_peered":"2023-10-16T20:07:53.046639+0000","last_clean":"2023-10-16T20:07:53.046639+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:53.046639+0000","last_undegraded":"2023-10-16T20:07:53.046639+0000","last_fullsized":"2023-10-16T20:07:53.046639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:43.628385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057625+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:53.057625+0000","last_peered":"2023-10-16T20:07:53.057625+0000","last_clean":"2023-10-16T20:07:53.057625+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:53.057625+0000","last_undegraded":"2023-10-16T20:07:53.057625+0000","last_fullsized":"2023-10-16T20:07:53.057625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061105+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:53.061105+0000","last_peered":"2023-10-16T20:07:53.061105+0000","last_clean":"2023-10-16T20:07:53.061105+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:53.061105+0000","last_undegraded":"2023-10-16T20:07:53.061105+0000","last_fullsized":"2023-10-16T20:07:53.061105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058587+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:53.058587+0000","last_peered":"2023-10-16T20:07:53.058587+0000","last_clean":"2023-10-16T20:07:53.058587+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:53.058587+0000","last_undegraded":"2023-10-16T20:07:53.058587+0000","last_fullsized":"2023-10-16T20:07:53.058587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044053+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:53.044053+0000","last_peered":"2023-10-16T20:07:53.044053+0000","last_clean":"2023-10-16T20:07:53.044053+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:53.044053+0000","last_undegraded":"2023-10-16T20:07:53.044053+0000","last_fullsized":"2023-10-16T20:07:53.044053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022817+0000","last_change":"2023-10-16T20:07:52.022817+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022817+0000","last_undegraded":"2023-10-16T20:07:52.022817+0000","last_fullsized":"2023-10-16T20:07:52.022817+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043928+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:53.043928+0000","last_peered":"2023-10-16T20:07:53.043928+0000","last_clean":"2023-10-16T20:07:53.043928+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:53.043928+0000","last_undegraded":"2023-10-16T20:07:53.043928+0000","last_fullsized":"2023-10-16T20:07:53.043928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047542+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:53.047542+0000","last_peered":"2023-10-16T20:07:53.047542+0000","last_clean":"2023-10-16T20:07:53.047542+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:53.047542+0000","last_undegraded":"2023-10-16T20:07:53.047542+0000","last_fullsized":"2023-10-16T20:07:53.047542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044878+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:53.044878+0000","last_peered":"2023-10-16T20:07:53.044878+0000","last_clean":"2023-10-16T20:07:53.044878+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:53.044878+0000","last_undegraded":"2023-10-16T20:07:53.044878+0000","last_fullsized":"2023-10-16T20:07:53.044878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058371+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:53.058371+0000","last_peered":"2023-10-16T20:07:53.058371+0000","last_clean":"2023-10-16T20:07:53.058371+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:53.058371+0000","last_undegraded":"2023-10-16T20:07:53.058371+0000","last_fullsized":"2023-10-16T20:07:53.058371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022950+0000","last_change":"2023-10-16T20:07:52.022950+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022950+0000","last_undegraded":"2023-10-16T20:07:52.022950+0000","last_fullsized":"2023-10-16T20:07:52.022950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048316+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:53.048316+0000","last_peered":"2023-10-16T20:07:53.048316+0000","last_clean":"2023-10-16T20:07:53.048316+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:53.048316+0000","last_undegraded":"2023-10-16T20:07:53.048316+0000","last_fullsized":"2023-10-16T20:07:53.048316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023649+0000","last_change":"2023-10-16T20:07:52.023649+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023649+0000","last_undegraded":"2023-10-16T20:07:52.023649+0000","last_fullsized":"2023-10-16T20:07:52.023649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044088+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:53.044088+0000","last_peered":"2023-10-16T20:07:53.044088+0000","last_clean":"2023-10-16T20:07:53.044088+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:53.044088+0000","last_undegraded":"2023-10-16T20:07:53.044088+0000","last_fullsized":"2023-10-16T20:07:53.044088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:04.826839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053823+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:53.053823+0000","last_peered":"2023-10-16T20:07:53.053823+0000","last_clean":"2023-10-16T20:07:53.053823+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:53.053823+0000","last_undegraded":"2023-10-16T20:07:53.053823+0000","last_fullsized":"2023-10-16T20:07:53.053823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039648+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:53.039648+0000","last_peered":"2023-10-16T20:07:53.039648+0000","last_clean":"2023-10-16T20:07:53.039648+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:53.039648+0000","last_undegraded":"2023-10-16T20:07:53.039648+0000","last_fullsized":"2023-10-16T20:07:53.039648+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046439+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:53.046439+0000","last_peered":"2023-10-16T20:07:53.046439+0000","last_clean":"2023-10-16T20:07:53.046439+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:53.046439+0000","last_undegraded":"2023-10-16T20:07:53.046439+0000","last_fullsized":"2023-10-16T20:07:53.046439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:19.669427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058280+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:53.058280+0000","last_peered":"2023-10-16T20:07:53.058280+0000","last_clean":"2023-10-16T20:07:53.058280+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:53.058280+0000","last_undegraded":"2023-10-16T20:07:53.058280+0000","last_fullsized":"2023-10-16T20:07:53.058280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:55.937988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023468+0000","last_change":"2023-10-16T20:07:52.023468+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023468+0000","last_undegraded":"2023-10-16T20:07:52.023468+0000","last_fullsized":"2023-10-16T20:07:52.023468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058965+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:53.058965+0000","last_peered":"2023-10-16T20:07:53.058965+0000","last_clean":"2023-10-16T20:07:53.058965+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:53.058965+0000","last_undegraded":"2023-10-16T20:07:53.058965+0000","last_fullsized":"2023-10-16T20:07:53.058965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053642+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.053642+0000","last_peered":"2023-10-16T20:07:53.053642+0000","last_clean":"2023-10-16T20:07:53.053642+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.053642+0000","last_undegraded":"2023-10-16T20:07:53.053642+0000","last_fullsized":"2023-10-16T20:07:53.053642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024074+0000","last_change":"2023-10-16T20:07:52.024074+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024074+0000","last_undegraded":"2023-10-16T20:07:52.024074+0000","last_fullsized":"2023-10-16T20:07:52.024074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042127+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:52.042127+0000","last_peered":"2023-10-16T20:07:52.042127+0000","last_clean":"2023-10-16T20:07:52.042127+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:52.042127+0000","last_undegraded":"2023-10-16T20:07:52.042127+0000","last_fullsized":"2023-10-16T20:07:52.042127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043820+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:53.043820+0000","last_peered":"2023-10-16T20:07:53.043820+0000","last_clean":"2023-10-16T20:07:53.043820+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:53.043820+0000","last_undegraded":"2023-10-16T20:07:53.043820+0000","last_fullsized":"2023-10-16T20:07:53.043820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:08.472229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041828+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:52.041828+0000","last_peered":"2023-10-16T20:07:52.041828+0000","last_clean":"2023-10-16T20:07:52.041828+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:52.041828+0000","last_undegraded":"2023-10-16T20:07:52.041828+0000","last_fullsized":"2023-10-16T20:07:52.041828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:34.051850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029761+0000","last_change":"2023-10-16T20:07:52.029761+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029761+0000","last_undegraded":"2023-10-16T20:07:52.029761+0000","last_fullsized":"2023-10-16T20:07:52.029761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054959+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.054959+0000","last_peered":"2023-10-16T20:07:53.054959+0000","last_clean":"2023-10-16T20:07:53.054959+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.054959+0000","last_undegraded":"2023-10-16T20:07:53.054959+0000","last_fullsized":"2023-10-16T20:07:53.054959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029609+0000","last_change":"2023-10-16T20:07:52.029609+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029609+0000","last_undegraded":"2023-10-16T20:07:52.029609+0000","last_fullsized":"2023-10-16T20:07:52.029609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059229+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.059229+0000","last_peered":"2023-10-16T20:07:53.059229+0000","last_clean":"2023-10-16T20:07:53.059229+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.059229+0000","last_undegraded":"2023-10-16T20:07:53.059229+0000","last_fullsized":"2023-10-16T20:07:53.059229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057603+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:53.057603+0000","last_peered":"2023-10-16T20:07:53.057603+0000","last_clean":"2023-10-16T20:07:53.057603+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:53.057603+0000","last_undegraded":"2023-10-16T20:07:53.057603+0000","last_fullsized":"2023-10-16T20:07:53.057603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056263+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.056263+0000","last_peered":"2023-10-16T20:07:53.056263+0000","last_clean":"2023-10-16T20:07:53.056263+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.056263+0000","last_undegraded":"2023-10-16T20:07:53.056263+0000","last_fullsized":"2023-10-16T20:07:53.056263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044858+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:53.044858+0000","last_peered":"2023-10-16T20:07:53.044858+0000","last_clean":"2023-10-16T20:07:53.044858+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:53.044858+0000","last_undegraded":"2023-10-16T20:07:53.044858+0000","last_fullsized":"2023-10-16T20:07:53.044858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042945+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:52.042945+0000","last_peered":"2023-10-16T20:07:52.042945+0000","last_clean":"2023-10-16T20:07:52.042945+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:52.042945+0000","last_undegraded":"2023-10-16T20:07:52.042945+0000","last_fullsized":"2023-10-16T20:07:52.042945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:05.950966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030529+0000","last_change":"2023-10-16T20:07:52.030529+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030529+0000","last_undegraded":"2023-10-16T20:07:52.030529+0000","last_fullsized":"2023-10-16T20:07:52.030529+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026881+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.026881+0000","last_peered":"2023-10-16T20:07:53.026881+0000","last_clean":"2023-10-16T20:07:53.026881+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.026881+0000","last_undegraded":"2023-10-16T20:07:53.026881+0000","last_fullsized":"2023-10-16T20:07:53.026881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026213+0000","last_change":"2023-10-16T20:07:52.026213+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026213+0000","last_undegraded":"2023-10-16T20:07:52.026213+0000","last_fullsized":"2023-10-16T20:07:52.026213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047820+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:52.047820+0000","last_peered":"2023-10-16T20:07:52.047820+0000","last_clean":"2023-10-16T20:07:52.047820+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:52.047820+0000","last_undegraded":"2023-10-16T20:07:52.047820+0000","last_fullsized":"2023-10-16T20:07:52.047820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:08.428897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051679+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:53.051679+0000","last_peered":"2023-10-16T20:07:53.051679+0000","last_clean":"2023-10-16T20:07:53.051679+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:53.051679+0000","last_undegraded":"2023-10-16T20:07:53.051679+0000","last_fullsized":"2023-10-16T20:07:53.051679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.033944+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.033944+0000","last_peered":"2023-10-16T20:07:53.033944+0000","last_clean":"2023-10-16T20:07:53.033944+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.033944+0000","last_undegraded":"2023-10-16T20:07:53.033944+0000","last_fullsized":"2023-10-16T20:07:53.033944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026682+0000","last_change":"2023-10-16T20:07:52.026682+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026682+0000","last_undegraded":"2023-10-16T20:07:52.026682+0000","last_fullsized":"2023-10-16T20:07:52.026682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059565+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.059565+0000","last_peered":"2023-10-16T20:07:53.059565+0000","last_clean":"2023-10-16T20:07:53.059565+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.059565+0000","last_undegraded":"2023-10-16T20:07:53.059565+0000","last_fullsized":"2023-10-16T20:07:53.059565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.040882+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:53.040882+0000","last_peered":"2023-10-16T20:07:53.040882+0000","last_clean":"2023-10-16T20:07:53.040882+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:53.040882+0000","last_undegraded":"2023-10-16T20:07:53.040882+0000","last_fullsized":"2023-10-16T20:07:53.040882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:50:27.554553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041965+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:52.041965+0000","last_peered":"2023-10-16T20:07:52.041965+0000","last_clean":"2023-10-16T20:07:52.041965+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:52.041965+0000","last_undegraded":"2023-10-16T20:07:52.041965+0000","last_fullsized":"2023-10-16T20:07:52.041965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031459+0000","last_change":"2023-10-16T20:07:52.031459+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031459+0000","last_undegraded":"2023-10-16T20:07:52.031459+0000","last_fullsized":"2023-10-16T20:07:52.031459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041928+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:52.041928+0000","last_peered":"2023-10-16T20:07:52.041928+0000","last_clean":"2023-10-16T20:07:52.041928+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:52.041928+0000","last_undegraded":"2023-10-16T20:07:52.041928+0000","last_fullsized":"2023-10-16T20:07:52.041928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030508+0000","last_change":"2023-10-16T20:07:52.030508+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030508+0000","last_undegraded":"2023-10-16T20:07:52.030508+0000","last_fullsized":"2023-10-16T20:07:52.030508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042918+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:52.042918+0000","last_peered":"2023-10-16T20:07:52.042918+0000","last_clean":"2023-10-16T20:07:52.042918+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:52.042918+0000","last_undegraded":"2023-10-16T20:07:52.042918+0000","last_fullsized":"2023-10-16T20:07:52.042918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:15:03.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058375+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:53.058375+0000","last_peered":"2023-10-16T20:07:53.058375+0000","last_clean":"2023-10-16T20:07:53.058375+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:53.058375+0000","last_undegraded":"2023-10-16T20:07:53.058375+0000","last_fullsized":"2023-10-16T20:07:53.058375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.030393+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.030393+0000","last_peered":"2023-10-16T20:07:53.030393+0000","last_clean":"2023-10-16T20:07:53.030393+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.030393+0000","last_undegraded":"2023-10-16T20:07:53.030393+0000","last_fullsized":"2023-10-16T20:07:53.030393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031776+0000","last_change":"2023-10-16T20:07:52.031776+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031776+0000","last_undegraded":"2023-10-16T20:07:52.031776+0000","last_fullsized":"2023-10-16T20:07:52.031776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058435+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.058435+0000","last_peered":"2023-10-16T20:07:53.058435+0000","last_clean":"2023-10-16T20:07:53.058435+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.058435+0000","last_undegraded":"2023-10-16T20:07:53.058435+0000","last_fullsized":"2023-10-16T20:07:53.058435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030964+0000","last_change":"2023-10-16T20:07:52.030964+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030964+0000","last_undegraded":"2023-10-16T20:07:52.030964+0000","last_fullsized":"2023-10-16T20:07:52.030964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059421+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.059421+0000","last_peered":"2023-10-16T20:07:53.059421+0000","last_clean":"2023-10-16T20:07:53.059421+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.059421+0000","last_undegraded":"2023-10-16T20:07:53.059421+0000","last_fullsized":"2023-10-16T20:07:53.059421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049131+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:53.049131+0000","last_peered":"2023-10-16T20:07:53.049131+0000","last_clean":"2023-10-16T20:07:53.049131+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:53.049131+0000","last_undegraded":"2023-10-16T20:07:53.049131+0000","last_fullsized":"2023-10-16T20:07:53.049131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059748+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.059748+0000","last_peered":"2023-10-16T20:07:53.059748+0000","last_clean":"2023-10-16T20:07:53.059748+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.059748+0000","last_undegraded":"2023-10-16T20:07:53.059748+0000","last_fullsized":"2023-10-16T20:07:53.059748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.035583+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:53.035583+0000","last_peered":"2023-10-16T20:07:53.035583+0000","last_clean":"2023-10-16T20:07:53.035583+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:53.035583+0000","last_undegraded":"2023-10-16T20:07:53.035583+0000","last_fullsized":"2023-10-16T20:07:53.035583+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:46.637846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.046676+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:52.046676+0000","last_peered":"2023-10-16T20:07:52.046676+0000","last_clean":"2023-10-16T20:07:52.046676+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:52.046676+0000","last_undegraded":"2023-10-16T20:07:52.046676+0000","last_fullsized":"2023-10-16T20:07:52.046676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.338270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022700+0000","last_change":"2023-10-16T20:07:52.022700+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022700+0000","last_undegraded":"2023-10-16T20:07:52.022700+0000","last_fullsized":"2023-10-16T20:07:52.022700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042882+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:52.042882+0000","last_peered":"2023-10-16T20:07:52.042882+0000","last_clean":"2023-10-16T20:07:52.042882+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:52.042882+0000","last_undegraded":"2023-10-16T20:07:52.042882+0000","last_fullsized":"2023-10-16T20:07:52.042882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:40:45.795652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061085+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:53.061085+0000","last_peered":"2023-10-16T20:07:53.061085+0000","last_clean":"2023-10-16T20:07:53.061085+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:53.061085+0000","last_undegraded":"2023-10-16T20:07:53.061085+0000","last_fullsized":"2023-10-16T20:07:53.061085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.045283+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:52.045283+0000","last_peered":"2023-10-16T20:07:52.045283+0000","last_clean":"2023-10-16T20:07:52.045283+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:52.045283+0000","last_undegraded":"2023-10-16T20:07:52.045283+0000","last_fullsized":"2023-10-16T20:07:52.045283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:51:54.049368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026256+0000","last_change":"2023-10-16T20:07:52.026256+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026256+0000","last_undegraded":"2023-10-16T20:07:52.026256+0000","last_fullsized":"2023-10-16T20:07:52.026256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.036592+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:52.036592+0000","last_peered":"2023-10-16T20:07:52.036592+0000","last_clean":"2023-10-16T20:07:52.036592+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:52.036592+0000","last_undegraded":"2023-10-16T20:07:52.036592+0000","last_fullsized":"2023-10-16T20:07:52.036592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:37.418051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047612+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:53.047612+0000","last_peered":"2023-10-16T20:07:53.047612+0000","last_clean":"2023-10-16T20:07:53.047612+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:53.047612+0000","last_undegraded":"2023-10-16T20:07:53.047612+0000","last_fullsized":"2023-10-16T20:07:53.047612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039862+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.039862+0000","last_peered":"2023-10-16T20:07:53.039862+0000","last_clean":"2023-10-16T20:07:53.039862+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.039862+0000","last_undegraded":"2023-10-16T20:07:53.039862+0000","last_fullsized":"2023-10-16T20:07:53.039862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031403+0000","last_change":"2023-10-16T20:07:52.031403+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031403+0000","last_undegraded":"2023-10-16T20:07:52.031403+0000","last_fullsized":"2023-10-16T20:07:52.031403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047948+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:52.047948+0000","last_peered":"2023-10-16T20:07:52.047948+0000","last_clean":"2023-10-16T20:07:52.047948+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:52.047948+0000","last_undegraded":"2023-10-16T20:07:52.047948+0000","last_fullsized":"2023-10-16T20:07:52.047948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:19.523829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.025011+0000","last_change":"2023-10-16T20:07:52.025011+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.025011+0000","last_undegraded":"2023-10-16T20:07:52.025011+0000","last_fullsized":"2023-10-16T20:07:52.025011+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059407+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.059407+0000","last_peered":"2023-10-16T20:07:53.059407+0000","last_clean":"2023-10-16T20:07:53.059407+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.059407+0000","last_undegraded":"2023-10-16T20:07:53.059407+0000","last_fullsized":"2023-10-16T20:07:53.059407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051703+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:53.051703+0000","last_peered":"2023-10-16T20:07:53.051703+0000","last_clean":"2023-10-16T20:07:53.051703+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:53.051703+0000","last_undegraded":"2023-10-16T20:07:53.051703+0000","last_fullsized":"2023-10-16T20:07:53.051703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.048004+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:52.048004+0000","last_peered":"2023-10-16T20:07:52.048004+0000","last_clean":"2023-10-16T20:07:52.048004+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:52.048004+0000","last_undegraded":"2023-10-16T20:07:52.048004+0000","last_fullsized":"2023-10-16T20:07:52.048004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:31.854394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031171+0000","last_change":"2023-10-16T20:07:52.031171+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031171+0000","last_undegraded":"2023-10-16T20:07:52.031171+0000","last_fullsized":"2023-10-16T20:07:52.031171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042471+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:52.042471+0000","last_peered":"2023-10-16T20:07:52.042471+0000","last_clean":"2023-10-16T20:07:52.042471+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:52.042471+0000","last_undegraded":"2023-10-16T20:07:52.042471+0000","last_fullsized":"2023-10-16T20:07:52.042471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:52.002355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029979+0000","last_change":"2023-10-16T20:07:52.029979+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029979+0000","last_undegraded":"2023-10-16T20:07:52.029979+0000","last_fullsized":"2023-10-16T20:07:52.029979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.038234+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:52.038234+0000","last_peered":"2023-10-16T20:07:52.038234+0000","last_clean":"2023-10-16T20:07:52.038234+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:52.038234+0000","last_undegraded":"2023-10-16T20:07:52.038234+0000","last_fullsized":"2023-10-16T20:07:52.038234+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:31.838414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023892+0000","last_change":"2023-10-16T20:07:52.023892+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023892+0000","last_undegraded":"2023-10-16T20:07:52.023892+0000","last_fullsized":"2023-10-16T20:07:52.023892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.031280+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.031280+0000","last_peered":"2023-10-16T20:07:53.031280+0000","last_clean":"2023-10-16T20:07:53.031280+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.031280+0000","last_undegraded":"2023-10-16T20:07:53.031280+0000","last_fullsized":"2023-10-16T20:07:53.031280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051483+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:53.051483+0000","last_peered":"2023-10-16T20:07:53.051483+0000","last_clean":"2023-10-16T20:07:53.051483+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:53.051483+0000","last_undegraded":"2023-10-16T20:07:53.051483+0000","last_fullsized":"2023-10-16T20:07:53.051483+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027052+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.027052+0000","last_peered":"2023-10-16T20:07:53.027052+0000","last_clean":"2023-10-16T20:07:53.027052+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.027052+0000","last_undegraded":"2023-10-16T20:07:53.027052+0000","last_fullsized":"2023-10-16T20:07:53.027052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057204+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:53.057204+0000","last_peered":"2023-10-16T20:07:53.057204+0000","last_clean":"2023-10-16T20:07:53.057204+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:53.057204+0000","last_undegraded":"2023-10-16T20:07:53.057204+0000","last_fullsized":"2023-10-16T20:07:53.057204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047791+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:52.047791+0000","last_peered":"2023-10-16T20:07:52.047791+0000","last_clean":"2023-10-16T20:07:52.047791+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:52.047791+0000","last_undegraded":"2023-10-16T20:07:52.047791+0000","last_fullsized":"2023-10-16T20:07:52.047791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:36.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053686+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:53.053686+0000","last_peered":"2023-10-16T20:07:53.053686+0000","last_clean":"2023-10-16T20:07:53.053686+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:53.053686+0000","last_undegraded":"2023-10-16T20:07:53.053686+0000","last_fullsized":"2023-10-16T20:07:53.053686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.038910+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.038910+0000","last_peered":"2023-10-16T20:07:53.038910+0000","last_clean":"2023-10-16T20:07:53.038910+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.038910+0000","last_undegraded":"2023-10-16T20:07:53.038910+0000","last_fullsized":"2023-10-16T20:07:53.038910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.032672+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:52.032672+0000","last_peered":"2023-10-16T20:07:52.032672+0000","last_clean":"2023-10-16T20:07:52.032672+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:52.032672+0000","last_undegraded":"2023-10-16T20:07:52.032672+0000","last_fullsized":"2023-10-16T20:07:52.032672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":786692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.441}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.52800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.438}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.624}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.75},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":777885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.317},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.47099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.246}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.26300000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.77100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.315}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.375},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68600000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":195246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.5}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.379}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:07:57.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-10-16T20:07:57.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.031007+0000', 'last_change': '2023-10-16T20:07:52.031007+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.031007+0000', 'last_undegraded': '2023-10-16T20:07:52.031007+0000', 'last_fullsized': '2023-10-16T20:07:52.031007+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-10-16T20:07:57.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.031533+0000', 'last_change': '2023-10-16T20:07:52.031533+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.031533+0000', 'last_undegraded': '2023-10-16T20:07:52.031533+0000', 'last_fullsized': '2023-10-16T20:07:52.031533+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-10-16T20:07:57.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.030317+0000', 'last_change': '2023-10-16T20:07:52.030317+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.030317+0000', 'last_undegraded': '2023-10-16T20:07:52.030317+0000', 'last_fullsized': '2023-10-16T20:07:52.030317+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-10-16T20:07:57.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.026758+0000', 'last_change': '2023-10-16T20:07:52.026758+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.026758+0000', 'last_undegraded': '2023-10-16T20:07:52.026758+0000', 'last_fullsized': '2023-10-16T20:07:52.026758+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T20:07:57.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-10-16T20:07:57.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.023238+0000', 'last_change': '2023-10-16T20:07:52.023238+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.023238+0000', 'last_undegraded': '2023-10-16T20:07:52.023238+0000', 'last_fullsized': '2023-10-16T20:07:52.023238+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T20:07:57.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-10-16T20:07:57.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.024221+0000', 'last_change': '2023-10-16T20:07:52.024221+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.024221+0000', 'last_undegraded': '2023-10-16T20:07:52.024221+0000', 'last_fullsized': '2023-10-16T20:07:52.024221+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T20:07:57.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-10-16T20:07:57.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.029110+0000', 'last_change': '2023-10-16T20:07:52.029110+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.029110+0000', 'last_undegraded': '2023-10-16T20:07:52.029110+0000', 'last_fullsized': '2023-10-16T20:07:52.029110+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-10-16T20:07:57.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.029061+0000', 'last_change': '2023-10-16T20:07:52.029061+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.029061+0000', 'last_undegraded': '2023-10-16T20:07:52.029061+0000', 'last_fullsized': '2023-10-16T20:07:52.029061+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-10-16T20:07:57.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.028894+0000', 'last_change': '2023-10-16T20:07:52.028894+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.028894+0000', 'last_undegraded': '2023-10-16T20:07:52.028894+0000', 'last_fullsized': '2023-10-16T20:07:52.028894+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-10-16T20:07:57.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.022817+0000', 'last_change': '2023-10-16T20:07:52.022817+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.022817+0000', 'last_undegraded': '2023-10-16T20:07:52.022817+0000', 'last_fullsized': '2023-10-16T20:07:52.022817+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T20:07:57.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-10-16T20:07:57.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.022950+0000', 'last_change': '2023-10-16T20:07:52.022950+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.022950+0000', 'last_undegraded': '2023-10-16T20:07:52.022950+0000', 'last_fullsized': '2023-10-16T20:07:52.022950+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T20:07:57.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-10-16T20:07:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.023649+0000', 'last_change': '2023-10-16T20:07:52.023649+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.023649+0000', 'last_undegraded': '2023-10-16T20:07:52.023649+0000', 'last_fullsized': '2023-10-16T20:07:52.023649+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T20:07:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-10-16T20:07:57.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.023468+0000', 'last_change': '2023-10-16T20:07:52.023468+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.023468+0000', 'last_undegraded': '2023-10-16T20:07:52.023468+0000', 'last_fullsized': '2023-10-16T20:07:52.023468+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T20:07:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-10-16T20:07:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.024074+0000', 'last_change': '2023-10-16T20:07:52.024074+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.024074+0000', 'last_undegraded': '2023-10-16T20:07:52.024074+0000', 'last_fullsized': '2023-10-16T20:07:52.024074+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T20:07:57.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-16T20:07:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.029761+0000', 'last_change': '2023-10-16T20:07:52.029761+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.029761+0000', 'last_undegraded': '2023-10-16T20:07:52.029761+0000', 'last_fullsized': '2023-10-16T20:07:52.029761+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-16T20:07:57.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.029609+0000', 'last_change': '2023-10-16T20:07:52.029609+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.029609+0000', 'last_undegraded': '2023-10-16T20:07:52.029609+0000', 'last_fullsized': '2023-10-16T20:07:52.029609+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-16T20:07:57.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.030529+0000', 'last_change': '2023-10-16T20:07:52.030529+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.030529+0000', 'last_undegraded': '2023-10-16T20:07:52.030529+0000', 'last_fullsized': '2023-10-16T20:07:52.030529+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-16T20:07:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.026213+0000', 'last_change': '2023-10-16T20:07:52.026213+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.026213+0000', 'last_undegraded': '2023-10-16T20:07:52.026213+0000', 'last_fullsized': '2023-10-16T20:07:52.026213+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T20:07:57.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-16T20:07:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.026682+0000', 'last_change': '2023-10-16T20:07:52.026682+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.026682+0000', 'last_undegraded': '2023-10-16T20:07:52.026682+0000', 'last_fullsized': '2023-10-16T20:07:52.026682+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-16T20:07:57.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.031459+0000', 'last_change': '2023-10-16T20:07:52.031459+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.031459+0000', 'last_undegraded': '2023-10-16T20:07:52.031459+0000', 'last_fullsized': '2023-10-16T20:07:52.031459+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-16T20:07:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.030508+0000', 'last_change': '2023-10-16T20:07:52.030508+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.030508+0000', 'last_undegraded': '2023-10-16T20:07:52.030508+0000', 'last_fullsized': '2023-10-16T20:07:52.030508+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-16T20:07:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.031776+0000', 'last_change': '2023-10-16T20:07:52.031776+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.031776+0000', 'last_undegraded': '2023-10-16T20:07:52.031776+0000', 'last_fullsized': '2023-10-16T20:07:52.031776+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-16T20:07:57.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.030964+0000', 'last_change': '2023-10-16T20:07:52.030964+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.030964+0000', 'last_undegraded': '2023-10-16T20:07:52.030964+0000', 'last_fullsized': '2023-10-16T20:07:52.030964+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-16T20:07:57.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.022700+0000', 'last_change': '2023-10-16T20:07:52.022700+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.022700+0000', 'last_undegraded': '2023-10-16T20:07:52.022700+0000', 'last_fullsized': '2023-10-16T20:07:52.022700+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-16T20:07:57.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-16T20:07:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.026256+0000', 'last_change': '2023-10-16T20:07:52.026256+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.026256+0000', 'last_undegraded': '2023-10-16T20:07:52.026256+0000', 'last_fullsized': '2023-10-16T20:07:52.026256+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-16T20:07:57.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.031403+0000', 'last_change': '2023-10-16T20:07:52.031403+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.031403+0000', 'last_undegraded': '2023-10-16T20:07:52.031403+0000', 'last_fullsized': '2023-10-16T20:07:52.031403+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-10-16T20:07:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.025011+0000', 'last_change': '2023-10-16T20:07:52.025011+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.025011+0000', 'last_undegraded': '2023-10-16T20:07:52.025011+0000', 'last_fullsized': '2023-10-16T20:07:52.025011+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T20:07:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-16T20:07:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.031171+0000', 'last_change': '2023-10-16T20:07:52.031171+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.031171+0000', 'last_undegraded': '2023-10-16T20:07:52.031171+0000', 'last_fullsized': '2023-10-16T20:07:52.031171+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-16T20:07:57.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-16T20:07:57.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.029979+0000', 'last_change': '2023-10-16T20:07:52.029979+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.029979+0000', 'last_undegraded': '2023-10-16T20:07:52.029979+0000', 'last_fullsized': '2023-10-16T20:07:52.029979+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-16T20:07:57.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-10-16T20:07:57.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-10-16T20:07:52.023892+0000', 'last_change': '2023-10-16T20:07:52.023892+0000', 'last_active': '2023-10-16T20:07:52.013721+0000', 'last_peered': '2023-10-16T20:07:52.013721+0000', 'last_clean': '2023-10-16T20:07:52.013721+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-16T20:07:52.023892+0000', 'last_undegraded': '2023-10-16T20:07:52.023892+0000', 'last_fullsized': '2023-10-16T20:07:52.023892+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'last_clean_scrub_stamp': '2023-10-16T20:07:52.013721+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-16T20:07:57.920 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T20:07:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.052+0000 7f1fdb5fd700 1 Processor -- start 2023-10-16T20:07:58.054 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.052+0000 7f1fdb5fd700 1 -- start start 2023-10-16T20:07:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fdb5fd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1fd415a240 0x7f1fd415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fdb5fd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1fd40b1bd0 0x7f1fd40b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fdb5fd700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd40b2510 con 0x7f1fd415e390 2023-10-16T20:07:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fdb5fd700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd415edf0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fdb5fd700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd415e830 con 0x7f1fd415a240 2023-10-16T20:07:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd9b9a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1fd40b1bd0 0x7f1fd40b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd8b98700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1fd415e390 0x7f1fd40724a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41144/0 (socket says 172.21.15.152:41144) 2023-10-16T20:07:58.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd8b98700 1 -- 172.21.15.152:0/1174679960 learned_addr learned my addr 172.21.15.152:0/1174679960 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd9399700 1 --2- 172.21.15.152:0/1174679960 >> v2:172.21.15.163:3300/0 conn(0x7f1fd415a240 0x7f1fd415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd9b9a700 1 -- 172.21.15.152:0/1174679960 >> v2:172.21.15.163:3300/0 conn(0x7f1fd415a240 msgr2=0x7f1fd415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:07:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd9b9a700 1 --2- 172.21.15.152:0/1174679960 >> v2:172.21.15.163:3300/0 conn(0x7f1fd415a240 0x7f1fd415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd9b9a700 1 -- 172.21.15.152:0/1174679960 >> v1:172.21.15.152:6789/0 conn(0x7f1fd415e390 legacy=0x7f1fd40724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.053+0000 7f1fd9b9a700 1 -- 172.21.15.152:0/1174679960 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd415eb10 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fd9b9a700 1 --2- 172.21.15.152:0/1174679960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b1fd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1fd406e750 tx=0x7f1fcc00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c88dc5ba88d4b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:58.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fcbfff700 1 -- 172.21.15.152:0/1174679960 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc010070 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fcbfff700 1 -- 172.21.15.152:0/1174679960 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00b2e0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fcbfff700 1 -- 172.21.15.152:0/1174679960 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00dcc0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/1174679960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 msgr2=0x7f1fd40b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/1174679960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b1fd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1fd406e750 tx=0x7f1fcc00d330 comp rx=0 tx=0).stop 2023-10-16T20:07:58.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/1174679960 shutdown_connections 2023-10-16T20:07:58.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/1174679960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b1fd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/1174679960 >> v2:172.21.15.163:3300/0 conn(0x7f1fd415a240 0x7f1fd415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.060 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.054+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/1174679960 >> 172.21.15.152:0/1174679960 conn(0x7f1fd406bd50 msgr2=0x7f1fd406c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:58.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.055+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/1174679960 shutdown_connections 2023-10-16T20:07:58.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.055+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/1174679960 wait complete. 2023-10-16T20:07:58.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 Processor -- start 2023-10-16T20:07:58.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 -- start start 2023-10-16T20:07:58.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fd415a240 0x7f1fd40c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fd415e390 0x7f1fd414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40c8110 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40b4fe0 con 0x7f1fd415a240 2023-10-16T20:07:58.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.056+0000 7f1fdb5fd700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd40c7590 con 0x7f1fd415e390 2023-10-16T20:07:58.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60952/0 (socket says 172.21.15.152:60952) 2023-10-16T20:07:58.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 -- 172.21.15.152:0/2291586181 learned_addr learned my addr 172.21.15.152:0/2291586181 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:58.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9b9a700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fd415e390 0x7f1fd414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd8b98700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fd415a240 0x7f1fd40c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 -- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fd415e390 msgr2=0x7f1fd414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fd415e390 0x7f1fd414e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 -- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fd415a240 msgr2=0x7f1fd40c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fd415a240 0x7f1fd40c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 -- 172.21.15.152:0/2291586181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc00bc80 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fd9399700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b4aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e810 tx=0x7f1fc400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:58.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400c070 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4013610 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd40c7870 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40139a0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.057+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd40c7e30 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.058+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd41f67d0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.059+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1fc4013b00 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.059+0000 7f1fc9ffb700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1fb806af00 0x7f1fb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.059+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f1fc4089470 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.059+0000 7f1fd8b98700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1fb806af00 0x7f1fb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.059+0000 7f1fd8b98700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1fb806af00 0x7f1fb806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b1ba0 tx=0x7f1fd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:58.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.063+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1fc40543d0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.333+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1fd404ebb0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.333+0000 7f1fc9ffb700 1 -- 172.21.15.152:0/2291586181 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1097 (secure 0 0 0) 0x7f1fc4013db0 con 0x7f1fd40b1bd0 2023-10-16T20:07:58.335 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:58.336 INFO:teuthology.orchestra.run.smithi152.stdout:{"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":111,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1697486778,"num_in_osds":8,"osd_in_since":1697486769,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"creating+peering","count":30}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591062,"bytes_used":226197504,"bytes_avail":772867915776,"bytes_total":773094113280,"inactive_pgs_ratio":0.30927833914756775,"write_bytes_sec":532,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":19,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5310}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-16T20:07:34.781148+0000","services":{}},"progress_events":{}} 2023-10-16T20:07:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1fb806af00 msgr2=0x7f1fb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1fb806af00 0x7f1fb806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40b1ba0 tx=0x7f1fd0009040 comp rx=0 tx=0).stop 2023-10-16T20:07:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 msgr2=0x7f1fd40b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b4aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400e810 tx=0x7f1fc400eb20 comp rx=0 tx=0).stop 2023-10-16T20:07:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 shutdown_connections 2023-10-16T20:07:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1fb806af00 0x7f1fb806d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1fd415e390 0x7f1fd414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fd40b1bd0 0x7f1fd40b4aa0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 --2- 172.21.15.152:0/2291586181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fd415a240 0x7f1fd40c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 >> 172.21.15.152:0/2291586181 conn(0x7f1fd406bd50 msgr2=0x7f1fd406c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:58.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 shutdown_connections 2023-10-16T20:07:58.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.335+0000 7f1fdb5fd700 1 -- 172.21.15.152:0/2291586181 wait complete. 2023-10-16T20:07:58.349 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T20:07:58.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:07:58.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.469+0000 7f601bf30700 1 Processor -- start 2023-10-16T20:07:58.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.469+0000 7f601bf30700 1 -- start start 2023-10-16T20:07:58.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f601bf30700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60140b3410 0x7f60140cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f601bf30700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6014070d70 con 0x7f6014152470 2023-10-16T20:07:58.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f601bf30700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601415c990 con 0x7f60140cb8d0 2023-10-16T20:07:58.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f601bf30700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6014071200 con 0x7f60140b3410 2023-10-16T20:07:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f60194cb700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60140b3410 0x7f60140cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f6019ccc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6014152470 0x7f60140b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41158/0 (socket says 172.21.15.152:41158) 2023-10-16T20:07:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f6019ccc700 1 -- 172.21.15.152:0/2723666529 learned_addr learned my addr 172.21.15.152:0/2723666529 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:07:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f60194cb700 1 -- 172.21.15.152:0/2723666529 >> v1:172.21.15.163:6789/0 conn(0x7f60140cb8d0 legacy=0x7f60140b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f60194cb700 1 -- 172.21.15.152:0/2723666529 >> v1:172.21.15.152:6789/0 conn(0x7f6014152470 legacy=0x7f60140b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f6018cca700 1 -- 172.21.15.152:0/2723666529 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870088228 0 0) 0x7f6014070d70 con 0x7f6014152470 2023-10-16T20:07:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f60194cb700 1 -- 172.21.15.152:0/2723666529 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014070440 con 0x7f60140b3410 2023-10-16T20:07:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f60194cb700 1 --2- 172.21.15.152:0/2723666529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60140cd570 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6010009840 tx=0x7f6010009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9596baa55fb16a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f6018cca700 1 -- 172.21.15.152:0/2723666529 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010011830 con 0x7f60140b3410 2023-10-16T20:07:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f6018cca700 1 -- 172.21.15.152:0/2723666529 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010011990 con 0x7f60140b3410 2023-10-16T20:07:58.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.470+0000 7f6018cca700 1 -- 172.21.15.152:0/2723666529 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010011d20 con 0x7f60140b3410 2023-10-16T20:07:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 -- 172.21.15.152:0/2723666529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 msgr2=0x7f60140cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 --2- 172.21.15.152:0/2723666529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60140cd570 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6010009840 tx=0x7f6010009b50 comp rx=0 tx=0).stop 2023-10-16T20:07:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 -- 172.21.15.152:0/2723666529 shutdown_connections 2023-10-16T20:07:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 --2- 172.21.15.152:0/2723666529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60140cd570 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 -- 172.21.15.152:0/2723666529 >> 172.21.15.152:0/2723666529 conn(0x7f60140cdd00 msgr2=0x7f60140ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:58.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 -- 172.21.15.152:0/2723666529 shutdown_connections 2023-10-16T20:07:58.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.471+0000 7f601bf30700 1 -- 172.21.15.152:0/2723666529 wait complete. 2023-10-16T20:07:58.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.472+0000 7f601bf30700 1 Processor -- start 2023-10-16T20:07:58.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.472+0000 7f601bf30700 1 -- start start 2023-10-16T20:07:58.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601bf30700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60141f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601bf30700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60140cb8d0 0x7f60141461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601bf30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6014152470 0x7f60141574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601bf30700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60141579e0 con 0x7f60140b3410 2023-10-16T20:07:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601bf30700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014158270 con 0x7f6014152470 2023-10-16T20:07:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601bf30700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6014156a00 con 0x7f60140cb8d0 2023-10-16T20:07:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60141f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60141f0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60968/0 (socket says 172.21.15.152:60968) 2023-10-16T20:07:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 -- 172.21.15.152:0/1424298953 learned_addr learned my addr 172.21.15.152:0/1424298953 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:07:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601a4cd700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6014152470 0x7f60141574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f60194cb700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60140cb8d0 0x7f60141461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 -- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60140cb8d0 msgr2=0x7f60141461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60140cb8d0 0x7f60141461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 -- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6014152470 msgr2=0x7f60141574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6014152470 0x7f60141574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f6019ccc700 1 -- 172.21.15.152:0/1424298953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100094a0 con 0x7f60140b3410 2023-10-16T20:07:58.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.473+0000 7f601a4cd700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6014152470 0x7f60141574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:07:58.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.474+0000 7f6019ccc700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60141f0670 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f600400c520 tx=0x7f600400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:58.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.474+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004004c80 con 0x7f60140b3410 2023-10-16T20:07:58.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.474+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004004e00 con 0x7f60140b3410 2023-10-16T20:07:58.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.474+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60141584c0 con 0x7f60140b3410 2023-10-16T20:07:58.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.474+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004007310 con 0x7f60140b3410 2023-10-16T20:07:58.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.474+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6014156ca0 con 0x7f60140b3410 2023-10-16T20:07:58.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.475+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601404ebb0 con 0x7f60140b3410 2023-10-16T20:07:58.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.475+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6004007470 con 0x7f60140b3410 2023-10-16T20:07:58.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.476+0000 7f600a7fc700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5ff806af00 0x7f5ff806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:07:58.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.476+0000 7f60194cb700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5ff806af00 0x7f5ff806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:07:58.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.476+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6004089440 con 0x7f60140b3410 2023-10-16T20:07:58.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.476+0000 7f60194cb700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5ff806af00 0x7f5ff806d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f601415a0e0 tx=0x7f601001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:07:58.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.480+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6004054390 con 0x7f60140b3410 2023-10-16T20:07:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.664+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6014070a00 con 0x7f5ff806af00 2023-10-16T20:07:58.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.672+0000 7f600a7fc700 1 -- 172.21.15.152:0/1424298953 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286288 (secure 0 0 0) 0x7f6010011b80 con 0x7f5ff806af00 2023-10-16T20:07:58.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:07:58.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5ff806af00 msgr2=0x7f5ff806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5ff806af00 0x7f5ff806d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f601415a0e0 tx=0x7f601001c040 comp rx=0 tx=0).stop 2023-10-16T20:07:58.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 msgr2=0x7f60141f0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:07:58.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60141f0670 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f600400c520 tx=0x7f600400c8e0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 shutdown_connections 2023-10-16T20:07:58.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f5ff806af00 0x7f5ff806d3c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6014152470 0x7f60141574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60140b3410 0x7f60141f0670 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 --2- 172.21.15.152:0/1424298953 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f60140cb8d0 0x7f60141461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:07:58.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.675+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 >> 172.21.15.152:0/1424298953 conn(0x7f60140cdd00 msgr2=0x7f601415a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:07:58.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.676+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 shutdown_connections 2023-10-16T20:07:58.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:07:58.676+0000 7f601bf30700 1 -- 172.21.15.152:0/1424298953 wait complete. 2023-10-16T20:07:58.682 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:07:58.689 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-10-16T20:07:56.785115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220896,"kb_used_data":4700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753824,"statfs":{"total":773094113280,"available":772867915776,"internally_reserved":0,"allocated":4812800,"data_stored":2712352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771237"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031007+0000","last_change":"2023-10-16T20:07:52.031007+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031007+0000","last_undegraded":"2023-10-16T20:07:52.031007+0000","last_fullsized":"2023-10-16T20:07:52.031007+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031533+0000","last_change":"2023-10-16T20:07:52.031533+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031533+0000","last_undegraded":"2023-10-16T20:07:52.031533+0000","last_fullsized":"2023-10-16T20:07:52.031533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030317+0000","last_change":"2023-10-16T20:07:52.030317+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030317+0000","last_undegraded":"2023-10-16T20:07:52.030317+0000","last_fullsized":"2023-10-16T20:07:52.030317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026758+0000","last_change":"2023-10-16T20:07:52.026758+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026758+0000","last_undegraded":"2023-10-16T20:07:52.026758+0000","last_fullsized":"2023-10-16T20:07:52.026758+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023238+0000","last_change":"2023-10-16T20:07:52.023238+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023238+0000","last_undegraded":"2023-10-16T20:07:52.023238+0000","last_fullsized":"2023-10-16T20:07:52.023238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024221+0000","last_change":"2023-10-16T20:07:52.024221+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024221+0000","last_undegraded":"2023-10-16T20:07:52.024221+0000","last_fullsized":"2023-10-16T20:07:52.024221+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057581+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:53.057581+0000","last_peered":"2023-10-16T20:07:53.057581+0000","last_clean":"2023-10-16T20:07:53.057581+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:53.057581+0000","last_undegraded":"2023-10-16T20:07:53.057581+0000","last_fullsized":"2023-10-16T20:07:53.057581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029110+0000","last_change":"2023-10-16T20:07:52.029110+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029110+0000","last_undegraded":"2023-10-16T20:07:52.029110+0000","last_fullsized":"2023-10-16T20:07:52.029110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029061+0000","last_change":"2023-10-16T20:07:52.029061+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029061+0000","last_undegraded":"2023-10-16T20:07:52.029061+0000","last_fullsized":"2023-10-16T20:07:52.029061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054548+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:53.054548+0000","last_peered":"2023-10-16T20:07:53.054548+0000","last_clean":"2023-10-16T20:07:53.054548+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:53.054548+0000","last_undegraded":"2023-10-16T20:07:53.054548+0000","last_fullsized":"2023-10-16T20:07:53.054548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049101+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:53.049101+0000","last_peered":"2023-10-16T20:07:53.049101+0000","last_clean":"2023-10-16T20:07:53.049101+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:53.049101+0000","last_undegraded":"2023-10-16T20:07:53.049101+0000","last_fullsized":"2023-10-16T20:07:53.049101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.028894+0000","last_change":"2023-10-16T20:07:52.028894+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.028894+0000","last_undegraded":"2023-10-16T20:07:52.028894+0000","last_fullsized":"2023-10-16T20:07:52.028894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059021+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:53.059021+0000","last_peered":"2023-10-16T20:07:53.059021+0000","last_clean":"2023-10-16T20:07:53.059021+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:53.059021+0000","last_undegraded":"2023-10-16T20:07:53.059021+0000","last_fullsized":"2023-10-16T20:07:53.059021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:32.233089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046639+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:53.046639+0000","last_peered":"2023-10-16T20:07:53.046639+0000","last_clean":"2023-10-16T20:07:53.046639+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:53.046639+0000","last_undegraded":"2023-10-16T20:07:53.046639+0000","last_fullsized":"2023-10-16T20:07:53.046639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:50:43.628385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057625+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:53.057625+0000","last_peered":"2023-10-16T20:07:53.057625+0000","last_clean":"2023-10-16T20:07:53.057625+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:53.057625+0000","last_undegraded":"2023-10-16T20:07:53.057625+0000","last_fullsized":"2023-10-16T20:07:53.057625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061105+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:53.061105+0000","last_peered":"2023-10-16T20:07:53.061105+0000","last_clean":"2023-10-16T20:07:53.061105+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:53.061105+0000","last_undegraded":"2023-10-16T20:07:53.061105+0000","last_fullsized":"2023-10-16T20:07:53.061105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058587+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:53.058587+0000","last_peered":"2023-10-16T20:07:53.058587+0000","last_clean":"2023-10-16T20:07:53.058587+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:53.058587+0000","last_undegraded":"2023-10-16T20:07:53.058587+0000","last_fullsized":"2023-10-16T20:07:53.058587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044053+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:53.044053+0000","last_peered":"2023-10-16T20:07:53.044053+0000","last_clean":"2023-10-16T20:07:53.044053+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:53.044053+0000","last_undegraded":"2023-10-16T20:07:53.044053+0000","last_fullsized":"2023-10-16T20:07:53.044053+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022817+0000","last_change":"2023-10-16T20:07:52.022817+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022817+0000","last_undegraded":"2023-10-16T20:07:52.022817+0000","last_fullsized":"2023-10-16T20:07:52.022817+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043928+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:53.043928+0000","last_peered":"2023-10-16T20:07:53.043928+0000","last_clean":"2023-10-16T20:07:53.043928+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:53.043928+0000","last_undegraded":"2023-10-16T20:07:53.043928+0000","last_fullsized":"2023-10-16T20:07:53.043928+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047542+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:53.047542+0000","last_peered":"2023-10-16T20:07:53.047542+0000","last_clean":"2023-10-16T20:07:53.047542+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:53.047542+0000","last_undegraded":"2023-10-16T20:07:53.047542+0000","last_fullsized":"2023-10-16T20:07:53.047542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044878+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:53.044878+0000","last_peered":"2023-10-16T20:07:53.044878+0000","last_clean":"2023-10-16T20:07:53.044878+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:53.044878+0000","last_undegraded":"2023-10-16T20:07:53.044878+0000","last_fullsized":"2023-10-16T20:07:53.044878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058371+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:53.058371+0000","last_peered":"2023-10-16T20:07:53.058371+0000","last_clean":"2023-10-16T20:07:53.058371+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:53.058371+0000","last_undegraded":"2023-10-16T20:07:53.058371+0000","last_fullsized":"2023-10-16T20:07:53.058371+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022950+0000","last_change":"2023-10-16T20:07:52.022950+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022950+0000","last_undegraded":"2023-10-16T20:07:52.022950+0000","last_fullsized":"2023-10-16T20:07:52.022950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048316+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:53.048316+0000","last_peered":"2023-10-16T20:07:53.048316+0000","last_clean":"2023-10-16T20:07:53.048316+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:53.048316+0000","last_undegraded":"2023-10-16T20:07:53.048316+0000","last_fullsized":"2023-10-16T20:07:53.048316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:34:47.232698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023649+0000","last_change":"2023-10-16T20:07:52.023649+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023649+0000","last_undegraded":"2023-10-16T20:07:52.023649+0000","last_fullsized":"2023-10-16T20:07:52.023649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044088+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:53.044088+0000","last_peered":"2023-10-16T20:07:53.044088+0000","last_clean":"2023-10-16T20:07:53.044088+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:53.044088+0000","last_undegraded":"2023-10-16T20:07:53.044088+0000","last_fullsized":"2023-10-16T20:07:53.044088+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:04.826839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053823+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:53.053823+0000","last_peered":"2023-10-16T20:07:53.053823+0000","last_clean":"2023-10-16T20:07:53.053823+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:53.053823+0000","last_undegraded":"2023-10-16T20:07:53.053823+0000","last_fullsized":"2023-10-16T20:07:53.053823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.916793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039648+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:53.039648+0000","last_peered":"2023-10-16T20:07:53.039648+0000","last_clean":"2023-10-16T20:07:53.039648+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:53.039648+0000","last_undegraded":"2023-10-16T20:07:53.039648+0000","last_fullsized":"2023-10-16T20:07:53.039648+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.046439+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:53.046439+0000","last_peered":"2023-10-16T20:07:53.046439+0000","last_clean":"2023-10-16T20:07:53.046439+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:53.046439+0000","last_undegraded":"2023-10-16T20:07:53.046439+0000","last_fullsized":"2023-10-16T20:07:53.046439+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:19.669427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058280+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:53.058280+0000","last_peered":"2023-10-16T20:07:53.058280+0000","last_clean":"2023-10-16T20:07:53.058280+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:53.058280+0000","last_undegraded":"2023-10-16T20:07:53.058280+0000","last_fullsized":"2023-10-16T20:07:53.058280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:55.937988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023468+0000","last_change":"2023-10-16T20:07:52.023468+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023468+0000","last_undegraded":"2023-10-16T20:07:52.023468+0000","last_fullsized":"2023-10-16T20:07:52.023468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058965+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:53.058965+0000","last_peered":"2023-10-16T20:07:53.058965+0000","last_clean":"2023-10-16T20:07:53.058965+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:53.058965+0000","last_undegraded":"2023-10-16T20:07:53.058965+0000","last_fullsized":"2023-10-16T20:07:53.058965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053642+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.053642+0000","last_peered":"2023-10-16T20:07:53.053642+0000","last_clean":"2023-10-16T20:07:53.053642+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.053642+0000","last_undegraded":"2023-10-16T20:07:53.053642+0000","last_fullsized":"2023-10-16T20:07:53.053642+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.024074+0000","last_change":"2023-10-16T20:07:52.024074+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.024074+0000","last_undegraded":"2023-10-16T20:07:52.024074+0000","last_fullsized":"2023-10-16T20:07:52.024074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042127+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:52.042127+0000","last_peered":"2023-10-16T20:07:52.042127+0000","last_clean":"2023-10-16T20:07:52.042127+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:52.042127+0000","last_undegraded":"2023-10-16T20:07:52.042127+0000","last_fullsized":"2023-10-16T20:07:52.042127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.043820+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:53.043820+0000","last_peered":"2023-10-16T20:07:53.043820+0000","last_clean":"2023-10-16T20:07:53.043820+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:53.043820+0000","last_undegraded":"2023-10-16T20:07:53.043820+0000","last_fullsized":"2023-10-16T20:07:53.043820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:08.472229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041828+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:52.041828+0000","last_peered":"2023-10-16T20:07:52.041828+0000","last_clean":"2023-10-16T20:07:52.041828+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:52.041828+0000","last_undegraded":"2023-10-16T20:07:52.041828+0000","last_fullsized":"2023-10-16T20:07:52.041828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:34.051850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029761+0000","last_change":"2023-10-16T20:07:52.029761+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029761+0000","last_undegraded":"2023-10-16T20:07:52.029761+0000","last_fullsized":"2023-10-16T20:07:52.029761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.054959+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.054959+0000","last_peered":"2023-10-16T20:07:53.054959+0000","last_clean":"2023-10-16T20:07:53.054959+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.054959+0000","last_undegraded":"2023-10-16T20:07:53.054959+0000","last_fullsized":"2023-10-16T20:07:53.054959+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029609+0000","last_change":"2023-10-16T20:07:52.029609+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029609+0000","last_undegraded":"2023-10-16T20:07:52.029609+0000","last_fullsized":"2023-10-16T20:07:52.029609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059229+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.059229+0000","last_peered":"2023-10-16T20:07:53.059229+0000","last_clean":"2023-10-16T20:07:53.059229+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.059229+0000","last_undegraded":"2023-10-16T20:07:53.059229+0000","last_fullsized":"2023-10-16T20:07:53.059229+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057603+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:53.057603+0000","last_peered":"2023-10-16T20:07:53.057603+0000","last_clean":"2023-10-16T20:07:53.057603+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:53.057603+0000","last_undegraded":"2023-10-16T20:07:53.057603+0000","last_fullsized":"2023-10-16T20:07:53.057603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056263+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.056263+0000","last_peered":"2023-10-16T20:07:53.056263+0000","last_clean":"2023-10-16T20:07:53.056263+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.056263+0000","last_undegraded":"2023-10-16T20:07:53.056263+0000","last_fullsized":"2023-10-16T20:07:53.056263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.044858+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:53.044858+0000","last_peered":"2023-10-16T20:07:53.044858+0000","last_clean":"2023-10-16T20:07:53.044858+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:53.044858+0000","last_undegraded":"2023-10-16T20:07:53.044858+0000","last_fullsized":"2023-10-16T20:07:53.044858+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:28:58.471051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042945+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:52.042945+0000","last_peered":"2023-10-16T20:07:52.042945+0000","last_clean":"2023-10-16T20:07:52.042945+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:52.042945+0000","last_undegraded":"2023-10-16T20:07:52.042945+0000","last_fullsized":"2023-10-16T20:07:52.042945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:05.950966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030529+0000","last_change":"2023-10-16T20:07:52.030529+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030529+0000","last_undegraded":"2023-10-16T20:07:52.030529+0000","last_fullsized":"2023-10-16T20:07:52.030529+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026881+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.026881+0000","last_peered":"2023-10-16T20:07:53.026881+0000","last_clean":"2023-10-16T20:07:53.026881+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.026881+0000","last_undegraded":"2023-10-16T20:07:53.026881+0000","last_fullsized":"2023-10-16T20:07:53.026881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026213+0000","last_change":"2023-10-16T20:07:52.026213+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026213+0000","last_undegraded":"2023-10-16T20:07:52.026213+0000","last_fullsized":"2023-10-16T20:07:52.026213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047820+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:52.047820+0000","last_peered":"2023-10-16T20:07:52.047820+0000","last_clean":"2023-10-16T20:07:52.047820+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:52.047820+0000","last_undegraded":"2023-10-16T20:07:52.047820+0000","last_fullsized":"2023-10-16T20:07:52.047820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:08.428897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051679+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:53.051679+0000","last_peered":"2023-10-16T20:07:53.051679+0000","last_clean":"2023-10-16T20:07:53.051679+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:53.051679+0000","last_undegraded":"2023-10-16T20:07:53.051679+0000","last_fullsized":"2023-10-16T20:07:53.051679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.033944+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.033944+0000","last_peered":"2023-10-16T20:07:53.033944+0000","last_clean":"2023-10-16T20:07:53.033944+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.033944+0000","last_undegraded":"2023-10-16T20:07:53.033944+0000","last_fullsized":"2023-10-16T20:07:53.033944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026682+0000","last_change":"2023-10-16T20:07:52.026682+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026682+0000","last_undegraded":"2023-10-16T20:07:52.026682+0000","last_fullsized":"2023-10-16T20:07:52.026682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059565+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.059565+0000","last_peered":"2023-10-16T20:07:53.059565+0000","last_clean":"2023-10-16T20:07:53.059565+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.059565+0000","last_undegraded":"2023-10-16T20:07:53.059565+0000","last_fullsized":"2023-10-16T20:07:53.059565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.040882+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:53.040882+0000","last_peered":"2023-10-16T20:07:53.040882+0000","last_clean":"2023-10-16T20:07:53.040882+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:53.040882+0000","last_undegraded":"2023-10-16T20:07:53.040882+0000","last_fullsized":"2023-10-16T20:07:53.040882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:50:27.554553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041965+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:52.041965+0000","last_peered":"2023-10-16T20:07:52.041965+0000","last_clean":"2023-10-16T20:07:52.041965+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:52.041965+0000","last_undegraded":"2023-10-16T20:07:52.041965+0000","last_fullsized":"2023-10-16T20:07:52.041965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031459+0000","last_change":"2023-10-16T20:07:52.031459+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031459+0000","last_undegraded":"2023-10-16T20:07:52.031459+0000","last_fullsized":"2023-10-16T20:07:52.031459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.041928+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:52.041928+0000","last_peered":"2023-10-16T20:07:52.041928+0000","last_clean":"2023-10-16T20:07:52.041928+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:52.041928+0000","last_undegraded":"2023-10-16T20:07:52.041928+0000","last_fullsized":"2023-10-16T20:07:52.041928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030508+0000","last_change":"2023-10-16T20:07:52.030508+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030508+0000","last_undegraded":"2023-10-16T20:07:52.030508+0000","last_fullsized":"2023-10-16T20:07:52.030508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042918+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:52.042918+0000","last_peered":"2023-10-16T20:07:52.042918+0000","last_clean":"2023-10-16T20:07:52.042918+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:52.042918+0000","last_undegraded":"2023-10-16T20:07:52.042918+0000","last_fullsized":"2023-10-16T20:07:52.042918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:15:03.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058375+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:53.058375+0000","last_peered":"2023-10-16T20:07:53.058375+0000","last_clean":"2023-10-16T20:07:53.058375+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:53.058375+0000","last_undegraded":"2023-10-16T20:07:53.058375+0000","last_fullsized":"2023-10-16T20:07:53.058375+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:02:00.723926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.030393+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.030393+0000","last_peered":"2023-10-16T20:07:53.030393+0000","last_clean":"2023-10-16T20:07:53.030393+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.030393+0000","last_undegraded":"2023-10-16T20:07:53.030393+0000","last_fullsized":"2023-10-16T20:07:53.030393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031776+0000","last_change":"2023-10-16T20:07:52.031776+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031776+0000","last_undegraded":"2023-10-16T20:07:52.031776+0000","last_fullsized":"2023-10-16T20:07:52.031776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.058435+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.058435+0000","last_peered":"2023-10-16T20:07:53.058435+0000","last_clean":"2023-10-16T20:07:53.058435+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.058435+0000","last_undegraded":"2023-10-16T20:07:53.058435+0000","last_fullsized":"2023-10-16T20:07:53.058435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.030964+0000","last_change":"2023-10-16T20:07:52.030964+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.030964+0000","last_undegraded":"2023-10-16T20:07:52.030964+0000","last_fullsized":"2023-10-16T20:07:52.030964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059421+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.059421+0000","last_peered":"2023-10-16T20:07:53.059421+0000","last_clean":"2023-10-16T20:07:53.059421+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.059421+0000","last_undegraded":"2023-10-16T20:07:53.059421+0000","last_fullsized":"2023-10-16T20:07:53.059421+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.049131+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:53.049131+0000","last_peered":"2023-10-16T20:07:53.049131+0000","last_clean":"2023-10-16T20:07:53.049131+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:53.049131+0000","last_undegraded":"2023-10-16T20:07:53.049131+0000","last_fullsized":"2023-10-16T20:07:53.049131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059748+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.059748+0000","last_peered":"2023-10-16T20:07:53.059748+0000","last_clean":"2023-10-16T20:07:53.059748+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.059748+0000","last_undegraded":"2023-10-16T20:07:53.059748+0000","last_fullsized":"2023-10-16T20:07:53.059748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.035583+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:53.035583+0000","last_peered":"2023-10-16T20:07:53.035583+0000","last_clean":"2023-10-16T20:07:53.035583+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:53.035583+0000","last_undegraded":"2023-10-16T20:07:53.035583+0000","last_fullsized":"2023-10-16T20:07:53.035583+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:46.637846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.046676+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:52.046676+0000","last_peered":"2023-10-16T20:07:52.046676+0000","last_clean":"2023-10-16T20:07:52.046676+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:52.046676+0000","last_undegraded":"2023-10-16T20:07:52.046676+0000","last_fullsized":"2023-10-16T20:07:52.046676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:01:16.338270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.022700+0000","last_change":"2023-10-16T20:07:52.022700+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.022700+0000","last_undegraded":"2023-10-16T20:07:52.022700+0000","last_fullsized":"2023-10-16T20:07:52.022700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042882+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:52.042882+0000","last_peered":"2023-10-16T20:07:52.042882+0000","last_clean":"2023-10-16T20:07:52.042882+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:52.042882+0000","last_undegraded":"2023-10-16T20:07:52.042882+0000","last_fullsized":"2023-10-16T20:07:52.042882+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:40:45.795652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061085+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:53.061085+0000","last_peered":"2023-10-16T20:07:53.061085+0000","last_clean":"2023-10-16T20:07:53.061085+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:53.061085+0000","last_undegraded":"2023-10-16T20:07:53.061085+0000","last_fullsized":"2023-10-16T20:07:53.061085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.045283+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:52.045283+0000","last_peered":"2023-10-16T20:07:52.045283+0000","last_clean":"2023-10-16T20:07:52.045283+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:52.045283+0000","last_undegraded":"2023-10-16T20:07:52.045283+0000","last_fullsized":"2023-10-16T20:07:52.045283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:51:54.049368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.026256+0000","last_change":"2023-10-16T20:07:52.026256+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.026256+0000","last_undegraded":"2023-10-16T20:07:52.026256+0000","last_fullsized":"2023-10-16T20:07:52.026256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.036592+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:52.036592+0000","last_peered":"2023-10-16T20:07:52.036592+0000","last_clean":"2023-10-16T20:07:52.036592+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:52.036592+0000","last_undegraded":"2023-10-16T20:07:52.036592+0000","last_fullsized":"2023-10-16T20:07:52.036592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:30:37.418051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.047612+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:53.047612+0000","last_peered":"2023-10-16T20:07:53.047612+0000","last_clean":"2023-10-16T20:07:53.047612+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:53.047612+0000","last_undegraded":"2023-10-16T20:07:53.047612+0000","last_fullsized":"2023-10-16T20:07:53.047612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039862+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.039862+0000","last_peered":"2023-10-16T20:07:53.039862+0000","last_clean":"2023-10-16T20:07:53.039862+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.039862+0000","last_undegraded":"2023-10-16T20:07:53.039862+0000","last_fullsized":"2023-10-16T20:07:53.039862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031403+0000","last_change":"2023-10-16T20:07:52.031403+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031403+0000","last_undegraded":"2023-10-16T20:07:52.031403+0000","last_fullsized":"2023-10-16T20:07:52.031403+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047948+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:52.047948+0000","last_peered":"2023-10-16T20:07:52.047948+0000","last_clean":"2023-10-16T20:07:52.047948+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:52.047948+0000","last_undegraded":"2023-10-16T20:07:52.047948+0000","last_fullsized":"2023-10-16T20:07:52.047948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:19.523829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.025011+0000","last_change":"2023-10-16T20:07:52.025011+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.025011+0000","last_undegraded":"2023-10-16T20:07:52.025011+0000","last_fullsized":"2023-10-16T20:07:52.025011+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.059407+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.059407+0000","last_peered":"2023-10-16T20:07:53.059407+0000","last_clean":"2023-10-16T20:07:53.059407+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.059407+0000","last_undegraded":"2023-10-16T20:07:53.059407+0000","last_fullsized":"2023-10-16T20:07:53.059407+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051703+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:53.051703+0000","last_peered":"2023-10-16T20:07:53.051703+0000","last_clean":"2023-10-16T20:07:53.051703+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:53.051703+0000","last_undegraded":"2023-10-16T20:07:53.051703+0000","last_fullsized":"2023-10-16T20:07:53.051703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.048004+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:52.048004+0000","last_peered":"2023-10-16T20:07:52.048004+0000","last_clean":"2023-10-16T20:07:52.048004+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:52.048004+0000","last_undegraded":"2023-10-16T20:07:52.048004+0000","last_fullsized":"2023-10-16T20:07:52.048004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:57:31.854394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.031171+0000","last_change":"2023-10-16T20:07:52.031171+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.031171+0000","last_undegraded":"2023-10-16T20:07:52.031171+0000","last_fullsized":"2023-10-16T20:07:52.031171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.042471+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:52.042471+0000","last_peered":"2023-10-16T20:07:52.042471+0000","last_clean":"2023-10-16T20:07:52.042471+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:52.042471+0000","last_undegraded":"2023-10-16T20:07:52.042471+0000","last_fullsized":"2023-10-16T20:07:52.042471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:52.002355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.029979+0000","last_change":"2023-10-16T20:07:52.029979+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.029979+0000","last_undegraded":"2023-10-16T20:07:52.029979+0000","last_fullsized":"2023-10-16T20:07:52.029979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.038234+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:52.038234+0000","last_peered":"2023-10-16T20:07:52.038234+0000","last_clean":"2023-10-16T20:07:52.038234+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:52.038234+0000","last_undegraded":"2023-10-16T20:07:52.038234+0000","last_fullsized":"2023-10-16T20:07:52.038234+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:31.838414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-16T20:07:52.023892+0000","last_change":"2023-10-16T20:07:52.023892+0000","last_active":"2023-10-16T20:07:52.013721+0000","last_peered":"2023-10-16T20:07:52.013721+0000","last_clean":"2023-10-16T20:07:52.013721+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T20:07:52.023892+0000","last_undegraded":"2023-10-16T20:07:52.023892+0000","last_fullsized":"2023-10-16T20:07:52.023892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.031280+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.031280+0000","last_peered":"2023-10-16T20:07:53.031280+0000","last_clean":"2023-10-16T20:07:53.031280+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.031280+0000","last_undegraded":"2023-10-16T20:07:53.031280+0000","last_fullsized":"2023-10-16T20:07:53.031280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051483+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:53.051483+0000","last_peered":"2023-10-16T20:07:53.051483+0000","last_clean":"2023-10-16T20:07:53.051483+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:53.051483+0000","last_undegraded":"2023-10-16T20:07:53.051483+0000","last_fullsized":"2023-10-16T20:07:53.051483+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:49:47.359299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027052+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.027052+0000","last_peered":"2023-10-16T20:07:53.027052+0000","last_clean":"2023-10-16T20:07:53.027052+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.027052+0000","last_undegraded":"2023-10-16T20:07:53.027052+0000","last_fullsized":"2023-10-16T20:07:53.027052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.057204+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:53.057204+0000","last_peered":"2023-10-16T20:07:53.057204+0000","last_clean":"2023-10-16T20:07:53.057204+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:53.057204+0000","last_undegraded":"2023-10-16T20:07:53.057204+0000","last_fullsized":"2023-10-16T20:07:53.057204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:05.876451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.047791+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:52.047791+0000","last_peered":"2023-10-16T20:07:52.047791+0000","last_clean":"2023-10-16T20:07:52.047791+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:52.047791+0000","last_undegraded":"2023-10-16T20:07:52.047791+0000","last_fullsized":"2023-10-16T20:07:52.047791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:36.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.053686+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:53.053686+0000","last_peered":"2023-10-16T20:07:53.053686+0000","last_clean":"2023-10-16T20:07:53.053686+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:53.053686+0000","last_undegraded":"2023-10-16T20:07:53.053686+0000","last_fullsized":"2023-10-16T20:07:53.053686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.038910+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.038910+0000","last_peered":"2023-10-16T20:07:53.038910+0000","last_clean":"2023-10-16T20:07:53.038910+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.038910+0000","last_undegraded":"2023-10-16T20:07:53.038910+0000","last_fullsized":"2023-10-16T20:07:53.038910+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T20:07:52.032672+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:52.032672+0000","last_peered":"2023-10-16T20:07:52.032672+0000","last_clean":"2023-10-16T20:07:52.032672+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:52.032672+0000","last_undegraded":"2023-10-16T20:07:52.032672+0000","last_fullsized":"2023-10-16T20:07:52.032672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":786692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.441}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.53200000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59699999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":195224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.52800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.438}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.624}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.75},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":777885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.317},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.33800000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.47099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.307},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.33100000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.246}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.26300000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.77100000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":187517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.315}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.375},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64900000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.68600000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":195246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.5}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.379}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:00.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:00.915 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:01.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:01.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.831+0000 7fbb1ef7d700 1 Processor -- start 2023-10-16T20:08:01.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.831+0000 7fbb1ef7d700 1 -- start start 2023-10-16T20:08:01.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1ef7d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 0x7fbb1815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1ef7d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbb180cbc10 0x7fbb180cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1ef7d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180cd4b0 con 0x7fbb180712e0 2023-10-16T20:08:01.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1ef7d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1815b8f0 con 0x7fbb180cbc10 2023-10-16T20:08:01.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1ef7d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180cc0c0 con 0x7fbb18144ea0 2023-10-16T20:08:01.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1cd19700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbb180712e0 0x7fbb180716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41172/0 (socket says 172.21.15.152:41172) 2023-10-16T20:08:01.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1cd19700 1 -- 172.21.15.152:0/2260022458 learned_addr learned my addr 172.21.15.152:0/2260022458 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:01.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590480353 0 0) 0x7fbb180cd4b0 con 0x7fbb180712e0 2023-10-16T20:08:01.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb1d51a700 1 --2- 172.21.15.152:0/2260022458 >> v2:172.21.15.163:3300/0 conn(0x7fbb180cbc10 0x7fbb180cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb17fff700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 0x7fbb1815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb080035b0 con 0x7fbb180712e0 2023-10-16T20:08:01.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521848933 0 0) 0x7fbb080035b0 con 0x7fbb180712e0 2023-10-16T20:08:01.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 msgr2=0x7fbb1815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:01.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 0x7fbb1815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:01.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 >> v2:172.21.15.163:3300/0 conn(0x7fbb180cbc10 msgr2=0x7fbb180cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:01.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.832+0000 7fbb177fe700 1 --2- 172.21.15.152:0/2260022458 >> v2:172.21.15.163:3300/0 conn(0x7fbb180cbc10 0x7fbb180cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:01.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1815fdb0 con 0x7fbb180712e0 2023-10-16T20:08:01.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7fbb0c001670 con 0x7fbb180712e0 2023-10-16T20:08:01.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 >> v1:172.21.15.152:6789/0 conn(0x7fbb180712e0 legacy=0x7fbb180716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:01.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08003a00 0x7fbb08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb08004850 0x7fbb08004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 0x7fbb08005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1815b8f0 con 0x7fbb08004850 2023-10-16T20:08:01.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180cc0c0 con 0x7fbb08003a00 2023-10-16T20:08:01.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0800ba10 con 0x7fbb18144ea0 2023-10-16T20:08:01.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb08004850 0x7fbb08004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb1cd19700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08003a00 0x7fbb08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb1d51a700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 0x7fbb08005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 -- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 msgr2=0x7fbb08005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:01.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb18144ea0 0x7fbb08005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:01.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 -- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08003a00 msgr2=0x7fbb08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:01.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08003a00 0x7fbb08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:01.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 -- 172.21.15.152:0/2260022458 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080035b0 con 0x7fbb08004850 2023-10-16T20:08:01.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb17fff700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb08004850 0x7fbb08004cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009b60 tx=0x7fbb08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402fbe1efc17d8c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400e6c0 con 0x7fbb08004850 2023-10-16T20:08:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400e820 con 0x7fbb08004850 2023-10-16T20:08:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.833+0000 7fbb177fe700 1 -- 172.21.15.152:0/2260022458 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400eb90 con 0x7fbb08004850 2023-10-16T20:08:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/2260022458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb08004850 msgr2=0x7fbb08004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:01.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/2260022458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb08004850 0x7fbb08004cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009b60 tx=0x7fbb08005880 comp rx=0 tx=0).stop 2023-10-16T20:08:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1d51a700 1 -- 172.21.15.152:0/2260022458 reap_dead start 2023-10-16T20:08:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/2260022458 shutdown_connections 2023-10-16T20:08:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/2260022458 >> 172.21.15.152:0/2260022458 conn(0x7fbb180cfcd0 msgr2=0x7fbb180d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/2260022458 shutdown_connections 2023-10-16T20:08:01.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.834+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/2260022458 wait complete. 2023-10-16T20:08:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.836+0000 7fbb1ef7d700 1 Processor -- start 2023-10-16T20:08:01.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.836+0000 7fbb1ef7d700 1 -- start start 2023-10-16T20:08:01.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1ef7d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08004850 0x7fbb181e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1ef7d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 0x7fbb181f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1ef7d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb181e59d0 0x7fbb1815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1ef7d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180b52d0 con 0x7fbb180b4a80 2023-10-16T20:08:01.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1ef7d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181e5e80 con 0x7fbb08004850 2023-10-16T20:08:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1ef7d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180b4ff0 con 0x7fbb181e59d0 2023-10-16T20:08:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 0x7fbb181f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 0x7fbb181f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60988/0 (socket says 172.21.15.152:60988) 2023-10-16T20:08:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 -- 172.21.15.152:0/72778877 learned_addr learned my addr 172.21.15.152:0/72778877 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:01.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1cd19700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08004850 0x7fbb181e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb1d51a700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb181e59d0 0x7fbb1815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 -- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb181e59d0 msgr2=0x7fbb1815d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb181e59d0 0x7fbb1815d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:01.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 -- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08004850 msgr2=0x7fbb181e7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:01.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08004850 0x7fbb181e7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:01.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 -- 172.21.15.152:0/72778877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb181e4ef0 con 0x7fbb180b4a80 2023-10-16T20:08:01.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb17fff700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 0x7fbb181f0740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbb080046a0 tx=0x7fbb040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:01.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.837+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04021070 con 0x7fbb180b4a80 2023-10-16T20:08:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.838+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb040043f0 con 0x7fbb180b4a80 2023-10-16T20:08:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.838+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400e6c0 con 0x7fbb180b4a80 2023-10-16T20:08:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.838+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb181e51d0 con 0x7fbb180b4a80 2023-10-16T20:08:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.838+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb181e67f0 con 0x7fbb180b4a80 2023-10-16T20:08:01.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.839+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1804ebb0 con 0x7fbb180b4a80 2023-10-16T20:08:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.839+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbb04025070 con 0x7fbb180b4a80 2023-10-16T20:08:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.839+0000 7fbb157fa700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbafc06af00 0x7fbafc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.839+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbb0408a690 con 0x7fbb180b4a80 2023-10-16T20:08:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.840+0000 7fbb1cd19700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbafc06af00 0x7fbafc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:01.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.840+0000 7fbb1cd19700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbafc06af00 0x7fbafc06d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c001120 tx=0x7fbb0c007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:01.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:01.844+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb040555d0 con 0x7fbb180b4a80 2023-10-16T20:08:02.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.032+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb180b52d0 con 0x7fbafc06af00 2023-10-16T20:08:02.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.040+0000 7fbb157fa700 1 -- 172.21.15.152:0/72778877 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288759 (secure 0 0 0) 0x7fbb180b52d0 con 0x7fbafc06af00 2023-10-16T20:08:02.045 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:02.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbafc06af00 msgr2=0x7fbafc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbafc06af00 0x7fbafc06d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c001120 tx=0x7fbb0c007980 comp rx=0 tx=0).stop 2023-10-16T20:08:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 msgr2=0x7fbb181f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 0x7fbb181f0740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbb080046a0 tx=0x7fbb040047c0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 shutdown_connections 2023-10-16T20:08:02.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbafc06af00 0x7fbafc06d3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbb181e59d0 0x7fbb1815d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb08004850 0x7fbb181e7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 --2- 172.21.15.152:0/72778877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb180b4a80 0x7fbb181f0740 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 >> 172.21.15.152:0/72778877 conn(0x7fbb180cfcd0 msgr2=0x7fbb1815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:02.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 shutdown_connections 2023-10-16T20:08:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.043+0000 7fbb1ef7d700 1 -- 172.21.15.152:0/72778877 wait complete. 2023-10-16T20:08:02.050 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:02.058 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-10-16T20:08:00.785932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2795852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001676"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023225+0000","last_change":"2023-10-16T20:07:53.032076+0000","last_active":"2023-10-16T20:07:54.023225+0000","last_peered":"2023-10-16T20:07:54.023225+0000","last_clean":"2023-10-16T20:07:54.023225+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:07:54.023225+0000","last_undegraded":"2023-10-16T20:07:54.023225+0000","last_fullsized":"2023-10-16T20:07:54.023225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:53.865740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023105+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:07:54.023105+0000","last_peered":"2023-10-16T20:07:54.023105+0000","last_clean":"2023-10-16T20:07:54.023105+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:07:54.023105+0000","last_undegraded":"2023-10-16T20:07:54.023105+0000","last_fullsized":"2023-10-16T20:07:54.023105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:56.088181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269135+0000","last_change":"2023-10-16T20:07:53.041956+0000","last_active":"2023-10-16T20:07:54.269135+0000","last_peered":"2023-10-16T20:07:54.269135+0000","last_clean":"2023-10-16T20:07:54.269135+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:07:54.269135+0000","last_undegraded":"2023-10-16T20:07:54.269135+0000","last_fullsized":"2023-10-16T20:07:54.269135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:09.257087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101183+0000","last_change":"2023-10-16T20:07:53.037791+0000","last_active":"2023-10-16T20:07:54.101183+0000","last_peered":"2023-10-16T20:07:54.101183+0000","last_clean":"2023-10-16T20:07:54.101183+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:07:54.101183+0000","last_undegraded":"2023-10-16T20:07:54.101183+0000","last_fullsized":"2023-10-16T20:07:54.101183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:17.460962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101028+0000","last_change":"2023-10-16T20:07:53.037496+0000","last_active":"2023-10-16T20:07:54.101028+0000","last_peered":"2023-10-16T20:07:54.101028+0000","last_clean":"2023-10-16T20:07:54.101028+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:07:54.101028+0000","last_undegraded":"2023-10-16T20:07:54.101028+0000","last_fullsized":"2023-10-16T20:07:54.101028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:32.843327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269118+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269118+0000","last_peered":"2023-10-16T20:07:54.269118+0000","last_clean":"2023-10-16T20:07:54.269118+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:07:54.269118+0000","last_undegraded":"2023-10-16T20:07:54.269118+0000","last_fullsized":"2023-10-16T20:07:54.269118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103476+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:54.103476+0000","last_peered":"2023-10-16T20:07:54.103476+0000","last_clean":"2023-10-16T20:07:54.103476+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:54.103476+0000","last_undegraded":"2023-10-16T20:07:54.103476+0000","last_fullsized":"2023-10-16T20:07:54.103476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.022889+0000","last_change":"2023-10-16T20:07:53.031550+0000","last_active":"2023-10-16T20:07:54.022889+0000","last_peered":"2023-10-16T20:07:54.022889+0000","last_clean":"2023-10-16T20:07:54.022889+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:07:54.022889+0000","last_undegraded":"2023-10-16T20:07:54.022889+0000","last_fullsized":"2023-10-16T20:07:54.022889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:03:49.996848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269666+0000","last_change":"2023-10-16T20:07:53.053620+0000","last_active":"2023-10-16T20:07:54.269666+0000","last_peered":"2023-10-16T20:07:54.269666+0000","last_clean":"2023-10-16T20:07:54.269666+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:07:54.269666+0000","last_undegraded":"2023-10-16T20:07:54.269666+0000","last_fullsized":"2023-10-16T20:07:54.269666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103613+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:54.103613+0000","last_peered":"2023-10-16T20:07:54.103613+0000","last_clean":"2023-10-16T20:07:54.103613+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:54.103613+0000","last_undegraded":"2023-10-16T20:07:54.103613+0000","last_fullsized":"2023-10-16T20:07:54.103613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:09.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103704+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:54.103704+0000","last_peered":"2023-10-16T20:07:54.103704+0000","last_clean":"2023-10-16T20:07:54.103704+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:54.103704+0000","last_undegraded":"2023-10-16T20:07:54.103704+0000","last_fullsized":"2023-10-16T20:07:54.103704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:33.300151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269358+0000","last_change":"2023-10-16T20:07:53.038955+0000","last_active":"2023-10-16T20:07:54.269358+0000","last_peered":"2023-10-16T20:07:54.269358+0000","last_clean":"2023-10-16T20:07:54.269358+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:07:54.269358+0000","last_undegraded":"2023-10-16T20:07:54.269358+0000","last_fullsized":"2023-10-16T20:07:54.269358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103406+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:54.103406+0000","last_peered":"2023-10-16T20:07:54.103406+0000","last_clean":"2023-10-16T20:07:54.103406+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:54.103406+0000","last_undegraded":"2023-10-16T20:07:54.103406+0000","last_fullsized":"2023-10-16T20:07:54.103406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025328+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:54.025328+0000","last_peered":"2023-10-16T20:07:54.025328+0000","last_clean":"2023-10-16T20:07:54.025328+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:54.025328+0000","last_undegraded":"2023-10-16T20:07:54.025328+0000","last_fullsized":"2023-10-16T20:07:54.025328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103294+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:54.103294+0000","last_peered":"2023-10-16T20:07:54.103294+0000","last_clean":"2023-10-16T20:07:54.103294+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:54.103294+0000","last_undegraded":"2023-10-16T20:07:54.103294+0000","last_fullsized":"2023-10-16T20:07:54.103294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269416+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:54.269416+0000","last_peered":"2023-10-16T20:07:54.269416+0000","last_clean":"2023-10-16T20:07:54.269416+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:54.269416+0000","last_undegraded":"2023-10-16T20:07:54.269416+0000","last_fullsized":"2023-10-16T20:07:54.269416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:27.018295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269948+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:54.269948+0000","last_peered":"2023-10-16T20:07:54.269948+0000","last_clean":"2023-10-16T20:07:54.269948+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:54.269948+0000","last_undegraded":"2023-10-16T20:07:54.269948+0000","last_fullsized":"2023-10-16T20:07:54.269948+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025037+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:54.025037+0000","last_peered":"2023-10-16T20:07:54.025037+0000","last_clean":"2023-10-16T20:07:54.025037+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:54.025037+0000","last_undegraded":"2023-10-16T20:07:54.025037+0000","last_fullsized":"2023-10-16T20:07:54.025037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101108+0000","last_change":"2023-10-16T20:07:53.036516+0000","last_active":"2023-10-16T20:07:54.101108+0000","last_peered":"2023-10-16T20:07:54.101108+0000","last_clean":"2023-10-16T20:07:54.101108+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:07:54.101108+0000","last_undegraded":"2023-10-16T20:07:54.101108+0000","last_fullsized":"2023-10-16T20:07:54.101108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:53.007268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024266+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:54.024266+0000","last_peered":"2023-10-16T20:07:54.024266+0000","last_clean":"2023-10-16T20:07:54.024266+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:54.024266+0000","last_undegraded":"2023-10-16T20:07:54.024266+0000","last_fullsized":"2023-10-16T20:07:54.024266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103499+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:54.103499+0000","last_peered":"2023-10-16T20:07:54.103499+0000","last_clean":"2023-10-16T20:07:54.103499+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:54.103499+0000","last_undegraded":"2023-10-16T20:07:54.103499+0000","last_fullsized":"2023-10-16T20:07:54.103499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:38.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024960+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:54.024960+0000","last_peered":"2023-10-16T20:07:54.024960+0000","last_clean":"2023-10-16T20:07:54.024960+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:54.024960+0000","last_undegraded":"2023-10-16T20:07:54.024960+0000","last_fullsized":"2023-10-16T20:07:54.024960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269612+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:54.269612+0000","last_peered":"2023-10-16T20:07:54.269612+0000","last_clean":"2023-10-16T20:07:54.269612+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:54.269612+0000","last_undegraded":"2023-10-16T20:07:54.269612+0000","last_fullsized":"2023-10-16T20:07:54.269612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:12.377109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101006+0000","last_change":"2023-10-16T20:07:53.049683+0000","last_active":"2023-10-16T20:07:54.101006+0000","last_peered":"2023-10-16T20:07:54.101006+0000","last_clean":"2023-10-16T20:07:54.101006+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:07:54.101006+0000","last_undegraded":"2023-10-16T20:07:54.101006+0000","last_fullsized":"2023-10-16T20:07:54.101006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:06.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024377+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:54.024377+0000","last_peered":"2023-10-16T20:07:54.024377+0000","last_clean":"2023-10-16T20:07:54.024377+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:54.024377+0000","last_undegraded":"2023-10-16T20:07:54.024377+0000","last_fullsized":"2023-10-16T20:07:54.024377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269284+0000","last_change":"2023-10-16T20:07:53.041714+0000","last_active":"2023-10-16T20:07:54.269284+0000","last_peered":"2023-10-16T20:07:54.269284+0000","last_clean":"2023-10-16T20:07:54.269284+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:07:54.269284+0000","last_undegraded":"2023-10-16T20:07:54.269284+0000","last_fullsized":"2023-10-16T20:07:54.269284+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024374+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:54.024374+0000","last_peered":"2023-10-16T20:07:54.024374+0000","last_clean":"2023-10-16T20:07:54.024374+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:54.024374+0000","last_undegraded":"2023-10-16T20:07:54.024374+0000","last_fullsized":"2023-10-16T20:07:54.024374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103586+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:54.103586+0000","last_peered":"2023-10-16T20:07:54.103586+0000","last_clean":"2023-10-16T20:07:54.103586+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:54.103586+0000","last_undegraded":"2023-10-16T20:07:54.103586+0000","last_fullsized":"2023-10-16T20:07:54.103586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:14.506216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024418+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:54.024418+0000","last_peered":"2023-10-16T20:07:54.024418+0000","last_clean":"2023-10-16T20:07:54.024418+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:54.024418+0000","last_undegraded":"2023-10-16T20:07:54.024418+0000","last_fullsized":"2023-10-16T20:07:54.024418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024148+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:54.024148+0000","last_peered":"2023-10-16T20:07:54.024148+0000","last_clean":"2023-10-16T20:07:54.024148+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:54.024148+0000","last_undegraded":"2023-10-16T20:07:54.024148+0000","last_fullsized":"2023-10-16T20:07:54.024148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269484+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:54.269484+0000","last_peered":"2023-10-16T20:07:54.269484+0000","last_clean":"2023-10-16T20:07:54.269484+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:54.269484+0000","last_undegraded":"2023-10-16T20:07:54.269484+0000","last_fullsized":"2023-10-16T20:07:54.269484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268972+0000","last_change":"2023-10-16T20:07:53.033516+0000","last_active":"2023-10-16T20:07:54.268972+0000","last_peered":"2023-10-16T20:07:54.268972+0000","last_clean":"2023-10-16T20:07:54.268972+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:07:54.268972+0000","last_undegraded":"2023-10-16T20:07:54.268972+0000","last_fullsized":"2023-10-16T20:07:54.268972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269908+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:54.269908+0000","last_peered":"2023-10-16T20:07:54.269908+0000","last_clean":"2023-10-16T20:07:54.269908+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:54.269908+0000","last_undegraded":"2023-10-16T20:07:54.269908+0000","last_fullsized":"2023-10-16T20:07:54.269908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963697+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.963697+0000","last_peered":"2023-10-16T20:07:53.963697+0000","last_clean":"2023-10-16T20:07:53.963697+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.963697+0000","last_undegraded":"2023-10-16T20:07:53.963697+0000","last_fullsized":"2023-10-16T20:07:53.963697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269553+0000","last_change":"2023-10-16T20:07:53.041621+0000","last_active":"2023-10-16T20:07:54.269553+0000","last_peered":"2023-10-16T20:07:54.269553+0000","last_clean":"2023-10-16T20:07:54.269553+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:07:54.269553+0000","last_undegraded":"2023-10-16T20:07:54.269553+0000","last_fullsized":"2023-10-16T20:07:54.269553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:22:48.459709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051925+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:53.051925+0000","last_peered":"2023-10-16T20:07:53.051925+0000","last_clean":"2023-10-16T20:07:53.051925+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:53.051925+0000","last_undegraded":"2023-10-16T20:07:53.051925+0000","last_fullsized":"2023-10-16T20:07:53.051925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025298+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:54.025298+0000","last_peered":"2023-10-16T20:07:54.025298+0000","last_clean":"2023-10-16T20:07:54.025298+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:54.025298+0000","last_undegraded":"2023-10-16T20:07:54.025298+0000","last_fullsized":"2023-10-16T20:07:54.025298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056466+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:53.056466+0000","last_peered":"2023-10-16T20:07:53.056466+0000","last_clean":"2023-10-16T20:07:53.056466+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:53.056466+0000","last_undegraded":"2023-10-16T20:07:53.056466+0000","last_fullsized":"2023-10-16T20:07:53.056466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:17.552698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023330+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:07:54.023330+0000","last_peered":"2023-10-16T20:07:54.023330+0000","last_clean":"2023-10-16T20:07:54.023330+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:07:54.023330+0000","last_undegraded":"2023-10-16T20:07:54.023330+0000","last_fullsized":"2023-10-16T20:07:54.023330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:50:53.891138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962423+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.962423+0000","last_peered":"2023-10-16T20:07:53.962423+0000","last_clean":"2023-10-16T20:07:53.962423+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.962423+0000","last_undegraded":"2023-10-16T20:07:53.962423+0000","last_fullsized":"2023-10-16T20:07:53.962423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269292+0000","last_change":"2023-10-16T20:07:53.031450+0000","last_active":"2023-10-16T20:07:54.269292+0000","last_peered":"2023-10-16T20:07:54.269292+0000","last_clean":"2023-10-16T20:07:54.269292+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:07:54.269292+0000","last_undegraded":"2023-10-16T20:07:54.269292+0000","last_fullsized":"2023-10-16T20:07:54.269292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962521+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.962521+0000","last_peered":"2023-10-16T20:07:53.962521+0000","last_clean":"2023-10-16T20:07:53.962521+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.962521+0000","last_undegraded":"2023-10-16T20:07:53.962521+0000","last_fullsized":"2023-10-16T20:07:53.962521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103297+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:54.103297+0000","last_peered":"2023-10-16T20:07:54.103297+0000","last_clean":"2023-10-16T20:07:54.103297+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:54.103297+0000","last_undegraded":"2023-10-16T20:07:54.103297+0000","last_fullsized":"2023-10-16T20:07:54.103297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964077+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.964077+0000","last_peered":"2023-10-16T20:07:53.964077+0000","last_clean":"2023-10-16T20:07:53.964077+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.964077+0000","last_undegraded":"2023-10-16T20:07:53.964077+0000","last_fullsized":"2023-10-16T20:07:53.964077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025136+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:54.025136+0000","last_peered":"2023-10-16T20:07:54.025136+0000","last_clean":"2023-10-16T20:07:54.025136+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:54.025136+0000","last_undegraded":"2023-10-16T20:07:54.025136+0000","last_fullsized":"2023-10-16T20:07:54.025136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026238+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:53.026238+0000","last_peered":"2023-10-16T20:07:53.026238+0000","last_clean":"2023-10-16T20:07:53.026238+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:53.026238+0000","last_undegraded":"2023-10-16T20:07:53.026238+0000","last_fullsized":"2023-10-16T20:07:53.026238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.960835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023237+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:07:54.023237+0000","last_peered":"2023-10-16T20:07:54.023237+0000","last_clean":"2023-10-16T20:07:54.023237+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:07:54.023237+0000","last_undegraded":"2023-10-16T20:07:54.023237+0000","last_fullsized":"2023-10-16T20:07:54.023237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:10.581126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962309+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.962309+0000","last_peered":"2023-10-16T20:07:53.962309+0000","last_clean":"2023-10-16T20:07:53.962309+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.962309+0000","last_undegraded":"2023-10-16T20:07:53.962309+0000","last_fullsized":"2023-10-16T20:07:53.962309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101256+0000","last_change":"2023-10-16T20:07:53.038082+0000","last_active":"2023-10-16T20:07:54.101256+0000","last_peered":"2023-10-16T20:07:54.101256+0000","last_clean":"2023-10-16T20:07:54.101256+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:07:54.101256+0000","last_undegraded":"2023-10-16T20:07:54.101256+0000","last_fullsized":"2023-10-16T20:07:54.101256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:06.955879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022694+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:53.022694+0000","last_peered":"2023-10-16T20:07:53.022694+0000","last_clean":"2023-10-16T20:07:53.022694+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:53.022694+0000","last_undegraded":"2023-10-16T20:07:53.022694+0000","last_fullsized":"2023-10-16T20:07:53.022694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:26.475876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269796+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:54.269796+0000","last_peered":"2023-10-16T20:07:54.269796+0000","last_clean":"2023-10-16T20:07:54.269796+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:54.269796+0000","last_undegraded":"2023-10-16T20:07:54.269796+0000","last_fullsized":"2023-10-16T20:07:54.269796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962629+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.962629+0000","last_peered":"2023-10-16T20:07:53.962629+0000","last_clean":"2023-10-16T20:07:53.962629+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.962629+0000","last_undegraded":"2023-10-16T20:07:53.962629+0000","last_fullsized":"2023-10-16T20:07:53.962629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269544+0000","last_change":"2023-10-16T20:07:53.048262+0000","last_active":"2023-10-16T20:07:54.269544+0000","last_peered":"2023-10-16T20:07:54.269544+0000","last_clean":"2023-10-16T20:07:54.269544+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:07:54.269544+0000","last_undegraded":"2023-10-16T20:07:54.269544+0000","last_fullsized":"2023-10-16T20:07:54.269544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962580+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.962580+0000","last_peered":"2023-10-16T20:07:53.962580+0000","last_clean":"2023-10-16T20:07:53.962580+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.962580+0000","last_undegraded":"2023-10-16T20:07:53.962580+0000","last_fullsized":"2023-10-16T20:07:53.962580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025162+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:54.025162+0000","last_peered":"2023-10-16T20:07:54.025162+0000","last_clean":"2023-10-16T20:07:54.025162+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:54.025162+0000","last_undegraded":"2023-10-16T20:07:54.025162+0000","last_fullsized":"2023-10-16T20:07:54.025162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061493+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:53.061493+0000","last_peered":"2023-10-16T20:07:53.061493+0000","last_clean":"2023-10-16T20:07:53.061493+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:53.061493+0000","last_undegraded":"2023-10-16T20:07:53.061493+0000","last_fullsized":"2023-10-16T20:07:53.061493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:54.643651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269104+0000","last_change":"2023-10-16T20:07:53.048961+0000","last_active":"2023-10-16T20:07:54.269104+0000","last_peered":"2023-10-16T20:07:54.269104+0000","last_clean":"2023-10-16T20:07:54.269104+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:07:54.269104+0000","last_undegraded":"2023-10-16T20:07:54.269104+0000","last_fullsized":"2023-10-16T20:07:54.269104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:58.965748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048654+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:53.048654+0000","last_peered":"2023-10-16T20:07:53.048654+0000","last_clean":"2023-10-16T20:07:53.048654+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:53.048654+0000","last_undegraded":"2023-10-16T20:07:53.048654+0000","last_fullsized":"2023-10-16T20:07:53.048654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:19.484561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023303+0000","last_change":"2023-10-16T20:07:53.031630+0000","last_active":"2023-10-16T20:07:54.023303+0000","last_peered":"2023-10-16T20:07:54.023303+0000","last_clean":"2023-10-16T20:07:54.023303+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:07:54.023303+0000","last_undegraded":"2023-10-16T20:07:54.023303+0000","last_fullsized":"2023-10-16T20:07:54.023303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:19.312981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.025675+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:53.025675+0000","last_peered":"2023-10-16T20:07:53.025675+0000","last_clean":"2023-10-16T20:07:53.025675+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:53.025675+0000","last_undegraded":"2023-10-16T20:07:53.025675+0000","last_fullsized":"2023-10-16T20:07:53.025675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269686+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:54.269686+0000","last_peered":"2023-10-16T20:07:54.269686+0000","last_clean":"2023-10-16T20:07:54.269686+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:54.269686+0000","last_undegraded":"2023-10-16T20:07:54.269686+0000","last_fullsized":"2023-10-16T20:07:54.269686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:07.194764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963564+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.963564+0000","last_peered":"2023-10-16T20:07:53.963564+0000","last_clean":"2023-10-16T20:07:53.963564+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.963564+0000","last_undegraded":"2023-10-16T20:07:53.963564+0000","last_fullsized":"2023-10-16T20:07:53.963564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023252+0000","last_change":"2023-10-16T20:07:53.029968+0000","last_active":"2023-10-16T20:07:54.023252+0000","last_peered":"2023-10-16T20:07:54.023252+0000","last_clean":"2023-10-16T20:07:54.023252+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:07:54.023252+0000","last_undegraded":"2023-10-16T20:07:54.023252+0000","last_fullsized":"2023-10-16T20:07:54.023252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:25.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963991+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.963991+0000","last_peered":"2023-10-16T20:07:53.963991+0000","last_clean":"2023-10-16T20:07:53.963991+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.963991+0000","last_undegraded":"2023-10-16T20:07:53.963991+0000","last_fullsized":"2023-10-16T20:07:53.963991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023028+0000","last_change":"2023-10-16T20:07:53.037655+0000","last_active":"2023-10-16T20:07:54.023028+0000","last_peered":"2023-10-16T20:07:54.023028+0000","last_clean":"2023-10-16T20:07:54.023028+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:07:54.023028+0000","last_undegraded":"2023-10-16T20:07:54.023028+0000","last_fullsized":"2023-10-16T20:07:54.023028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:13.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962674+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.962674+0000","last_peered":"2023-10-16T20:07:53.962674+0000","last_clean":"2023-10-16T20:07:53.962674+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.962674+0000","last_undegraded":"2023-10-16T20:07:53.962674+0000","last_fullsized":"2023-10-16T20:07:53.962674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103796+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:54.103796+0000","last_peered":"2023-10-16T20:07:54.103796+0000","last_clean":"2023-10-16T20:07:54.103796+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:54.103796+0000","last_undegraded":"2023-10-16T20:07:54.103796+0000","last_fullsized":"2023-10-16T20:07:54.103796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:53.656150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962461+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.962461+0000","last_peered":"2023-10-16T20:07:53.962461+0000","last_clean":"2023-10-16T20:07:53.962461+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.962461+0000","last_undegraded":"2023-10-16T20:07:53.962461+0000","last_fullsized":"2023-10-16T20:07:53.962461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025395+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:54.025395+0000","last_peered":"2023-10-16T20:07:54.025395+0000","last_clean":"2023-10-16T20:07:54.025395+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:54.025395+0000","last_undegraded":"2023-10-16T20:07:54.025395+0000","last_fullsized":"2023-10-16T20:07:54.025395+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061109+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:53.061109+0000","last_peered":"2023-10-16T20:07:53.061109+0000","last_clean":"2023-10-16T20:07:53.061109+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:53.061109+0000","last_undegraded":"2023-10-16T20:07:53.061109+0000","last_fullsized":"2023-10-16T20:07:53.061109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101320+0000","last_change":"2023-10-16T20:07:53.039457+0000","last_active":"2023-10-16T20:07:54.101320+0000","last_peered":"2023-10-16T20:07:54.101320+0000","last_clean":"2023-10-16T20:07:54.101320+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:07:54.101320+0000","last_undegraded":"2023-10-16T20:07:54.101320+0000","last_fullsized":"2023-10-16T20:07:54.101320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:35.056763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026529+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:53.026529+0000","last_peered":"2023-10-16T20:07:53.026529+0000","last_clean":"2023-10-16T20:07:53.026529+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:53.026529+0000","last_undegraded":"2023-10-16T20:07:53.026529+0000","last_fullsized":"2023-10-16T20:07:53.026529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:03.961940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269527+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:54.269527+0000","last_peered":"2023-10-16T20:07:54.269527+0000","last_clean":"2023-10-16T20:07:54.269527+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:54.269527+0000","last_undegraded":"2023-10-16T20:07:54.269527+0000","last_fullsized":"2023-10-16T20:07:54.269527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:11.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051159+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:53.051159+0000","last_peered":"2023-10-16T20:07:53.051159+0000","last_clean":"2023-10-16T20:07:53.051159+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:53.051159+0000","last_undegraded":"2023-10-16T20:07:53.051159+0000","last_fullsized":"2023-10-16T20:07:53.051159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:21.527524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269159+0000","last_change":"2023-10-16T20:07:53.048171+0000","last_active":"2023-10-16T20:07:54.269159+0000","last_peered":"2023-10-16T20:07:54.269159+0000","last_clean":"2023-10-16T20:07:54.269159+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:07:54.269159+0000","last_undegraded":"2023-10-16T20:07:54.269159+0000","last_fullsized":"2023-10-16T20:07:54.269159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:04.966853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027784+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:53.027784+0000","last_peered":"2023-10-16T20:07:53.027784+0000","last_clean":"2023-10-16T20:07:53.027784+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:53.027784+0000","last_undegraded":"2023-10-16T20:07:53.027784+0000","last_fullsized":"2023-10-16T20:07:53.027784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:53.685902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103386+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:54.103386+0000","last_peered":"2023-10-16T20:07:54.103386+0000","last_clean":"2023-10-16T20:07:54.103386+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:54.103386+0000","last_undegraded":"2023-10-16T20:07:54.103386+0000","last_fullsized":"2023-10-16T20:07:54.103386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964052+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.964052+0000","last_peered":"2023-10-16T20:07:53.964052+0000","last_clean":"2023-10-16T20:07:53.964052+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.964052+0000","last_undegraded":"2023-10-16T20:07:53.964052+0000","last_fullsized":"2023-10-16T20:07:53.964052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023079+0000","last_change":"2023-10-16T20:07:53.051277+0000","last_active":"2023-10-16T20:07:54.023079+0000","last_peered":"2023-10-16T20:07:54.023079+0000","last_clean":"2023-10-16T20:07:54.023079+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:07:54.023079+0000","last_undegraded":"2023-10-16T20:07:54.023079+0000","last_fullsized":"2023-10-16T20:07:54.023079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:09.587579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.028961+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:53.028961+0000","last_peered":"2023-10-16T20:07:53.028961+0000","last_clean":"2023-10-16T20:07:53.028961+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:53.028961+0000","last_undegraded":"2023-10-16T20:07:53.028961+0000","last_fullsized":"2023-10-16T20:07:53.028961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:42.884671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269491+0000","last_change":"2023-10-16T20:07:53.042042+0000","last_active":"2023-10-16T20:07:54.269491+0000","last_peered":"2023-10-16T20:07:54.269491+0000","last_clean":"2023-10-16T20:07:54.269491+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:07:54.269491+0000","last_undegraded":"2023-10-16T20:07:54.269491+0000","last_fullsized":"2023-10-16T20:07:54.269491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962687+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.962687+0000","last_peered":"2023-10-16T20:07:53.962687+0000","last_clean":"2023-10-16T20:07:53.962687+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.962687+0000","last_undegraded":"2023-10-16T20:07:53.962687+0000","last_fullsized":"2023-10-16T20:07:53.962687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269825+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:54.269825+0000","last_peered":"2023-10-16T20:07:54.269825+0000","last_clean":"2023-10-16T20:07:54.269825+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:54.269825+0000","last_undegraded":"2023-10-16T20:07:54.269825+0000","last_fullsized":"2023-10-16T20:07:54.269825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101285+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:54.101285+0000","last_peered":"2023-10-16T20:07:54.101285+0000","last_clean":"2023-10-16T20:07:54.101285+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:54.101285+0000","last_undegraded":"2023-10-16T20:07:54.101285+0000","last_fullsized":"2023-10-16T20:07:54.101285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:19.786064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023295+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:07:54.023295+0000","last_peered":"2023-10-16T20:07:54.023295+0000","last_clean":"2023-10-16T20:07:54.023295+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:07:54.023295+0000","last_undegraded":"2023-10-16T20:07:54.023295+0000","last_fullsized":"2023-10-16T20:07:54.023295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027338+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:53.027338+0000","last_peered":"2023-10-16T20:07:53.027338+0000","last_clean":"2023-10-16T20:07:53.027338+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:53.027338+0000","last_undegraded":"2023-10-16T20:07:53.027338+0000","last_fullsized":"2023-10-16T20:07:53.027338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269278+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269278+0000","last_peered":"2023-10-16T20:07:54.269278+0000","last_clean":"2023-10-16T20:07:54.269278+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:07:54.269278+0000","last_undegraded":"2023-10-16T20:07:54.269278+0000","last_fullsized":"2023-10-16T20:07:54.269278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027463+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:53.027463+0000","last_peered":"2023-10-16T20:07:53.027463+0000","last_clean":"2023-10-16T20:07:53.027463+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:53.027463+0000","last_undegraded":"2023-10-16T20:07:53.027463+0000","last_fullsized":"2023-10-16T20:07:53.027463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268970+0000","last_change":"2023-10-16T20:07:53.036387+0000","last_active":"2023-10-16T20:07:54.268970+0000","last_peered":"2023-10-16T20:07:54.268970+0000","last_clean":"2023-10-16T20:07:54.268970+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:07:54.268970+0000","last_undegraded":"2023-10-16T20:07:54.268970+0000","last_fullsized":"2023-10-16T20:07:54.268970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963596+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.963596+0000","last_peered":"2023-10-16T20:07:53.963596+0000","last_clean":"2023-10-16T20:07:53.963596+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.963596+0000","last_undegraded":"2023-10-16T20:07:53.963596+0000","last_fullsized":"2023-10-16T20:07:53.963596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025267+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:54.025267+0000","last_peered":"2023-10-16T20:07:54.025267+0000","last_clean":"2023-10-16T20:07:54.025267+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:54.025267+0000","last_undegraded":"2023-10-16T20:07:54.025267+0000","last_fullsized":"2023-10-16T20:07:54.025267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962334+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.962334+0000","last_peered":"2023-10-16T20:07:53.962334+0000","last_clean":"2023-10-16T20:07:53.962334+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.962334+0000","last_undegraded":"2023-10-16T20:07:53.962334+0000","last_fullsized":"2023-10-16T20:07:53.962334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269794+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:54.269794+0000","last_peered":"2023-10-16T20:07:54.269794+0000","last_clean":"2023-10-16T20:07:54.269794+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:54.269794+0000","last_undegraded":"2023-10-16T20:07:54.269794+0000","last_fullsized":"2023-10-16T20:07:54.269794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022176+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:53.022176+0000","last_peered":"2023-10-16T20:07:53.022176+0000","last_clean":"2023-10-16T20:07:53.022176+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:53.022176+0000","last_undegraded":"2023-10-16T20:07:53.022176+0000","last_fullsized":"2023-10-16T20:07:53.022176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103809+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:54.103809+0000","last_peered":"2023-10-16T20:07:54.103809+0000","last_clean":"2023-10-16T20:07:54.103809+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:54.103809+0000","last_undegraded":"2023-10-16T20:07:54.103809+0000","last_fullsized":"2023-10-16T20:07:54.103809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:22.531060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964119+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.964119+0000","last_peered":"2023-10-16T20:07:53.964119+0000","last_clean":"2023-10-16T20:07:53.964119+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.964119+0000","last_undegraded":"2023-10-16T20:07:53.964119+0000","last_fullsized":"2023-10-16T20:07:53.964119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039606+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:53.039606+0000","last_peered":"2023-10-16T20:07:53.039606+0000","last_clean":"2023-10-16T20:07:53.039606+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:53.039606+0000","last_undegraded":"2023-10-16T20:07:53.039606+0000","last_fullsized":"2023-10-16T20:07:53.039606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":793337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52600000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.497},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.63100000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.752},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.77300000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":201869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.437},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.63},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.69599999999999995}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.76300000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.374}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44900000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.505},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.623}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53000000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.315}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.35799999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.45500000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.501}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.253},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.315}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.29599999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.505},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48499999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.313},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.38900000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54300000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.629},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.50900000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.73699999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.627}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.79600000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65300000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38300000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.63},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:02.064 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T20:08:02.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-16T20:08:02.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.224+0000 7f8ea8086700 1 Processor -- start 2023-10-16T20:08:02.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.224+0000 7f8ea8086700 1 -- start start 2023-10-16T20:08:02.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea8086700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea0155af0 0x7f8ea0070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea8086700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ea00cbd00 0x7f8ea00d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea8086700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8ea00b2d00 0x7f8ea00b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea8086700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea0155ed0 con 0x7f8ea00cbd00 2023-10-16T20:08:02.229 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea8086700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00b36d0 con 0x7f8ea00b2d00 2023-10-16T20:08:02.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea8086700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0070310 con 0x7f8ea0155af0 2023-10-16T20:08:02.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ea00cbd00 0x7f8ea00d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ea00cbd00 0x7f8ea00d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60994/0 (socket says 172.21.15.152:60994) 2023-10-16T20:08:02.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 -- 172.21.15.152:0/4000013417 learned_addr learned my addr 172.21.15.152:0/4000013417 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:02.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5e22700 1 --2- 172.21.15.152:0/4000013417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea0155af0 0x7f8ea0070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea6623700 1 --2- 172.21.15.152:0/4000013417 >> v2:172.21.15.163:3300/0 conn(0x7f8ea00b2d00 0x7f8ea00b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 -- 172.21.15.152:0/4000013417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea0155af0 msgr2=0x7f8ea0070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 --2- 172.21.15.152:0/4000013417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea0155af0 0x7f8ea0070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 -- 172.21.15.152:0/4000013417 >> v2:172.21.15.163:3300/0 conn(0x7f8ea00b2d00 msgr2=0x7f8ea00b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 --2- 172.21.15.152:0/4000013417 >> v2:172.21.15.163:3300/0 conn(0x7f8ea00b2d00 0x7f8ea00b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 -- 172.21.15.152:0/4000013417 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00cc180 con 0x7f8ea00cbd00 2023-10-16T20:08:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea5621700 1 --2- 172.21.15.152:0/4000013417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea00cbd00 0x7f8ea00d0400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b0c90 tx=0x7f8e90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cec704959d7ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea4e20700 1 -- 172.21.15.152:0/4000013417 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000b870 con 0x7f8ea00cbd00 2023-10-16T20:08:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea4e20700 1 -- 172.21.15.152:0/4000013417 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000b9d0 con 0x7f8ea00cbd00 2023-10-16T20:08:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.225+0000 7f8ea4e20700 1 -- 172.21.15.152:0/4000013417 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000bd60 con 0x7f8ea00cbd00 2023-10-16T20:08:02.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 -- 172.21.15.152:0/4000013417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea00cbd00 msgr2=0x7f8ea00d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 --2- 172.21.15.152:0/4000013417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea00cbd00 0x7f8ea00d0400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b0c90 tx=0x7f8e90009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 -- 172.21.15.152:0/4000013417 shutdown_connections 2023-10-16T20:08:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 --2- 172.21.15.152:0/4000013417 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea0155af0 0x7f8ea0070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 --2- 172.21.15.152:0/4000013417 >> v2:172.21.15.163:3300/0 conn(0x7f8ea00b2d00 0x7f8ea00b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 --2- 172.21.15.152:0/4000013417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea00cbd00 0x7f8ea00d0400 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 -- 172.21.15.152:0/4000013417 >> 172.21.15.152:0/4000013417 conn(0x7f8ea00cdd00 msgr2=0x7f8ea00ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:02.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 -- 172.21.15.152:0/4000013417 shutdown_connections 2023-10-16T20:08:02.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.226+0000 7f8ea8086700 1 -- 172.21.15.152:0/4000013417 wait complete. 2023-10-16T20:08:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.228+0000 7f8ea8086700 1 Processor -- start 2023-10-16T20:08:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.228+0000 7f8ea8086700 1 -- start start 2023-10-16T20:08:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ea00b2d00 0x7f8ea00b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea00cbd00 0x7f8ea00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 0x7f8ea00b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00c7a10 con 0x7f8ea0155af0 2023-10-16T20:08:02.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00b4e70 con 0x7f8ea00b2d00 2023-10-16T20:08:02.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea015ddb0 con 0x7f8ea00cbd00 2023-10-16T20:08:02.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 0x7f8ea00b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 0x7f8ea00b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32770/0 (socket says 172.21.15.152:32770) 2023-10-16T20:08:02.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 -- 172.21.15.152:0/1437690767 learned_addr learned my addr 172.21.15.152:0/1437690767 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:02.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea5621700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea00cbd00 0x7f8ea00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea5e22700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ea00b2d00 0x7f8ea00b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 -- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea00cbd00 msgr2=0x7f8ea00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea00cbd00 0x7f8ea00b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 -- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ea00b2d00 msgr2=0x7f8ea00b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ea00b2d00 0x7f8ea00b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 -- 172.21.15.152:0/1437690767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90009550 con 0x7f8ea0155af0 2023-10-16T20:08:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea6623700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 0x7f8ea00b1cd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8e98007e70 tx=0x7f8e9800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800ee50 con 0x7f8ea0155af0 2023-10-16T20:08:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98014420 con 0x7f8ea0155af0 2023-10-16T20:08:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea00c7170 con 0x7f8ea0155af0 2023-10-16T20:08:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980147d0 con 0x7f8ea0155af0 2023-10-16T20:08:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.229+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea00c7730 con 0x7f8ea0155af0 2023-10-16T20:08:02.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.230+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea004ebb0 con 0x7f8ea0155af0 2023-10-16T20:08:02.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.231+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8e98014930 con 0x7f8ea0155af0 2023-10-16T20:08:02.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.231+0000 7f8e967fc700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8e8406af00 0x7f8e8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.231+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8e98089e20 con 0x7f8ea0155af0 2023-10-16T20:08:02.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.231+0000 7f8ea5e22700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8e8406af00 0x7f8e8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.232+0000 7f8ea5e22700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8e8406af00 0x7f8e8406d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00b930 tx=0x7f8e9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:02.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.236+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e98054e00 con 0x7f8ea0155af0 2023-10-16T20:08:02.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.501+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f8ea00b32c0 con 0x7f8ea0155af0 2023-10-16T20:08:02.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.503+0000 7f8e967fc700 1 -- 172.21.15.152:0/1437690767 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 195+0+152 (secure 0 0 0) 0x7f8e98058420 con 0x7f8ea0155af0 2023-10-16T20:08:02.506 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2023-10-16T20:08:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNly1l2A6OKBAA5O34FFHdeoZfbqU4ugN4Rw== 2023-10-16T20:08:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: caps mds = "allow" 2023-10-16T20:08:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: caps mon = "allow r" 2023-10-16T20:08:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-16T20:08:02.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8e8406af00 msgr2=0x7f8e8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8e8406af00 0x7f8e8406d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00b930 tx=0x7f8e9c008040 comp rx=0 tx=0).stop 2023-10-16T20:08:02.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 msgr2=0x7f8ea00b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 0x7f8ea00b1cd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8e98007e70 tx=0x7f8e9800e3c0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 shutdown_connections 2023-10-16T20:08:02.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8e8406af00 0x7f8e8406d3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ea0155af0 0x7f8ea00b1cd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ea00b2d00 0x7f8ea00b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 --2- 172.21.15.152:0/1437690767 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8ea00cbd00 0x7f8ea00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 >> 172.21.15.152:0/1437690767 conn(0x7f8ea00cdd00 msgr2=0x7f8ea015f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:02.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 shutdown_connections 2023-10-16T20:08:02.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.506+0000 7f8ea8086700 1 -- 172.21.15.152:0/1437690767 wait complete. 2023-10-16T20:08:02.511 INFO:teuthology.orchestra.run.smithi152.stderr:updated caps for client.0 2023-10-16T20:08:02.521 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:08:02.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.640+0000 7f217f864700 1 Processor -- start 2023-10-16T20:08:02.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.640+0000 7f217f864700 1 -- start start 2023-10-16T20:08:02.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217f864700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f21780b3410 0x7f21780cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217f864700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780cb8d0 0x7f21780b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217f864700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2178070d70 con 0x7f2178152470 2023-10-16T20:08:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217f864700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2178071200 con 0x7f21780b3410 2023-10-16T20:08:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217f864700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780cbd80 con 0x7f21780cb8d0 2023-10-16T20:08:02.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217cdff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f21780b3410 0x7f21780cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217d600700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f2178152470 0x7f21780b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:56384/0 (socket says 172.21.15.152:56384) 2023-10-16T20:08:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217d600700 1 -- 172.21.15.152:0/2693336633 learned_addr learned my addr 172.21.15.152:0/2693336633 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.641+0000 7f217de01700 1 --2- 172.21.15.152:0/2693336633 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780cb8d0 0x7f21780b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f217de01700 1 -- 172.21.15.152:0/2693336633 >> v2:172.21.15.163:3300/0 conn(0x7f21780b3410 msgr2=0x7f21780cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:02.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f217de01700 1 --2- 172.21.15.152:0/2693336633 >> v2:172.21.15.163:3300/0 conn(0x7f21780b3410 0x7f21780cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f217de01700 1 -- 172.21.15.152:0/2693336633 >> v1:172.21.15.163:6789/0 conn(0x7f2178152470 legacy=0x7f21780b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f216ffff700 1 -- 172.21.15.152:0/2693336633 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792785044 0 0) 0x7f2178070d70 con 0x7f2178152470 2023-10-16T20:08:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f217de01700 1 -- 172.21.15.152:0/2693336633 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178070440 con 0x7f21780cb8d0 2023-10-16T20:08:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f217cdff700 1 --2- 172.21.15.152:0/2693336633 >> v2:172.21.15.163:3300/0 conn(0x7f21780b3410 0x7f21780cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T20:08:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f217de01700 1 --2- 172.21.15.152:0/2693336633 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780cb8d0 0x7f21780b60f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2170009d90 tx=0x7f217000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e7c269a37b8caf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:02.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f216ffff700 1 -- 172.21.15.152:0/2693336633 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000e070 con 0x7f21780cb8d0 2023-10-16T20:08:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f216ffff700 1 -- 172.21.15.152:0/2693336633 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000bb20 con 0x7f21780cb8d0 2023-10-16T20:08:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.642+0000 7f216ffff700 1 -- 172.21.15.152:0/2693336633 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170012430 con 0x7f21780cb8d0 2023-10-16T20:08:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 -- 172.21.15.152:0/2693336633 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780cb8d0 msgr2=0x7f21780b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 --2- 172.21.15.152:0/2693336633 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780cb8d0 0x7f21780b60f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2170009d90 tx=0x7f217000b330 comp rx=0 tx=0).stop 2023-10-16T20:08:02.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 -- 172.21.15.152:0/2693336633 shutdown_connections 2023-10-16T20:08:02.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 --2- 172.21.15.152:0/2693336633 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780cb8d0 0x7f21780b60f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 --2- 172.21.15.152:0/2693336633 >> v2:172.21.15.163:3300/0 conn(0x7f21780b3410 0x7f21780cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 -- 172.21.15.152:0/2693336633 >> 172.21.15.152:0/2693336633 conn(0x7f21780cdd00 msgr2=0x7f21780ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:02.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 -- 172.21.15.152:0/2693336633 shutdown_connections 2023-10-16T20:08:02.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.643+0000 7f217f864700 1 -- 172.21.15.152:0/2693336633 wait complete. 2023-10-16T20:08:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.644+0000 7f217f864700 1 Processor -- start 2023-10-16T20:08:02.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.644+0000 7f217f864700 1 -- start start 2023-10-16T20:08:02.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780b3410 0x7f21780afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21780cb8d0 0x7f21780c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 0x7f217806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178158c00 con 0x7f2178152470 2023-10-16T20:08:02.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217806c610 con 0x7f21780cb8d0 2023-10-16T20:08:02.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217806ba00 con 0x7f21780b3410 2023-10-16T20:08:02.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 0x7f217806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 0x7f217806caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32784/0 (socket says 172.21.15.152:32784) 2023-10-16T20:08:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 -- 172.21.15.152:0/1721418044 learned_addr learned my addr 172.21.15.152:0/1721418044 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217d600700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780b3410 0x7f21780afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217cdff700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21780cb8d0 0x7f21780c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 -- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780b3410 msgr2=0x7f21780afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780b3410 0x7f21780afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 -- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21780cb8d0 msgr2=0x7f21780c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21780cb8d0 0x7f21780c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 -- 172.21.15.152:0/1721418044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680094a0 con 0x7f2178152470 2023-10-16T20:08:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217d600700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780b3410 0x7f21780afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217de01700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 0x7f217806caa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2178071340 tx=0x7f2170004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170012430 con 0x7f2178152470 2023-10-16T20:08:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2170020070 con 0x7f2178152470 2023-10-16T20:08:02.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2170009a70 con 0x7f2178152470 2023-10-16T20:08:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.645+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170004480 con 0x7f2178152470 2023-10-16T20:08:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.646+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217806bfc0 con 0x7f2178152470 2023-10-16T20:08:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.647+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217806c7c0 con 0x7f2178152470 2023-10-16T20:08:02.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.647+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21700045e0 con 0x7f2178152470 2023-10-16T20:08:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.648+0000 7f216dffb700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f215c06af00 0x7f215c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.648+0000 7f217d600700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f215c06af00 0x7f215c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.648+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2170022070 con 0x7f2178152470 2023-10-16T20:08:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.648+0000 7f217d600700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f215c06af00 0x7f215c06d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2174007fd0 tx=0x7f2174009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:02.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.652+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f217806c7c0 con 0x7f2178152470 2023-10-16T20:08:02.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.887+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21780cd690 con 0x7f2178152470 2023-10-16T20:08:02.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.887+0000 7f216dffb700 1 -- 172.21.15.152:0/1721418044 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f2170056420 con 0x7f2178152470 2023-10-16T20:08:02.890 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:02.890 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2930592275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2930592275},{"type":"v1","addr":"172.21.15.163:6834","nonce":2930592275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/3404226802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":3404226802},{"type":"v1","addr":"172.21.15.163:6835","nonce":3404226802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2105247281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2105247281},{"type":"v1","addr":"172.21.15.152:6835","nonce":2105247281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:07:52.423205+0000","modified":"2023-10-16T20:07:55.444012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6837/829949938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":829949938},{"type":"v1","addr":"172.21.15.152:6837","nonce":829949938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T20:08:02.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f215c06af00 msgr2=0x7f215c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f215c06af00 0x7f215c06d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2174007fd0 tx=0x7f2174009040 comp rx=0 tx=0).stop 2023-10-16T20:08:02.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 msgr2=0x7f217806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:02.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 0x7f217806caa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2178071340 tx=0x7f2170004ad0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 shutdown_connections 2023-10-16T20:08:02.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f215c06af00 0x7f215c06d3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f21780b3410 0x7f21780afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2178152470 0x7f217806caa0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 --2- 172.21.15.152:0/1721418044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21780cb8d0 0x7f21780c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:02.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 >> 172.21.15.152:0/1721418044 conn(0x7f21780cdd00 msgr2=0x7f21780cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:02.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 shutdown_connections 2023-10-16T20:08:02.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:02.890+0000 7f217f864700 1 -- 172.21.15.152:0/1721418044 wait complete. 2023-10-16T20:08:02.895 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 19 2023-10-16T20:08:03.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T20:07:52.423205+0000', 'modified': '2023-10-16T20:07:55.444012+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5310}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5310': {'gid': 5310, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.152:6837/829949938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 829949938}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 829949938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T20:08:03.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T20:08:03.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T20:08:03.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.434+0000 7f184d6b5700 1 Processor -- start 2023-10-16T20:08:03.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.434+0000 7f184d6b5700 1 -- start start 2023-10-16T20:08:03.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.434+0000 7f184d6b5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f184815b600 0x7f1848164860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.434+0000 7f184d6b5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480c9d40 con 0x7f18480b0c30 2023-10-16T20:08:03.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f184d6b5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480cd6d0 con 0x7f18480b1860 2023-10-16T20:08:03.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f184d6b5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18480cd9a0 con 0x7f184815b600 2023-10-16T20:08:03.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1846ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f18480b0c30 0x7f18480b1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41218/0 (socket says 172.21.15.152:41218) 2023-10-16T20:08:03.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1846ffd700 1 -- 172.21.15.152:0/1140227261 learned_addr learned my addr 172.21.15.152:0/1140227261 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436241325 0 0) 0x7f18480c9d40 con 0x7f18480b0c30 2023-10-16T20:08:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18300046c0 con 0x7f18480b0c30 2023-10-16T20:08:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f18477fe700 1 --2- 172.21.15.152:0/1140227261 >> v2:172.21.15.163:3300/0 conn(0x7f184815b600 0x7f1848164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952523943 0 0) 0x7f18300046c0 con 0x7f18480b0c30 2023-10-16T20:08:03.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 >> v2:172.21.15.163:3300/0 conn(0x7f184815b600 msgr2=0x7f1848164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 --2- 172.21.15.152:0/1140227261 >> v2:172.21.15.163:3300/0 conn(0x7f184815b600 0x7f1848164860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 >> v1:172.21.15.163:6789/0 conn(0x7f18480b1860 legacy=0x7f18480ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480cdc80 con 0x7f18480b0c30 2023-10-16T20:08:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f1838001670 con 0x7f18480b0c30 2023-10-16T20:08:03.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 >> v1:172.21.15.152:6789/0 conn(0x7f18480b0c30 legacy=0x7f18480b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1830004b10 0x7f1830004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1830005510 0x7f18300059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18300061e0 0x7f18300035b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480cd9a0 con 0x7f18300061e0 2023-10-16T20:08:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830003c20 con 0x7f1830004b10 2023-10-16T20:08:03.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830003de0 con 0x7f1830005510 2023-10-16T20:08:03.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f18477fe700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18300061e0 0x7f18300035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.435+0000 7f1846ffd700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1830004b10 0x7f1830004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18467fc700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1830005510 0x7f18300059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 -- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1830005510 msgr2=0x7f18300059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1830005510 0x7f18300059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 -- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1830004b10 msgr2=0x7f1830004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1830004b10 0x7f1830004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 -- 172.21.15.152:0/1140227261 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300046c0 con 0x7f18300061e0 2023-10-16T20:08:03.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 -- 172.21.15.152:0/1140227261 reap_dead start 2023-10-16T20:08:03.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f18477fe700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18300061e0 0x7f18300035b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1840009fc0 tx=0x7f1830006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c608b6aa340126c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840003a20 con 0x7f18300061e0 2023-10-16T20:08:03.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000f040 con 0x7f18300061e0 2023-10-16T20:08:03.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f1845ffb700 1 -- 172.21.15.152:0/1140227261 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840003da0 con 0x7f18300061e0 2023-10-16T20:08:03.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f184d6b5700 1 -- 172.21.15.152:0/1140227261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18300061e0 msgr2=0x7f18300035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f184d6b5700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18300061e0 0x7f18300035b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1840009fc0 tx=0x7f1830006990 comp rx=0 tx=0).stop 2023-10-16T20:08:03.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.436+0000 7f184d6b5700 1 -- 172.21.15.152:0/1140227261 shutdown_connections 2023-10-16T20:08:03.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.437+0000 7f184d6b5700 1 --2- 172.21.15.152:0/1140227261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18300061e0 0x7f18300035b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.437+0000 7f184d6b5700 1 -- 172.21.15.152:0/1140227261 >> 172.21.15.152:0/1140227261 conn(0x7f184806c850 msgr2=0x7f184806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.437+0000 7f184d6b5700 1 -- 172.21.15.152:0/1140227261 shutdown_connections 2023-10-16T20:08:03.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.437+0000 7f184d6b5700 1 -- 172.21.15.152:0/1140227261 wait complete. 2023-10-16T20:08:03.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.438+0000 7f184d6b5700 1 Processor -- start 2023-10-16T20:08:03.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.438+0000 7f184d6b5700 1 -- start start 2023-10-16T20:08:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18300061e0 0x7f18480c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 0x7f18481ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18480afaf0 0x7f18481edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c4fd0 con 0x7f18480af670 2023-10-16T20:08:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c5e10 con 0x7f18300061e0 2023-10-16T20:08:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c5200 con 0x7f18480afaf0 2023-10-16T20:08:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 0x7f18481ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 0x7f18481ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32802/0 (socket says 172.21.15.152:32802) 2023-10-16T20:08:03.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 -- 172.21.15.152:0/2459810741 learned_addr learned my addr 172.21.15.152:0/2459810741 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18300061e0 0x7f18480c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18477fe700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18480afaf0 0x7f18481edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 -- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18480afaf0 msgr2=0x7f18481edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18480afaf0 0x7f18481edb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 -- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18300061e0 msgr2=0x7f18480c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18300061e0 0x7f18480c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 -- 172.21.15.152:0/2459810741 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480c54e0 con 0x7f18480af670 2023-10-16T20:08:03.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18300061e0 0x7f18480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:03.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f18467fc700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 0x7f18481ed5e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f183c00f820 tx=0x7f183c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f182f7fe700 1 -- 172.21.15.152:0/2459810741 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0052e0 con 0x7f18480af670 2023-10-16T20:08:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f182f7fe700 1 -- 172.21.15.152:0/2459810741 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c005460 con 0x7f18480af670 2023-10-16T20:08:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18480c57c0 con 0x7f18480af670 2023-10-16T20:08:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f182f7fe700 1 -- 172.21.15.152:0/2459810741 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0038c0 con 0x7f18480af670 2023-10-16T20:08:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.439+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481ee060 con 0x7f18480af670 2023-10-16T20:08:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.441+0000 7f182f7fe700 1 -- 172.21.15.152:0/2459810741 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f183c003a20 con 0x7f18480af670 2023-10-16T20:08:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.441+0000 7f182f7fe700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f183406af00 0x7f183406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.441+0000 7f182f7fe700 1 -- 172.21.15.152:0/2459810741 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f183c0895e0 con 0x7f18480af670 2023-10-16T20:08:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.441+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f183406af00 0x7f183406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.442+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f183406af00 0x7f183406d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1838000c00 tx=0x7f1838009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.443+0000 7f185989fb80 1 Processor -- start 2023-10-16T20:08:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.443+0000 7f185989fb80 1 -- start start 2023-10-16T20:08:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f185989fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f185989fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed59443c20 con 0x55ed594f6f30 2023-10-16T20:08:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed59428c10 con 0x55ed594cfb40 2023-10-16T20:08:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed59426530 con 0x55ed594caf00 2023-10-16T20:08:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32808/0 (socket says 172.21.15.152:32808) 2023-10-16T20:08:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 -- 172.21.15.152:0/2405295246 learned_addr learned my addr 172.21.15.152:0/2405295246 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18477fe700 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 -- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 msgr2=0x55ed594f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 -- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 msgr2=0x55ed594cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18467fc700 1 -- 172.21.15.152:0/2405295246 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed593df3a0 con 0x55ed594f6f30 2023-10-16T20:08:03.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.444+0000 7f18477fe700 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:03.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f18467fc700 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cf280 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f183c05ff20 tx=0x7f183c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cb16c1f95da856 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f182cff9700 1 -- 172.21.15.152:0/2405295246 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c06f070 con 0x55ed594f6f30 2023-10-16T20:08:03.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f182cff9700 1 -- 172.21.15.152:0/2405295246 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0581b0 con 0x55ed594f6f30 2023-10-16T20:08:03.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f182cff9700 1 -- 172.21.15.152:0/2405295246 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c06bea0 con 0x55ed594f6f30 2023-10-16T20:08:03.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 -- 172.21.15.152:0/2405295246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 msgr2=0x55ed594cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cf280 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f183c05ff20 tx=0x7f183c01d000 comp rx=0 tx=0).stop 2023-10-16T20:08:03.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 -- 172.21.15.152:0/2405295246 shutdown_connections 2023-10-16T20:08:03.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 --2- 172.21.15.152:0/2405295246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cf280 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.445+0000 7f185989fb80 1 -- 172.21.15.152:0/2405295246 >> 172.21.15.152:0/2405295246 conn(0x55ed593fcd80 msgr2=0x55ed59517ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.446+0000 7f185989fb80 1 -- 172.21.15.152:0/2405295246 shutdown_connections 2023-10-16T20:08:03.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.446+0000 7f185989fb80 1 -- 172.21.15.152:0/2405295246 wait complete. 2023-10-16T20:08:03.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.446+0000 7f185989fb80 1 -- start start 2023-10-16T20:08:03.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.446+0000 7f185989fb80 1 Processor -- start 2023-10-16T20:08:03.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed59421e20 con 0x55ed594f6f30 2023-10-16T20:08:03.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed593be6c0 con 0x55ed594cfb40 2023-10-16T20:08:03.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed593be360 con 0x55ed594caf00 2023-10-16T20:08:03.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f185989fb80 10 client.0 _ll_register_callbacks cb 0x55ed5921b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T20:08:03.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32818/0 (socket says 172.21.15.152:32818) 2023-10-16T20:08:03.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 -- 172.21.15.152:0/2278900504 learned_addr learned my addr 172.21.15.152:0/2278900504 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18467fc700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 -- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 msgr2=0x55ed594f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 -- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 msgr2=0x55ed594ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 -- 172.21.15.152:0/2278900504 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481ee060 con 0x55ed594f6f30 2023-10-16T20:08:03.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f18477fe700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cd510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f184806b6c0 tx=0x7f1840004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26750934018aefc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.447+0000 7f1825ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T20:08:03.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1825ffb700 1 -- 172.21.15.152:0/2278900504 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000ec40 con 0x55ed594f6f30 2023-10-16T20:08:03.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1825ffb700 1 -- 172.21.15.152:0/2278900504 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f184000eda0 con 0x55ed594f6f30 2023-10-16T20:08:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed594c25b0 con 0x55ed594f6f30 2023-10-16T20:08:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1825ffb700 1 -- 172.21.15.152:0/2278900504 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1840004040 con 0x55ed594f6f30 2023-10-16T20:08:03.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 10 client.5502 fetch_fsmap learned FSMap version 19 2023-10-16T20:08:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55ed5924cd90 con 0x55ed594f6f30 2023-10-16T20:08:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1825ffb700 1 -- 172.21.15.152:0/2278900504 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed594c25b0 con 0x55ed594f6f30 2023-10-16T20:08:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1825ffb700 1 -- 172.21.15.152:0/2278900504 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 19) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f18400041a0 con 0x55ed594f6f30 2023-10-16T20:08:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 10 client.5502 fetch_fsmap finished waiting for FSMap version 19 2023-10-16T20:08:03.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 10 client.5502 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T20:08:03.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 20 client.5502 populate_metadata read hostname 'smithi152' 2023-10-16T20:08:03.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5952c070 0x55ed5952c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 4 client.5502 mds_command: new command op to 5310 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T20:08:03.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 --> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed5941ae00 con 0x55ed5952c070 2023-10-16T20:08:03.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5952c070 0x55ed5952c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1825ffb700 10 client.5502 ms_handle_connect on v2:172.21.15.152:6836/829949938 2023-10-16T20:08:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.448+0000 7f1846ffd700 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5952c070 0x55ed5952c450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97f00b67c1759e6 server_cookie=ec3cd7ef6c19be30 in_seq=0 out_seq=0 2023-10-16T20:08:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f1825ffb700 1 -- 172.21.15.152:0/2278900504 <== mds.0 v2:172.21.15.152:6836/829949938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed5941ae00 con 0x55ed5952c070 2023-10-16T20:08:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f1825ffb700 10 client.5502 handle_command_reply: tid=0 2023-10-16T20:08:03.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 client.5502 shutdown 2023-10-16T20:08:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 msgr2=0x55ed594cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cd510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f184806b6c0 tx=0x7f1840004b40 comp rx=0 tx=0).stop 2023-10-16T20:08:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 shutdown_connections 2023-10-16T20:08:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5952c070 0x55ed5952c450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594cd510 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 --2- 172.21.15.152:0/2278900504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594cfb40 0x55ed594ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f1825ffb700 0 client.5502 ms_handle_reset on v2:172.21.15.152:6836/829949938 2023-10-16T20:08:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 >> 172.21.15.152:0/2278900504 conn(0x55ed593fcd80 msgr2=0x55ed594c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 shutdown_connections 2023-10-16T20:08:03.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 1 -- 172.21.15.152:0/2278900504 wait complete. 2023-10-16T20:08:03.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.449+0000 7f185989fb80 20 client.5502 trim_cache size 0 max 16384 2023-10-16T20:08:03.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.467+0000 7f185989fb80 1 Processor -- start 2023-10-16T20:08:03.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.467+0000 7f185989fb80 1 -- start start 2023-10-16T20:08:03.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594caf00 0x55ed594cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594cfb40 0x55ed594fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f185989fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f185989fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed592a28d0 con 0x55ed594f6f30 2023-10-16T20:08:03.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed594f5270 con 0x55ed594caf00 2023-10-16T20:08:03.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed594fdcb0 con 0x55ed594cfb40 2023-10-16T20:08:03.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594f39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32826/0 (socket says 172.21.15.152:32826) 2023-10-16T20:08:03.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 -- 172.21.15.152:0/614408719 learned_addr learned my addr 172.21.15.152:0/614408719 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f1846ffd700 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594caf00 0x55ed594cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 -- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594cfb40 msgr2=0x55ed594fd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594cfb40 0x55ed594fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 -- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594caf00 msgr2=0x55ed594cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594caf00 0x55ed594cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 -- 172.21.15.152:0/614408719 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed59235c10 con 0x55ed594f6f30 2023-10-16T20:08:03.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f18477fe700 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594f39b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1840009b90 tx=0x7f1840022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f67227bda7e442 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f182d7fa700 1 -- 172.21.15.152:0/614408719 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840004730 con 0x55ed594f6f30 2023-10-16T20:08:03.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f182d7fa700 1 -- 172.21.15.152:0/614408719 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000ec40 con 0x55ed594f6f30 2023-10-16T20:08:03.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.468+0000 7f182d7fa700 1 -- 172.21.15.152:0/614408719 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000ee10 con 0x55ed594f6f30 2023-10-16T20:08:03.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 -- 172.21.15.152:0/614408719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 msgr2=0x55ed594f39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594f39b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1840009b90 tx=0x7f1840022000 comp rx=0 tx=0).stop 2023-10-16T20:08:03.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 -- 172.21.15.152:0/614408719 shutdown_connections 2023-10-16T20:08:03.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594f6f30 0x55ed594f39b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594caf00 0x55ed594cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 --2- 172.21.15.152:0/614408719 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594cfb40 0x55ed594fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 -- 172.21.15.152:0/614408719 >> 172.21.15.152:0/614408719 conn(0x55ed593fcd80 msgr2=0x55ed594ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 -- 172.21.15.152:0/614408719 shutdown_connections 2023-10-16T20:08:03.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 -- 172.21.15.152:0/614408719 wait complete. 2023-10-16T20:08:03.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.469+0000 7f185989fb80 1 -- start start 2023-10-16T20:08:03.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 Processor -- start 2023-10-16T20:08:03.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 0x55ed5957f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594f6f30 0x55ed5952af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed594fdee0 con 0x55ed594cfb40 2023-10-16T20:08:03.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed595285b0 con 0x55ed594f6f30 2023-10-16T20:08:03.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed59520160 con 0x55ed594caf00 2023-10-16T20:08:03.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f185989fb80 10 client.0 _ll_register_callbacks cb 0x7f18300060c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T20:08:03.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f18467fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 0x55ed5957f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f18467fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 0x55ed5957f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32830/0 (socket says 172.21.15.152:32830) 2023-10-16T20:08:03.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.470+0000 7f18467fc700 1 -- 172.21.15.152:0/3319581733 learned_addr learned my addr 172.21.15.152:0/3319581733 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18467fc700 1 -- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 msgr2=0x55ed594ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18467fc700 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18477fe700 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594f6f30 0x55ed5952af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18467fc700 1 -- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594f6f30 msgr2=0x55ed5952af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18467fc700 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594f6f30 0x55ed5952af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18467fc700 1 -- 172.21.15.152:0/3319581733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed5924cd90 con 0x55ed594cfb40 2023-10-16T20:08:03.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f18467fc700 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 0x55ed5957f610 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f183c05c210 tx=0x7f183c0877e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ab8451064b6606 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1825ffb700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-10-16T20:08:03.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1825ffb700 1 -- 172.21.15.152:0/3319581733 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c06f040 con 0x55ed594cfb40 2023-10-16T20:08:03.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1825ffb700 1 -- 172.21.15.152:0/3319581733 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f183c060450 con 0x55ed594cfb40 2023-10-16T20:08:03.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f183c0581b0 con 0x55ed594cfb40 2023-10-16T20:08:03.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1825ffb700 1 -- 172.21.15.152:0/3319581733 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f183c06bea0 con 0x55ed594cfb40 2023-10-16T20:08:03.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 10 client.5508 fetch_fsmap learned FSMap version 19 2023-10-16T20:08:03.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55ed59273200 con 0x55ed594cfb40 2023-10-16T20:08:03.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1825ffb700 1 -- 172.21.15.152:0/3319581733 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0581b0 con 0x55ed594cfb40 2023-10-16T20:08:03.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1825ffb700 1 -- 172.21.15.152:0/3319581733 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 19) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f183c057640 con 0x55ed594cfb40 2023-10-16T20:08:03.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 10 client.5508 fetch_fsmap finished waiting for FSMap version 19 2023-10-16T20:08:03.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 10 client.5508 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T20:08:03.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 20 client.5508 populate_metadata read hostname 'smithi152' 2023-10-16T20:08:03.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5953b460 0x55ed594f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 4 client.5508 mds_command: new command op to 5310 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T20:08:03.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 --> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ed5941ab20 con 0x55ed5953b460 2023-10-16T20:08:03.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.471+0000 7f1846ffd700 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5953b460 0x55ed594f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f1825ffb700 10 client.5508 ms_handle_connect on v2:172.21.15.152:6836/829949938 2023-10-16T20:08:03.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f1846ffd700 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5953b460 0x55ed594f39b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f83ec835e482c3 server_cookie=934f4aa0a81e168a in_seq=0 out_seq=0 2023-10-16T20:08:03.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f1825ffb700 1 -- 172.21.15.152:0/3319581733 <== mds.0 v2:172.21.15.152:6836/829949938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55ed5941ab20 con 0x55ed5953b460 2023-10-16T20:08:03.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f1825ffb700 10 client.5508 handle_command_reply: tid=0 2023-10-16T20:08:03.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 client.5508 shutdown 2023-10-16T20:08:03.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 msgr2=0x55ed5957f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 0x55ed5957f610 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f183c05c210 tx=0x7f183c0877e0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 shutdown_connections 2023-10-16T20:08:03.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x55ed594caf00 0x55ed594ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:6836/829949938,v1:172.21.15.152:6837/829949938] conn(0x55ed5953b460 0x55ed594f39b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ed594f6f30 0x55ed5952af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f1825ffb700 0 client.5508 ms_handle_reset on v2:172.21.15.152:6836/829949938 2023-10-16T20:08:03.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 --2- 172.21.15.152:0/3319581733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ed594cfb40 0x55ed5957f610 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 >> 172.21.15.152:0/3319581733 conn(0x55ed593fcd80 msgr2=0x55ed594ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 shutdown_connections 2023-10-16T20:08:03.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 1 -- 172.21.15.152:0/3319581733 wait complete. 2023-10-16T20:08:03.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.472+0000 7f185989fb80 20 client.5508 trim_cache size 0 max 16384 2023-10-16T20:08:03.500 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:03.500 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "e602e5ee-bf17-44e1-9fbf-0f448134fb28", 2023-10-16T20:08:03.500 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2023-10-16T20:08:03.500 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5310, 2023-10-16T20:08:03.501 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2023-10-16T20:08:03.501 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2023-10-16T20:08:03.501 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "testcephfs1", 2023-10-16T20:08:03.501 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 10.437188366999999, 2023-10-16T20:08:03.501 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 19, 2023-10-16T20:08:03.502 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 41, 2023-10-16T20:08:03.502 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 41, 2023-10-16T20:08:03.502 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 19.375833930999999 2023-10-16T20:08:03.502 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:03.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f183406af00 msgr2=0x7f183406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f183406af00 0x7f183406d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1838000c00 tx=0x7f1838009040 comp rx=0 tx=0).stop 2023-10-16T20:08:03.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 msgr2=0x7f18481ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 0x7f18481ed5e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f183c00f820 tx=0x7f183c00fb30 comp rx=0 tx=0).stop 2023-10-16T20:08:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 shutdown_connections 2023-10-16T20:08:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f183406af00 0x7f183406d3c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f18480afaf0 0x7f18481edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18300061e0 0x7f18480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 --2- 172.21.15.152:0/2459810741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18480af670 0x7f18481ed5e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 >> 172.21.15.152:0/2459810741 conn(0x7f184806c850 msgr2=0x7f184815a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 shutdown_connections 2023-10-16T20:08:03.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.473+0000 7f184d6b5700 1 -- 172.21.15.152:0/2459810741 wait complete. 2023-10-16T20:08:03.506 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T20:08:03.628 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.626+0000 7fb790d0c700 1 Processor -- start 2023-10-16T20:08:03.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.626+0000 7fb790d0c700 1 -- start start 2023-10-16T20:08:03.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb790d0c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb78c152470 0x7fb78c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb790d0c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb78c0b3410 0x7fb78c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb790d0c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c070d70 con 0x7fb78c0cb8d0 2023-10-16T20:08:03.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb790d0c700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c071200 con 0x7fb78c152470 2023-10-16T20:08:03.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb790d0c700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c0cbd80 con 0x7fb78c0b3410 2023-10-16T20:08:03.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb78a59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb78c152470 0x7fb78c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb78a59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb78c152470 0x7fb78c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32836/0 (socket says 172.21.15.152:32836) 2023-10-16T20:08:03.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.627+0000 7fb78a59c700 1 -- 172.21.15.152:0/3624932465 learned_addr learned my addr 172.21.15.152:0/3624932465 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78a59c700 1 -- 172.21.15.152:0/3624932465 >> v2:172.21.15.163:3300/0 conn(0x7fb78c0b3410 msgr2=0x7fb78c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78ad9d700 1 --2- 172.21.15.152:0/3624932465 >> v2:172.21.15.163:3300/0 conn(0x7fb78c0b3410 0x7fb78c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78a59c700 1 --2- 172.21.15.152:0/3624932465 >> v2:172.21.15.163:3300/0 conn(0x7fb78c0b3410 0x7fb78c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78a59c700 1 -- 172.21.15.152:0/3624932465 >> v1:172.21.15.163:6789/0 conn(0x7fb78c0cb8d0 legacy=0x7fb78c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:03.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78a59c700 1 -- 172.21.15.152:0/3624932465 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c070440 con 0x7fb78c152470 2023-10-16T20:08:03.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78a59c700 1 --2- 172.21.15.152:0/3624932465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c152470 0x7fb78c0cd570 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0b0730 tx=0x7fb77c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa882540f696486 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78959a700 1 -- 172.21.15.152:0/3624932465 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c004230 con 0x7fb78c152470 2023-10-16T20:08:03.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78959a700 1 -- 172.21.15.152:0/3624932465 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c004390 con 0x7fb78c152470 2023-10-16T20:08:03.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.628+0000 7fb78959a700 1 -- 172.21.15.152:0/3624932465 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0036a0 con 0x7fb78c152470 2023-10-16T20:08:03.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 -- 172.21.15.152:0/3624932465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c152470 msgr2=0x7fb78c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 --2- 172.21.15.152:0/3624932465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c152470 0x7fb78c0cd570 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0b0730 tx=0x7fb77c009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 -- 172.21.15.152:0/3624932465 shutdown_connections 2023-10-16T20:08:03.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 --2- 172.21.15.152:0/3624932465 >> v2:172.21.15.163:3300/0 conn(0x7fb78c0b3410 0x7fb78c0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 --2- 172.21.15.152:0/3624932465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c152470 0x7fb78c0cd570 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 -- 172.21.15.152:0/3624932465 >> 172.21.15.152:0/3624932465 conn(0x7fb78c0cdd00 msgr2=0x7fb78c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 -- 172.21.15.152:0/3624932465 shutdown_connections 2023-10-16T20:08:03.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.629+0000 7fb790d0c700 1 -- 172.21.15.152:0/3624932465 wait complete. 2023-10-16T20:08:03.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.630+0000 7fb790d0c700 1 Processor -- start 2023-10-16T20:08:03.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.630+0000 7fb790d0c700 1 -- start start 2023-10-16T20:08:03.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 0x7fb78c1483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb78c0cb8d0 0x7fb78c14efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb78c152470 0x7fb78c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c1f4630 con 0x7fb78c0b3410 2023-10-16T20:08:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c1f1970 con 0x7fb78c0cb8d0 2023-10-16T20:08:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c1f1c50 con 0x7fb78c152470 2023-10-16T20:08:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 0x7fb78c1483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 0x7fb78c1483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32840/0 (socket says 172.21.15.152:32840) 2023-10-16T20:08:03.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 -- 172.21.15.152:0/4047459168 learned_addr learned my addr 172.21.15.152:0/4047459168 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:03.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb789d9b700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb78c0cb8d0 0x7fb78c14efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78ad9d700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb78c152470 0x7fb78c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 -- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb78c152470 msgr2=0x7fb78c0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb78c152470 0x7fb78c0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 -- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb78c0cb8d0 msgr2=0x7fb78c14efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb78c0cb8d0 0x7fb78c14efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 -- 172.21.15.152:0/4047459168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c009550 con 0x7fb78c0b3410 2023-10-16T20:08:03.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb78a59c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 0x7fb78c1483a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009130 tx=0x7fb77c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c003dc0 con 0x7fb78c0b3410 2023-10-16T20:08:03.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c01f070 con 0x7fb78c0b3410 2023-10-16T20:08:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c011870 con 0x7fb78c0b3410 2023-10-16T20:08:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.631+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c1478e0 con 0x7fb78c0b3410 2023-10-16T20:08:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.632+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c147ea0 con 0x7fb78c0b3410 2023-10-16T20:08:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.632+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c148210 con 0x7fb78c0b3410 2023-10-16T20:08:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.633+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb77c021030 con 0x7fb78c0b3410 2023-10-16T20:08:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.634+0000 7fb77affd700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb76c06af00 0x7fb76c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.634+0000 7fb789d9b700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb76c06af00 0x7fb76c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.634+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb77c08ae10 con 0x7fb78c0b3410 2023-10-16T20:08:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.634+0000 7fb789d9b700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb76c06af00 0x7fb76c06d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb78c14a1e0 tx=0x7fb780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:03.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.638+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb77c055f10 con 0x7fb78c0b3410 2023-10-16T20:08:03.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.873+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb78c04ebb0 con 0x7fb78c0b3410 2023-10-16T20:08:03.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.873+0000 7fb77affd700 1 -- 172.21.15.152:0/4047459168 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb77c029070 con 0x7fb78c0b3410 2023-10-16T20:08:03.876 INFO:teuthology.orchestra.run.smithi152.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-16T20:08:03.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb76c06af00 msgr2=0x7fb76c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb76c06af00 0x7fb76c06d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb78c14a1e0 tx=0x7fb780009040 comp rx=0 tx=0).stop 2023-10-16T20:08:03.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 msgr2=0x7fb78c1483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:03.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 0x7fb78c1483a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009130 tx=0x7fb77c004750 comp rx=0 tx=0).stop 2023-10-16T20:08:03.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 shutdown_connections 2023-10-16T20:08:03.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb76c06af00 0x7fb76c06d3c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb78c152470 0x7fb78c0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb78c0b3410 0x7fb78c1483a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 --2- 172.21.15.152:0/4047459168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb78c0cb8d0 0x7fb78c14efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 >> 172.21.15.152:0/4047459168 conn(0x7fb78c0cdd00 msgr2=0x7fb78c0cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 shutdown_connections 2023-10-16T20:08:03.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:03.876+0000 7fb790d0c700 1 -- 172.21.15.152:0/4047459168 wait complete. 2023-10-16T20:08:03.890 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T20:08:03.891 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T20:08:03.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-10-16T20:08:03.892 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T20:08:03.893 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T20:08:03.893 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T20:08:03.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-16T20:08:03.894 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T20:08:03.895 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T20:08:03.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:03.895 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-10-16T20:08:03.913 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T20:08:03.913 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T20:08:03.913 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T20:08:03.913 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.914 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-10-16T20:08:03.914 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.914 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:08:03.914 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:08:03.914 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:08:03.915 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:08:03.915 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T20:08:03.915 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:08:03.915 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T20:08:03.915 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-10-16T20:08:03.916 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T20:08:03.916 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42292sec preferred_lft 42292sec 2023-10-16T20:08:03.916 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d48f:a759:35f6:99dd/64 scope link noprefixroute 2023-10-16T20:08:03.916 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.916 INFO:teuthology.orchestra.run.smithi152.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T20:08:03.917 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0e:34:21:58:f2:2b brd ff:ff:ff:ff:ff:ff 2023-10-16T20:08:03.917 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T20:08:03.917 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.917 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::54a3:24ff:fe6e:d2b0/64 scope link 2023-10-16T20:08:03.917 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.918 INFO:teuthology.orchestra.run.smithi152.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T20:08:03.918 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0e:34:21:58:f2:2b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T20:08:03.918 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::c34:21ff:fe58:f22b/64 scope link 2023-10-16T20:08:03.918 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.918 INFO:teuthology.orchestra.run.smithi152.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T20:08:03.919 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 62:78:d4:2a:f1:2b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T20:08:03.919 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::6078:d4ff:fe2a:f12b/64 scope link 2023-10-16T20:08:03.919 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-10-16T20:08:03.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:03.920 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T20:08:03.978 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-10-16T20:08:03.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:03.979 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-10-16T20:08:04.037 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-10-16T20:08:04.038 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T20:08:04.038 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T20:08:04.038 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T20:08:04.039 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T20:08:04.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.040 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-10-16T20:08:04.040 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-10-16T20:08:04.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T20:08:04.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T20:08:04.042 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T20:08:04.042 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-10-16T20:08:04.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.144 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:08:04.161 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T20:08:04.161 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T20:08:04.162 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T20:08:04.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2023-10-16T20:08:04.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:08:04.228 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T20:08:04.285 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T20:08:04.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T20:08:04.287 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T20:08:04.342 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-16T20:08:04.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:08:04.428 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:08:04.429 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-16T20:08:04.429 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:08:04.437 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:08:04.437 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-16T20:08:04.437 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:08:04.438 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:08:04.438 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:08:04.463 INFO:teuthology.orchestra.run.smithi152.stderr:mount error 2 = No such file or directory 2023-10-16T20:08:04.463 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-16T20:08:04.464 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-16T20:08:04.464 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-10-16T20:08:04.464 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.163:3300,172.21.15.163:3301" 2023-10-16T20:08:04.464 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-16T20:08:04.464 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790" 2023-10-16T20:08:04.465 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.163:6789,172.21.15.163:6790:/ 2023-10-16T20:08:04.465 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e602e5ee-bf17-44e1-9fbf-0f448134fb28" will pass to kernel 2023-10-16T20:08:04.466 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T20:08:04.467 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-16T20:08:04.467 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back ... ERROR 2023-10-16T20:08:04.468 INFO:tasks.cephfs_test_runner: 2023-10-16T20:08:04.468 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T20:08:04.468 INFO:tasks.cephfs_test_runner:ERROR: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-16T20:08:04.469 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back 2023-10-16T20:08:04.469 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T20:08:04.469 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T20:08:04.469 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-16T20:08:04.470 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-16T20:08:04.470 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-16T20:08:04.470 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-16T20:08:04.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-16T20:08:04.471 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-16T20:08:04.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-16T20:08:04.471 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-16T20:08:04.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T20:08:04.472 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T20:08:04.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T20:08:04.472 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T20:08:04.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T20:08:04.473 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T20:08:04.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T20:08:04.473 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T20:08:04.474 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs' 2023-10-16T20:08:04.474 INFO:tasks.cephfs_test_runner: 2023-10-16T20:08:04.474 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T20:08:04.475 INFO:tasks.cephfs_test_runner:Ran 1 test in 46.785s 2023-10-16T20:08:04.475 INFO:tasks.cephfs_test_runner: 2023-10-16T20:08:04.475 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-16T20:08:04.475 INFO:tasks.cephfs_test_runner: 2023-10-16T20:08:04.476 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T20:08:04.476 INFO:tasks.cephfs_test_runner:ERROR: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-16T20:08:04.476 INFO:tasks.cephfs_test_runner:That when a client unmounts, the thread count on the MDS goes back 2023-10-16T20:08:04.477 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T20:08:04.477 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T20:08:04.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-16T20:08:04.477 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-16T20:08:04.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-16T20:08:04.478 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-16T20:08:04.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-16T20:08:04.479 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-16T20:08:04.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-16T20:08:04.479 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-16T20:08:04.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T20:08:04.479 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T20:08:04.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-16T20:08:04.480 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-16T20:08:04.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-16T20:08:04.480 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-16T20:08:04.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-16T20:08:04.481 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-16T20:08:04.481 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs' 2023-10-16T20:08:04.481 INFO:tasks.cephfs_test_runner: 2023-10-16T20:08:04.482 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-16T20:08:04.542 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fb160f1212ed4789b41ae9f8f7a91b8e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_19fd96fe3581520b6d9f50ffdabf29051aee5d4d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap) 2023-10-16T20:08:04.545 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T20:08:04.555 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-16T20:08:04.589 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-16T20:08:04.590 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:08:04.590 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:08:04.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3629 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T20:08:04.612 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-10-16T20:08:04.612 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:08:04.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3629 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-16T20:08:04.669 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:08:04.669 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:08:04.691 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284252k,nr_inodes=4071063,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18714 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260548k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T20:08:04.692 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-10-16T20:08:04.692 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T20:08:04.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284252k,nr_inodes=4071063,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18714 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260548k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-16T20:08:04.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.751 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:08:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T20:08:04.768 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T20:08:04.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T20:08:04.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T20:08:04.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:04.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-10-16T20:08:05.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.019 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-10-16T20:08:05.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.037 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-10-16T20:08:05.106 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-10-16T20:08:05.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:08:05.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.109 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-10-16T20:08:05.131 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-16T20:08:05.132 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T20:08:05.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T20:08:05.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T20:08:05.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-10-16T20:08:05.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.401 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-10-16T20:08:05.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T20:08:05.419 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-10-16T20:08:05.489 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2023-10-16T20:08:05.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:08:05.491 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T20:08:05.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T20:08:05.501 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:05.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.624+0000 7fdafe8e5700 1 Processor -- start 2023-10-16T20:08:05.627 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.624+0000 7fdafe8e5700 1 -- start start 2023-10-16T20:08:05.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdafe8e5700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdaf80b0c30 0x7fdaf80b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:05.629 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdafe8e5700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80c9d40 con 0x7fdaf80b1860 2023-10-16T20:08:05.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdafe8e5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80b1550 con 0x7fdaf815b600 2023-10-16T20:08:05.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdafe8e5700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf80cd6d0 con 0x7fdaf80b0c30 2023-10-16T20:08:05.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdaf7fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdaf80b0c30 0x7fdaf80b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdaf77fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdaf80b1860 0x7fdaf80ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41280/0 (socket says 172.21.15.152:41280) 2023-10-16T20:08:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.625+0000 7fdaf77fe700 1 -- 172.21.15.152:0/1521362604 learned_addr learned my addr 172.21.15.152:0/1521362604 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf7fff700 1 -- 172.21.15.152:0/1521362604 >> v1:172.21.15.163:6789/0 conn(0x7fdaf815b600 legacy=0x7fdaf80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf7fff700 1 -- 172.21.15.152:0/1521362604 >> v1:172.21.15.152:6789/0 conn(0x7fdaf80b1860 legacy=0x7fdaf80ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf7fff700 1 -- 172.21.15.152:0/1521362604 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80cd9a0 con 0x7fdaf80b0c30 2023-10-16T20:08:05.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf7fff700 1 --2- 172.21.15.152:0/1521362604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf80b1010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009840 tx=0x7fdaec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808fc8873d2f5b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:05.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf6ffd700 1 -- 172.21.15.152:0/1521362604 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011830 con 0x7fdaf80b0c30 2023-10-16T20:08:05.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf6ffd700 1 -- 172.21.15.152:0/1521362604 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec011990 con 0x7fdaf80b0c30 2023-10-16T20:08:05.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdaf6ffd700 1 -- 172.21.15.152:0/1521362604 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec011d20 con 0x7fdaf80b0c30 2023-10-16T20:08:05.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdafe8e5700 1 -- 172.21.15.152:0/1521362604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 msgr2=0x7fdaf80b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.626+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/1521362604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf80b1010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009840 tx=0x7fdaec009b50 comp rx=0 tx=0).stop 2023-10-16T20:08:05.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.627+0000 7fdafe8e5700 1 -- 172.21.15.152:0/1521362604 shutdown_connections 2023-10-16T20:08:05.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.627+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/1521362604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf80b1010 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.627+0000 7fdafe8e5700 1 -- 172.21.15.152:0/1521362604 >> 172.21.15.152:0/1521362604 conn(0x7fdaf806c850 msgr2=0x7fdaf806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:05.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.627+0000 7fdafe8e5700 1 -- 172.21.15.152:0/1521362604 shutdown_connections 2023-10-16T20:08:05.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.627+0000 7fdafe8e5700 1 -- 172.21.15.152:0/1521362604 wait complete. 2023-10-16T20:08:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.628+0000 7fdafe8e5700 1 Processor -- start 2023-10-16T20:08:05.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.628+0000 7fdafe8e5700 1 -- start start 2023-10-16T20:08:05.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdafe8e5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:05.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdafe8e5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaf80b1860 0x7fdaf81f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:05.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdafe8e5700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdaf815b600 0x7fdaf8167890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:05.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdafe8e5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf815c910 con 0x7fdaf80b0c30 2023-10-16T20:08:05.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdafe8e5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8159670 con 0x7fdaf80b1860 2023-10-16T20:08:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdafe8e5700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8159360 con 0x7fdaf815b600 2023-10-16T20:08:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdaf7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdaf7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32854/0 (socket says 172.21.15.152:32854) 2023-10-16T20:08:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.629+0000 7fdaf7fff700 1 -- 172.21.15.152:0/2179355593 learned_addr learned my addr 172.21.15.152:0/2179355593 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf7fff700 1 -- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdaf815b600 msgr2=0x7fdaf8167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdafce82700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdaf815b600 0x7fdaf8167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf77fe700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaf80b1860 0x7fdaf81f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:05.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf7fff700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdaf815b600 0x7fdaf8167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf7fff700 1 -- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaf80b1860 msgr2=0x7fdaf81f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf7fff700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaf80b1860 0x7fdaf81f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf7fff700 1 -- 172.21.15.152:0/2179355593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec0094a0 con 0x7fdaf80b0c30 2023-10-16T20:08:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdafce82700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdaf815b600 0x7fdaf8167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf7fff700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf815bfc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdaf806b800 tx=0x7fdaec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0045f0 con 0x7fdaf80b0c30 2023-10-16T20:08:05.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec01f070 con 0x7fdaf80b0c30 2023-10-16T20:08:05.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf815cb60 con 0x7fdaf80b0c30 2023-10-16T20:08:05.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec003b00 con 0x7fdaf80b0c30 2023-10-16T20:08:05.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.630+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf815c500 con 0x7fdaf80b0c30 2023-10-16T20:08:05.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.631+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf804f400 con 0x7fdaf80b0c30 2023-10-16T20:08:05.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.631+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaec003c60 con 0x7fdaf80b0c30 2023-10-16T20:08:05.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.632+0000 7fdaf4ff9700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdae406af00 0x7fdae406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:05.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.632+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdaec021070 con 0x7fdaf80b0c30 2023-10-16T20:08:05.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.632+0000 7fdaf77fe700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdae406af00 0x7fdae406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:05.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.632+0000 7fdaf77fe700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdae406af00 0x7fdae406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdaf81f4bc0 tx=0x7fdae8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:05.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.636+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaec0561b0 con 0x7fdaf80b0c30 2023-10-16T20:08:05.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.823+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdaf80cdf60 con 0x7fdae406af00 2023-10-16T20:08:05.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.831+0000 7fdaf4ff9700 1 -- 172.21.15.152:0/2179355593 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288659 (secure 0 0 0) 0x7fdae80013f0 con 0x7fdae406af00 2023-10-16T20:08:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.834+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdae406af00 msgr2=0x7fdae406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.834+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdae406af00 0x7fdae406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdaf81f4bc0 tx=0x7fdae8009040 comp rx=0 tx=0).stop 2023-10-16T20:08:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.834+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 msgr2=0x7fdaf815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:05.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.834+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf815bfc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdaf806b800 tx=0x7fdaec004750 comp rx=0 tx=0).stop 2023-10-16T20:08:05.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.834+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 shutdown_connections 2023-10-16T20:08:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.834+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fdae406af00 0x7fdae406d3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.835+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fdaf815b600 0x7fdaf8167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.835+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdaf80b0c30 0x7fdaf815bfc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.835+0000 7fdafe8e5700 1 --2- 172.21.15.152:0/2179355593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdaf80b1860 0x7fdaf81f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.835+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 >> 172.21.15.152:0/2179355593 conn(0x7fdaf806c850 msgr2=0x7fdaf80ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.835+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 shutdown_connections 2023-10-16T20:08:05.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:05.835+0000 7fdafe8e5700 1 -- 172.21.15.152:0/2179355593 wait complete. 2023-10-16T20:08:05.845 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:05.851 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-10-16T20:08:04.786734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2795852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.765206"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023225+0000","last_change":"2023-10-16T20:07:53.032076+0000","last_active":"2023-10-16T20:07:54.023225+0000","last_peered":"2023-10-16T20:07:54.023225+0000","last_clean":"2023-10-16T20:07:54.023225+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:07:54.023225+0000","last_undegraded":"2023-10-16T20:07:54.023225+0000","last_fullsized":"2023-10-16T20:07:54.023225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:53.865740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023105+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:07:54.023105+0000","last_peered":"2023-10-16T20:07:54.023105+0000","last_clean":"2023-10-16T20:07:54.023105+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:07:54.023105+0000","last_undegraded":"2023-10-16T20:07:54.023105+0000","last_fullsized":"2023-10-16T20:07:54.023105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:56.088181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269135+0000","last_change":"2023-10-16T20:07:53.041956+0000","last_active":"2023-10-16T20:07:54.269135+0000","last_peered":"2023-10-16T20:07:54.269135+0000","last_clean":"2023-10-16T20:07:54.269135+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:07:54.269135+0000","last_undegraded":"2023-10-16T20:07:54.269135+0000","last_fullsized":"2023-10-16T20:07:54.269135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:09.257087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101183+0000","last_change":"2023-10-16T20:07:53.037791+0000","last_active":"2023-10-16T20:07:54.101183+0000","last_peered":"2023-10-16T20:07:54.101183+0000","last_clean":"2023-10-16T20:07:54.101183+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:07:54.101183+0000","last_undegraded":"2023-10-16T20:07:54.101183+0000","last_fullsized":"2023-10-16T20:07:54.101183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:17.460962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101028+0000","last_change":"2023-10-16T20:07:53.037496+0000","last_active":"2023-10-16T20:07:54.101028+0000","last_peered":"2023-10-16T20:07:54.101028+0000","last_clean":"2023-10-16T20:07:54.101028+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:07:54.101028+0000","last_undegraded":"2023-10-16T20:07:54.101028+0000","last_fullsized":"2023-10-16T20:07:54.101028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:32.843327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269118+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269118+0000","last_peered":"2023-10-16T20:07:54.269118+0000","last_clean":"2023-10-16T20:07:54.269118+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:07:54.269118+0000","last_undegraded":"2023-10-16T20:07:54.269118+0000","last_fullsized":"2023-10-16T20:07:54.269118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103476+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:54.103476+0000","last_peered":"2023-10-16T20:07:54.103476+0000","last_clean":"2023-10-16T20:07:54.103476+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:54.103476+0000","last_undegraded":"2023-10-16T20:07:54.103476+0000","last_fullsized":"2023-10-16T20:07:54.103476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.022889+0000","last_change":"2023-10-16T20:07:53.031550+0000","last_active":"2023-10-16T20:07:54.022889+0000","last_peered":"2023-10-16T20:07:54.022889+0000","last_clean":"2023-10-16T20:07:54.022889+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:07:54.022889+0000","last_undegraded":"2023-10-16T20:07:54.022889+0000","last_fullsized":"2023-10-16T20:07:54.022889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:03:49.996848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269666+0000","last_change":"2023-10-16T20:07:53.053620+0000","last_active":"2023-10-16T20:07:54.269666+0000","last_peered":"2023-10-16T20:07:54.269666+0000","last_clean":"2023-10-16T20:07:54.269666+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:07:54.269666+0000","last_undegraded":"2023-10-16T20:07:54.269666+0000","last_fullsized":"2023-10-16T20:07:54.269666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103613+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:54.103613+0000","last_peered":"2023-10-16T20:07:54.103613+0000","last_clean":"2023-10-16T20:07:54.103613+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:54.103613+0000","last_undegraded":"2023-10-16T20:07:54.103613+0000","last_fullsized":"2023-10-16T20:07:54.103613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:09.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103704+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:54.103704+0000","last_peered":"2023-10-16T20:07:54.103704+0000","last_clean":"2023-10-16T20:07:54.103704+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:54.103704+0000","last_undegraded":"2023-10-16T20:07:54.103704+0000","last_fullsized":"2023-10-16T20:07:54.103704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:33.300151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269358+0000","last_change":"2023-10-16T20:07:53.038955+0000","last_active":"2023-10-16T20:07:54.269358+0000","last_peered":"2023-10-16T20:07:54.269358+0000","last_clean":"2023-10-16T20:07:54.269358+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:07:54.269358+0000","last_undegraded":"2023-10-16T20:07:54.269358+0000","last_fullsized":"2023-10-16T20:07:54.269358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103406+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:54.103406+0000","last_peered":"2023-10-16T20:07:54.103406+0000","last_clean":"2023-10-16T20:07:54.103406+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:54.103406+0000","last_undegraded":"2023-10-16T20:07:54.103406+0000","last_fullsized":"2023-10-16T20:07:54.103406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025328+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:54.025328+0000","last_peered":"2023-10-16T20:07:54.025328+0000","last_clean":"2023-10-16T20:07:54.025328+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:54.025328+0000","last_undegraded":"2023-10-16T20:07:54.025328+0000","last_fullsized":"2023-10-16T20:07:54.025328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103294+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:54.103294+0000","last_peered":"2023-10-16T20:07:54.103294+0000","last_clean":"2023-10-16T20:07:54.103294+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:54.103294+0000","last_undegraded":"2023-10-16T20:07:54.103294+0000","last_fullsized":"2023-10-16T20:07:54.103294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269416+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:54.269416+0000","last_peered":"2023-10-16T20:07:54.269416+0000","last_clean":"2023-10-16T20:07:54.269416+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:54.269416+0000","last_undegraded":"2023-10-16T20:07:54.269416+0000","last_fullsized":"2023-10-16T20:07:54.269416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:27.018295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269948+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:54.269948+0000","last_peered":"2023-10-16T20:07:54.269948+0000","last_clean":"2023-10-16T20:07:54.269948+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:54.269948+0000","last_undegraded":"2023-10-16T20:07:54.269948+0000","last_fullsized":"2023-10-16T20:07:54.269948+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025037+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:54.025037+0000","last_peered":"2023-10-16T20:07:54.025037+0000","last_clean":"2023-10-16T20:07:54.025037+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:54.025037+0000","last_undegraded":"2023-10-16T20:07:54.025037+0000","last_fullsized":"2023-10-16T20:07:54.025037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101108+0000","last_change":"2023-10-16T20:07:53.036516+0000","last_active":"2023-10-16T20:07:54.101108+0000","last_peered":"2023-10-16T20:07:54.101108+0000","last_clean":"2023-10-16T20:07:54.101108+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:07:54.101108+0000","last_undegraded":"2023-10-16T20:07:54.101108+0000","last_fullsized":"2023-10-16T20:07:54.101108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:53.007268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024266+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:54.024266+0000","last_peered":"2023-10-16T20:07:54.024266+0000","last_clean":"2023-10-16T20:07:54.024266+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:54.024266+0000","last_undegraded":"2023-10-16T20:07:54.024266+0000","last_fullsized":"2023-10-16T20:07:54.024266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103499+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:54.103499+0000","last_peered":"2023-10-16T20:07:54.103499+0000","last_clean":"2023-10-16T20:07:54.103499+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:54.103499+0000","last_undegraded":"2023-10-16T20:07:54.103499+0000","last_fullsized":"2023-10-16T20:07:54.103499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:38.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024960+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:54.024960+0000","last_peered":"2023-10-16T20:07:54.024960+0000","last_clean":"2023-10-16T20:07:54.024960+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:54.024960+0000","last_undegraded":"2023-10-16T20:07:54.024960+0000","last_fullsized":"2023-10-16T20:07:54.024960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269612+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:54.269612+0000","last_peered":"2023-10-16T20:07:54.269612+0000","last_clean":"2023-10-16T20:07:54.269612+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:54.269612+0000","last_undegraded":"2023-10-16T20:07:54.269612+0000","last_fullsized":"2023-10-16T20:07:54.269612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:12.377109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101006+0000","last_change":"2023-10-16T20:07:53.049683+0000","last_active":"2023-10-16T20:07:54.101006+0000","last_peered":"2023-10-16T20:07:54.101006+0000","last_clean":"2023-10-16T20:07:54.101006+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:07:54.101006+0000","last_undegraded":"2023-10-16T20:07:54.101006+0000","last_fullsized":"2023-10-16T20:07:54.101006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:06.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024377+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:54.024377+0000","last_peered":"2023-10-16T20:07:54.024377+0000","last_clean":"2023-10-16T20:07:54.024377+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:54.024377+0000","last_undegraded":"2023-10-16T20:07:54.024377+0000","last_fullsized":"2023-10-16T20:07:54.024377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269284+0000","last_change":"2023-10-16T20:07:53.041714+0000","last_active":"2023-10-16T20:07:54.269284+0000","last_peered":"2023-10-16T20:07:54.269284+0000","last_clean":"2023-10-16T20:07:54.269284+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:07:54.269284+0000","last_undegraded":"2023-10-16T20:07:54.269284+0000","last_fullsized":"2023-10-16T20:07:54.269284+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024374+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:54.024374+0000","last_peered":"2023-10-16T20:07:54.024374+0000","last_clean":"2023-10-16T20:07:54.024374+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:54.024374+0000","last_undegraded":"2023-10-16T20:07:54.024374+0000","last_fullsized":"2023-10-16T20:07:54.024374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103586+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:54.103586+0000","last_peered":"2023-10-16T20:07:54.103586+0000","last_clean":"2023-10-16T20:07:54.103586+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:54.103586+0000","last_undegraded":"2023-10-16T20:07:54.103586+0000","last_fullsized":"2023-10-16T20:07:54.103586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:14.506216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024418+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:54.024418+0000","last_peered":"2023-10-16T20:07:54.024418+0000","last_clean":"2023-10-16T20:07:54.024418+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:54.024418+0000","last_undegraded":"2023-10-16T20:07:54.024418+0000","last_fullsized":"2023-10-16T20:07:54.024418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024148+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:54.024148+0000","last_peered":"2023-10-16T20:07:54.024148+0000","last_clean":"2023-10-16T20:07:54.024148+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:54.024148+0000","last_undegraded":"2023-10-16T20:07:54.024148+0000","last_fullsized":"2023-10-16T20:07:54.024148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269484+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:54.269484+0000","last_peered":"2023-10-16T20:07:54.269484+0000","last_clean":"2023-10-16T20:07:54.269484+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:54.269484+0000","last_undegraded":"2023-10-16T20:07:54.269484+0000","last_fullsized":"2023-10-16T20:07:54.269484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268972+0000","last_change":"2023-10-16T20:07:53.033516+0000","last_active":"2023-10-16T20:07:54.268972+0000","last_peered":"2023-10-16T20:07:54.268972+0000","last_clean":"2023-10-16T20:07:54.268972+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:07:54.268972+0000","last_undegraded":"2023-10-16T20:07:54.268972+0000","last_fullsized":"2023-10-16T20:07:54.268972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269908+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:54.269908+0000","last_peered":"2023-10-16T20:07:54.269908+0000","last_clean":"2023-10-16T20:07:54.269908+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:54.269908+0000","last_undegraded":"2023-10-16T20:07:54.269908+0000","last_fullsized":"2023-10-16T20:07:54.269908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963697+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.963697+0000","last_peered":"2023-10-16T20:07:53.963697+0000","last_clean":"2023-10-16T20:07:53.963697+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.963697+0000","last_undegraded":"2023-10-16T20:07:53.963697+0000","last_fullsized":"2023-10-16T20:07:53.963697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269553+0000","last_change":"2023-10-16T20:07:53.041621+0000","last_active":"2023-10-16T20:07:54.269553+0000","last_peered":"2023-10-16T20:07:54.269553+0000","last_clean":"2023-10-16T20:07:54.269553+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:07:54.269553+0000","last_undegraded":"2023-10-16T20:07:54.269553+0000","last_fullsized":"2023-10-16T20:07:54.269553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:22:48.459709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051925+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:53.051925+0000","last_peered":"2023-10-16T20:07:53.051925+0000","last_clean":"2023-10-16T20:07:53.051925+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:53.051925+0000","last_undegraded":"2023-10-16T20:07:53.051925+0000","last_fullsized":"2023-10-16T20:07:53.051925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025298+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:54.025298+0000","last_peered":"2023-10-16T20:07:54.025298+0000","last_clean":"2023-10-16T20:07:54.025298+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:54.025298+0000","last_undegraded":"2023-10-16T20:07:54.025298+0000","last_fullsized":"2023-10-16T20:07:54.025298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056466+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:53.056466+0000","last_peered":"2023-10-16T20:07:53.056466+0000","last_clean":"2023-10-16T20:07:53.056466+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:53.056466+0000","last_undegraded":"2023-10-16T20:07:53.056466+0000","last_fullsized":"2023-10-16T20:07:53.056466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:17.552698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023330+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:07:54.023330+0000","last_peered":"2023-10-16T20:07:54.023330+0000","last_clean":"2023-10-16T20:07:54.023330+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:07:54.023330+0000","last_undegraded":"2023-10-16T20:07:54.023330+0000","last_fullsized":"2023-10-16T20:07:54.023330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:50:53.891138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962423+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.962423+0000","last_peered":"2023-10-16T20:07:53.962423+0000","last_clean":"2023-10-16T20:07:53.962423+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.962423+0000","last_undegraded":"2023-10-16T20:07:53.962423+0000","last_fullsized":"2023-10-16T20:07:53.962423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269292+0000","last_change":"2023-10-16T20:07:53.031450+0000","last_active":"2023-10-16T20:07:54.269292+0000","last_peered":"2023-10-16T20:07:54.269292+0000","last_clean":"2023-10-16T20:07:54.269292+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:07:54.269292+0000","last_undegraded":"2023-10-16T20:07:54.269292+0000","last_fullsized":"2023-10-16T20:07:54.269292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962521+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.962521+0000","last_peered":"2023-10-16T20:07:53.962521+0000","last_clean":"2023-10-16T20:07:53.962521+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.962521+0000","last_undegraded":"2023-10-16T20:07:53.962521+0000","last_fullsized":"2023-10-16T20:07:53.962521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103297+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:54.103297+0000","last_peered":"2023-10-16T20:07:54.103297+0000","last_clean":"2023-10-16T20:07:54.103297+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:54.103297+0000","last_undegraded":"2023-10-16T20:07:54.103297+0000","last_fullsized":"2023-10-16T20:07:54.103297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964077+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.964077+0000","last_peered":"2023-10-16T20:07:53.964077+0000","last_clean":"2023-10-16T20:07:53.964077+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.964077+0000","last_undegraded":"2023-10-16T20:07:53.964077+0000","last_fullsized":"2023-10-16T20:07:53.964077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025136+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:54.025136+0000","last_peered":"2023-10-16T20:07:54.025136+0000","last_clean":"2023-10-16T20:07:54.025136+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:54.025136+0000","last_undegraded":"2023-10-16T20:07:54.025136+0000","last_fullsized":"2023-10-16T20:07:54.025136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026238+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:53.026238+0000","last_peered":"2023-10-16T20:07:53.026238+0000","last_clean":"2023-10-16T20:07:53.026238+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:53.026238+0000","last_undegraded":"2023-10-16T20:07:53.026238+0000","last_fullsized":"2023-10-16T20:07:53.026238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.960835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023237+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:07:54.023237+0000","last_peered":"2023-10-16T20:07:54.023237+0000","last_clean":"2023-10-16T20:07:54.023237+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:07:54.023237+0000","last_undegraded":"2023-10-16T20:07:54.023237+0000","last_fullsized":"2023-10-16T20:07:54.023237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:10.581126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962309+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.962309+0000","last_peered":"2023-10-16T20:07:53.962309+0000","last_clean":"2023-10-16T20:07:53.962309+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.962309+0000","last_undegraded":"2023-10-16T20:07:53.962309+0000","last_fullsized":"2023-10-16T20:07:53.962309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101256+0000","last_change":"2023-10-16T20:07:53.038082+0000","last_active":"2023-10-16T20:07:54.101256+0000","last_peered":"2023-10-16T20:07:54.101256+0000","last_clean":"2023-10-16T20:07:54.101256+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:07:54.101256+0000","last_undegraded":"2023-10-16T20:07:54.101256+0000","last_fullsized":"2023-10-16T20:07:54.101256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:06.955879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022694+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:53.022694+0000","last_peered":"2023-10-16T20:07:53.022694+0000","last_clean":"2023-10-16T20:07:53.022694+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:53.022694+0000","last_undegraded":"2023-10-16T20:07:53.022694+0000","last_fullsized":"2023-10-16T20:07:53.022694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:26.475876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269796+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:54.269796+0000","last_peered":"2023-10-16T20:07:54.269796+0000","last_clean":"2023-10-16T20:07:54.269796+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:54.269796+0000","last_undegraded":"2023-10-16T20:07:54.269796+0000","last_fullsized":"2023-10-16T20:07:54.269796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962629+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.962629+0000","last_peered":"2023-10-16T20:07:53.962629+0000","last_clean":"2023-10-16T20:07:53.962629+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.962629+0000","last_undegraded":"2023-10-16T20:07:53.962629+0000","last_fullsized":"2023-10-16T20:07:53.962629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269544+0000","last_change":"2023-10-16T20:07:53.048262+0000","last_active":"2023-10-16T20:07:54.269544+0000","last_peered":"2023-10-16T20:07:54.269544+0000","last_clean":"2023-10-16T20:07:54.269544+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:07:54.269544+0000","last_undegraded":"2023-10-16T20:07:54.269544+0000","last_fullsized":"2023-10-16T20:07:54.269544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962580+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.962580+0000","last_peered":"2023-10-16T20:07:53.962580+0000","last_clean":"2023-10-16T20:07:53.962580+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.962580+0000","last_undegraded":"2023-10-16T20:07:53.962580+0000","last_fullsized":"2023-10-16T20:07:53.962580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025162+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:54.025162+0000","last_peered":"2023-10-16T20:07:54.025162+0000","last_clean":"2023-10-16T20:07:54.025162+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:54.025162+0000","last_undegraded":"2023-10-16T20:07:54.025162+0000","last_fullsized":"2023-10-16T20:07:54.025162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061493+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:53.061493+0000","last_peered":"2023-10-16T20:07:53.061493+0000","last_clean":"2023-10-16T20:07:53.061493+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:53.061493+0000","last_undegraded":"2023-10-16T20:07:53.061493+0000","last_fullsized":"2023-10-16T20:07:53.061493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:54.643651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269104+0000","last_change":"2023-10-16T20:07:53.048961+0000","last_active":"2023-10-16T20:07:54.269104+0000","last_peered":"2023-10-16T20:07:54.269104+0000","last_clean":"2023-10-16T20:07:54.269104+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:07:54.269104+0000","last_undegraded":"2023-10-16T20:07:54.269104+0000","last_fullsized":"2023-10-16T20:07:54.269104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:58.965748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048654+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:53.048654+0000","last_peered":"2023-10-16T20:07:53.048654+0000","last_clean":"2023-10-16T20:07:53.048654+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:53.048654+0000","last_undegraded":"2023-10-16T20:07:53.048654+0000","last_fullsized":"2023-10-16T20:07:53.048654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:19.484561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023303+0000","last_change":"2023-10-16T20:07:53.031630+0000","last_active":"2023-10-16T20:07:54.023303+0000","last_peered":"2023-10-16T20:07:54.023303+0000","last_clean":"2023-10-16T20:07:54.023303+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:07:54.023303+0000","last_undegraded":"2023-10-16T20:07:54.023303+0000","last_fullsized":"2023-10-16T20:07:54.023303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:19.312981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.025675+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:53.025675+0000","last_peered":"2023-10-16T20:07:53.025675+0000","last_clean":"2023-10-16T20:07:53.025675+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:53.025675+0000","last_undegraded":"2023-10-16T20:07:53.025675+0000","last_fullsized":"2023-10-16T20:07:53.025675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269686+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:54.269686+0000","last_peered":"2023-10-16T20:07:54.269686+0000","last_clean":"2023-10-16T20:07:54.269686+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:54.269686+0000","last_undegraded":"2023-10-16T20:07:54.269686+0000","last_fullsized":"2023-10-16T20:07:54.269686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:07.194764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963564+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.963564+0000","last_peered":"2023-10-16T20:07:53.963564+0000","last_clean":"2023-10-16T20:07:53.963564+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.963564+0000","last_undegraded":"2023-10-16T20:07:53.963564+0000","last_fullsized":"2023-10-16T20:07:53.963564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023252+0000","last_change":"2023-10-16T20:07:53.029968+0000","last_active":"2023-10-16T20:07:54.023252+0000","last_peered":"2023-10-16T20:07:54.023252+0000","last_clean":"2023-10-16T20:07:54.023252+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:07:54.023252+0000","last_undegraded":"2023-10-16T20:07:54.023252+0000","last_fullsized":"2023-10-16T20:07:54.023252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:25.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963991+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.963991+0000","last_peered":"2023-10-16T20:07:53.963991+0000","last_clean":"2023-10-16T20:07:53.963991+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.963991+0000","last_undegraded":"2023-10-16T20:07:53.963991+0000","last_fullsized":"2023-10-16T20:07:53.963991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023028+0000","last_change":"2023-10-16T20:07:53.037655+0000","last_active":"2023-10-16T20:07:54.023028+0000","last_peered":"2023-10-16T20:07:54.023028+0000","last_clean":"2023-10-16T20:07:54.023028+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:07:54.023028+0000","last_undegraded":"2023-10-16T20:07:54.023028+0000","last_fullsized":"2023-10-16T20:07:54.023028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:13.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962674+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.962674+0000","last_peered":"2023-10-16T20:07:53.962674+0000","last_clean":"2023-10-16T20:07:53.962674+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.962674+0000","last_undegraded":"2023-10-16T20:07:53.962674+0000","last_fullsized":"2023-10-16T20:07:53.962674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103796+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:54.103796+0000","last_peered":"2023-10-16T20:07:54.103796+0000","last_clean":"2023-10-16T20:07:54.103796+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:54.103796+0000","last_undegraded":"2023-10-16T20:07:54.103796+0000","last_fullsized":"2023-10-16T20:07:54.103796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:53.656150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962461+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.962461+0000","last_peered":"2023-10-16T20:07:53.962461+0000","last_clean":"2023-10-16T20:07:53.962461+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.962461+0000","last_undegraded":"2023-10-16T20:07:53.962461+0000","last_fullsized":"2023-10-16T20:07:53.962461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025395+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:54.025395+0000","last_peered":"2023-10-16T20:07:54.025395+0000","last_clean":"2023-10-16T20:07:54.025395+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:54.025395+0000","last_undegraded":"2023-10-16T20:07:54.025395+0000","last_fullsized":"2023-10-16T20:07:54.025395+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061109+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:53.061109+0000","last_peered":"2023-10-16T20:07:53.061109+0000","last_clean":"2023-10-16T20:07:53.061109+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:53.061109+0000","last_undegraded":"2023-10-16T20:07:53.061109+0000","last_fullsized":"2023-10-16T20:07:53.061109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101320+0000","last_change":"2023-10-16T20:07:53.039457+0000","last_active":"2023-10-16T20:07:54.101320+0000","last_peered":"2023-10-16T20:07:54.101320+0000","last_clean":"2023-10-16T20:07:54.101320+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:07:54.101320+0000","last_undegraded":"2023-10-16T20:07:54.101320+0000","last_fullsized":"2023-10-16T20:07:54.101320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:35.056763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026529+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:53.026529+0000","last_peered":"2023-10-16T20:07:53.026529+0000","last_clean":"2023-10-16T20:07:53.026529+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:53.026529+0000","last_undegraded":"2023-10-16T20:07:53.026529+0000","last_fullsized":"2023-10-16T20:07:53.026529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:03.961940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269527+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:54.269527+0000","last_peered":"2023-10-16T20:07:54.269527+0000","last_clean":"2023-10-16T20:07:54.269527+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:54.269527+0000","last_undegraded":"2023-10-16T20:07:54.269527+0000","last_fullsized":"2023-10-16T20:07:54.269527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:11.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051159+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:53.051159+0000","last_peered":"2023-10-16T20:07:53.051159+0000","last_clean":"2023-10-16T20:07:53.051159+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:53.051159+0000","last_undegraded":"2023-10-16T20:07:53.051159+0000","last_fullsized":"2023-10-16T20:07:53.051159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:21.527524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269159+0000","last_change":"2023-10-16T20:07:53.048171+0000","last_active":"2023-10-16T20:07:54.269159+0000","last_peered":"2023-10-16T20:07:54.269159+0000","last_clean":"2023-10-16T20:07:54.269159+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:07:54.269159+0000","last_undegraded":"2023-10-16T20:07:54.269159+0000","last_fullsized":"2023-10-16T20:07:54.269159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:04.966853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027784+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:53.027784+0000","last_peered":"2023-10-16T20:07:53.027784+0000","last_clean":"2023-10-16T20:07:53.027784+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:53.027784+0000","last_undegraded":"2023-10-16T20:07:53.027784+0000","last_fullsized":"2023-10-16T20:07:53.027784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:53.685902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103386+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:54.103386+0000","last_peered":"2023-10-16T20:07:54.103386+0000","last_clean":"2023-10-16T20:07:54.103386+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:54.103386+0000","last_undegraded":"2023-10-16T20:07:54.103386+0000","last_fullsized":"2023-10-16T20:07:54.103386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964052+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.964052+0000","last_peered":"2023-10-16T20:07:53.964052+0000","last_clean":"2023-10-16T20:07:53.964052+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.964052+0000","last_undegraded":"2023-10-16T20:07:53.964052+0000","last_fullsized":"2023-10-16T20:07:53.964052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023079+0000","last_change":"2023-10-16T20:07:53.051277+0000","last_active":"2023-10-16T20:07:54.023079+0000","last_peered":"2023-10-16T20:07:54.023079+0000","last_clean":"2023-10-16T20:07:54.023079+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:07:54.023079+0000","last_undegraded":"2023-10-16T20:07:54.023079+0000","last_fullsized":"2023-10-16T20:07:54.023079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:09.587579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.028961+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:53.028961+0000","last_peered":"2023-10-16T20:07:53.028961+0000","last_clean":"2023-10-16T20:07:53.028961+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:53.028961+0000","last_undegraded":"2023-10-16T20:07:53.028961+0000","last_fullsized":"2023-10-16T20:07:53.028961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:42.884671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269491+0000","last_change":"2023-10-16T20:07:53.042042+0000","last_active":"2023-10-16T20:07:54.269491+0000","last_peered":"2023-10-16T20:07:54.269491+0000","last_clean":"2023-10-16T20:07:54.269491+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:07:54.269491+0000","last_undegraded":"2023-10-16T20:07:54.269491+0000","last_fullsized":"2023-10-16T20:07:54.269491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962687+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.962687+0000","last_peered":"2023-10-16T20:07:53.962687+0000","last_clean":"2023-10-16T20:07:53.962687+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.962687+0000","last_undegraded":"2023-10-16T20:07:53.962687+0000","last_fullsized":"2023-10-16T20:07:53.962687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269825+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:54.269825+0000","last_peered":"2023-10-16T20:07:54.269825+0000","last_clean":"2023-10-16T20:07:54.269825+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:54.269825+0000","last_undegraded":"2023-10-16T20:07:54.269825+0000","last_fullsized":"2023-10-16T20:07:54.269825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101285+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:54.101285+0000","last_peered":"2023-10-16T20:07:54.101285+0000","last_clean":"2023-10-16T20:07:54.101285+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:54.101285+0000","last_undegraded":"2023-10-16T20:07:54.101285+0000","last_fullsized":"2023-10-16T20:07:54.101285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:19.786064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023295+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:07:54.023295+0000","last_peered":"2023-10-16T20:07:54.023295+0000","last_clean":"2023-10-16T20:07:54.023295+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:07:54.023295+0000","last_undegraded":"2023-10-16T20:07:54.023295+0000","last_fullsized":"2023-10-16T20:07:54.023295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027338+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:53.027338+0000","last_peered":"2023-10-16T20:07:53.027338+0000","last_clean":"2023-10-16T20:07:53.027338+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:53.027338+0000","last_undegraded":"2023-10-16T20:07:53.027338+0000","last_fullsized":"2023-10-16T20:07:53.027338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269278+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269278+0000","last_peered":"2023-10-16T20:07:54.269278+0000","last_clean":"2023-10-16T20:07:54.269278+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:07:54.269278+0000","last_undegraded":"2023-10-16T20:07:54.269278+0000","last_fullsized":"2023-10-16T20:07:54.269278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027463+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:53.027463+0000","last_peered":"2023-10-16T20:07:53.027463+0000","last_clean":"2023-10-16T20:07:53.027463+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:53.027463+0000","last_undegraded":"2023-10-16T20:07:53.027463+0000","last_fullsized":"2023-10-16T20:07:53.027463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268970+0000","last_change":"2023-10-16T20:07:53.036387+0000","last_active":"2023-10-16T20:07:54.268970+0000","last_peered":"2023-10-16T20:07:54.268970+0000","last_clean":"2023-10-16T20:07:54.268970+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:07:54.268970+0000","last_undegraded":"2023-10-16T20:07:54.268970+0000","last_fullsized":"2023-10-16T20:07:54.268970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963596+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.963596+0000","last_peered":"2023-10-16T20:07:53.963596+0000","last_clean":"2023-10-16T20:07:53.963596+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.963596+0000","last_undegraded":"2023-10-16T20:07:53.963596+0000","last_fullsized":"2023-10-16T20:07:53.963596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025267+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:54.025267+0000","last_peered":"2023-10-16T20:07:54.025267+0000","last_clean":"2023-10-16T20:07:54.025267+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:54.025267+0000","last_undegraded":"2023-10-16T20:07:54.025267+0000","last_fullsized":"2023-10-16T20:07:54.025267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962334+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.962334+0000","last_peered":"2023-10-16T20:07:53.962334+0000","last_clean":"2023-10-16T20:07:53.962334+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.962334+0000","last_undegraded":"2023-10-16T20:07:53.962334+0000","last_fullsized":"2023-10-16T20:07:53.962334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269794+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:54.269794+0000","last_peered":"2023-10-16T20:07:54.269794+0000","last_clean":"2023-10-16T20:07:54.269794+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:54.269794+0000","last_undegraded":"2023-10-16T20:07:54.269794+0000","last_fullsized":"2023-10-16T20:07:54.269794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022176+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:53.022176+0000","last_peered":"2023-10-16T20:07:53.022176+0000","last_clean":"2023-10-16T20:07:53.022176+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:53.022176+0000","last_undegraded":"2023-10-16T20:07:53.022176+0000","last_fullsized":"2023-10-16T20:07:53.022176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103809+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:54.103809+0000","last_peered":"2023-10-16T20:07:54.103809+0000","last_clean":"2023-10-16T20:07:54.103809+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:54.103809+0000","last_undegraded":"2023-10-16T20:07:54.103809+0000","last_fullsized":"2023-10-16T20:07:54.103809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:22.531060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964119+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.964119+0000","last_peered":"2023-10-16T20:07:53.964119+0000","last_clean":"2023-10-16T20:07:53.964119+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.964119+0000","last_undegraded":"2023-10-16T20:07:53.964119+0000","last_fullsized":"2023-10-16T20:07:53.964119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039606+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:53.039606+0000","last_peered":"2023-10-16T20:07:53.039606+0000","last_clean":"2023-10-16T20:07:53.039606+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:53.039606+0000","last_undegraded":"2023-10-16T20:07:53.039606+0000","last_fullsized":"2023-10-16T20:07:53.039606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":793337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.505}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.622}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.69399999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":201869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.40999999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.502}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.317}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.496},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51800000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.505}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.749}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.66900000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.32900000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52400000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.374},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.313},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50600000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57999999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.753}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83699999999999997}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.88500000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.374},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.627}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:05.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:06.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.009+0000 7f677196c700 1 Processor -- start 2023-10-16T20:08:06.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.009+0000 7f677196c700 1 -- start start 2023-10-16T20:08:06.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f677196c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c0712e0 0x7f676c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f677196c700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676c0cd4b0 con 0x7f676c144ea0 2023-10-16T20:08:06.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f677196c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676c15b8f0 con 0x7f676c0cbc10 2023-10-16T20:08:06.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f677196c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0cc0a0 con 0x7f676c0712e0 2023-10-16T20:08:06.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f676a7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f676c144ea0 0x7f676c0716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41292/0 (socket says 172.21.15.152:41292) 2023-10-16T20:08:06.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f676a7fc700 1 -- 172.21.15.152:0/2120721 learned_addr learned my addr 172.21.15.152:0/2120721 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:06.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f676affd700 1 --2- 172.21.15.152:0/2120721 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c0712e0 0x7f676c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.010+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348044303 0 0) 0x7f676c0cd4b0 con 0x7f676c144ea0 2023-10-16T20:08:06.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67540035b0 con 0x7f676c144ea0 2023-10-16T20:08:06.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193003177 0 0) 0x7f676c15b8f0 con 0x7f676c0cbc10 2023-10-16T20:08:06.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f676c0cd4b0 con 0x7f676c0cbc10 2023-10-16T20:08:06.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f676affd700 1 -- 172.21.15.152:0/2120721 >> v1:172.21.15.163:6789/0 conn(0x7f676c0cbc10 legacy=0x7f676c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f676affd700 1 -- 172.21.15.152:0/2120721 >> v1:172.21.15.152:6789/0 conn(0x7f676c144ea0 legacy=0x7f676c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f676affd700 1 -- 172.21.15.152:0/2120721 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c15fdb0 con 0x7f676c0712e0 2023-10-16T20:08:06.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f676affd700 1 --2- 172.21.15.152:0/2120721 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c0712e0 0x7f676c15f790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6760009870 tx=0x7f6760009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ee2c7a559d4f33 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760011830 con 0x7f676c0712e0 2023-10-16T20:08:06.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6760011990 con 0x7f676c0712e0 2023-10-16T20:08:06.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.011+0000 7f6769ffb700 1 -- 172.21.15.152:0/2120721 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760011d20 con 0x7f676c0712e0 2023-10-16T20:08:06.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 -- 172.21.15.152:0/2120721 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c0712e0 msgr2=0x7f676c15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 --2- 172.21.15.152:0/2120721 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c0712e0 0x7f676c15f790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6760009870 tx=0x7f6760009b80 comp rx=0 tx=0).stop 2023-10-16T20:08:06.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 -- 172.21.15.152:0/2120721 shutdown_connections 2023-10-16T20:08:06.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 --2- 172.21.15.152:0/2120721 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c0712e0 0x7f676c15f790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 -- 172.21.15.152:0/2120721 >> 172.21.15.152:0/2120721 conn(0x7f676c0cfcd0 msgr2=0x7f676c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:06.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 -- 172.21.15.152:0/2120721 shutdown_connections 2023-10-16T20:08:06.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.012+0000 7f677196c700 1 -- 172.21.15.152:0/2120721 wait complete. 2023-10-16T20:08:06.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.013+0000 7f677196c700 1 Processor -- start 2023-10-16T20:08:06.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.013+0000 7f677196c700 1 -- start start 2023-10-16T20:08:06.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 0x7f676c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f676c0cbc10 0x7f676c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c144ea0 0x7f676c0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c1f1180 con 0x7f676c0712e0 2023-10-16T20:08:06.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c1f1460 con 0x7f676c0cbc10 2023-10-16T20:08:06.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c1f1740 con 0x7f676c144ea0 2023-10-16T20:08:06.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 0x7f676c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 0x7f676c0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32868/0 (socket says 172.21.15.152:32868) 2023-10-16T20:08:06.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 -- 172.21.15.152:0/1876013456 learned_addr learned my addr 172.21.15.152:0/1876013456 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:06.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676a7fc700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f676c0cbc10 0x7f676c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676b7fe700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c144ea0 0x7f676c0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 -- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c144ea0 msgr2=0x7f676c0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c144ea0 0x7f676c0b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 -- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f676c0cbc10 msgr2=0x7f676c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f676c0cbc10 0x7f676c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 -- 172.21.15.152:0/1876013456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600094a0 con 0x7f676c0712e0 2023-10-16T20:08:06.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676b7fe700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c144ea0 0x7f676c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:06.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f676affd700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 0x7f676c0c7d00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f67600090b0 tx=0x7f6760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760024620 con 0x7f676c0712e0 2023-10-16T20:08:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6760024780 con 0x7f676c0712e0 2023-10-16T20:08:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c0c34b0 con 0x7f676c0712e0 2023-10-16T20:08:06.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760024af0 con 0x7f676c0712e0 2023-10-16T20:08:06.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.014+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c0c41f0 con 0x7f676c0712e0 2023-10-16T20:08:06.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.015+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c04ebb0 con 0x7f676c0712e0 2023-10-16T20:08:06.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.016+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6760022070 con 0x7f676c0712e0 2023-10-16T20:08:06.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.016+0000 7f6753fff700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f675806af00 0x7f675806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.016+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f676008a5e0 con 0x7f676c0712e0 2023-10-16T20:08:06.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.016+0000 7f676a7fc700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f675806af00 0x7f675806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.017+0000 7f676a7fc700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f675806af00 0x7f675806d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f676c0c9aa0 tx=0x7f675c007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.038 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.021+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67600556e0 con 0x7f676c0712e0 2023-10-16T20:08:06.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.208+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f676c0ca2b0 con 0x7f675806af00 2023-10-16T20:08:06.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.215+0000 7f6753fff700 1 -- 172.21.15.152:0/1876013456 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288659 (secure 0 0 0) 0x7f675c014450 con 0x7f675806af00 2023-10-16T20:08:06.221 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:06.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f675806af00 msgr2=0x7f675806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f675806af00 0x7f675806d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f676c0c9aa0 tx=0x7f675c007e00 comp rx=0 tx=0).stop 2023-10-16T20:08:06.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 msgr2=0x7f676c0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 0x7f676c0c7d00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f67600090b0 tx=0x7f6760004750 comp rx=0 tx=0).stop 2023-10-16T20:08:06.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 shutdown_connections 2023-10-16T20:08:06.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f675806af00 0x7f675806d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f676c144ea0 0x7f676c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676c0712e0 0x7f676c0c7d00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 --2- 172.21.15.152:0/1876013456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f676c0cbc10 0x7f676c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 >> 172.21.15.152:0/1876013456 conn(0x7f676c0cfcd0 msgr2=0x7f676c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:06.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 shutdown_connections 2023-10-16T20:08:06.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.219+0000 7f677196c700 1 -- 172.21.15.152:0/1876013456 wait complete. 2023-10-16T20:08:06.228 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:06.233 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-10-16T20:08:04.786734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2795852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.765206"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023225+0000","last_change":"2023-10-16T20:07:53.032076+0000","last_active":"2023-10-16T20:07:54.023225+0000","last_peered":"2023-10-16T20:07:54.023225+0000","last_clean":"2023-10-16T20:07:54.023225+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:07:54.023225+0000","last_undegraded":"2023-10-16T20:07:54.023225+0000","last_fullsized":"2023-10-16T20:07:54.023225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:53.865740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023105+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:07:54.023105+0000","last_peered":"2023-10-16T20:07:54.023105+0000","last_clean":"2023-10-16T20:07:54.023105+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:07:54.023105+0000","last_undegraded":"2023-10-16T20:07:54.023105+0000","last_fullsized":"2023-10-16T20:07:54.023105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:56.088181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269135+0000","last_change":"2023-10-16T20:07:53.041956+0000","last_active":"2023-10-16T20:07:54.269135+0000","last_peered":"2023-10-16T20:07:54.269135+0000","last_clean":"2023-10-16T20:07:54.269135+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:07:54.269135+0000","last_undegraded":"2023-10-16T20:07:54.269135+0000","last_fullsized":"2023-10-16T20:07:54.269135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:09.257087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101183+0000","last_change":"2023-10-16T20:07:53.037791+0000","last_active":"2023-10-16T20:07:54.101183+0000","last_peered":"2023-10-16T20:07:54.101183+0000","last_clean":"2023-10-16T20:07:54.101183+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:07:54.101183+0000","last_undegraded":"2023-10-16T20:07:54.101183+0000","last_fullsized":"2023-10-16T20:07:54.101183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:17.460962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101028+0000","last_change":"2023-10-16T20:07:53.037496+0000","last_active":"2023-10-16T20:07:54.101028+0000","last_peered":"2023-10-16T20:07:54.101028+0000","last_clean":"2023-10-16T20:07:54.101028+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:07:54.101028+0000","last_undegraded":"2023-10-16T20:07:54.101028+0000","last_fullsized":"2023-10-16T20:07:54.101028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:32.843327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269118+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269118+0000","last_peered":"2023-10-16T20:07:54.269118+0000","last_clean":"2023-10-16T20:07:54.269118+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:07:54.269118+0000","last_undegraded":"2023-10-16T20:07:54.269118+0000","last_fullsized":"2023-10-16T20:07:54.269118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103476+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:54.103476+0000","last_peered":"2023-10-16T20:07:54.103476+0000","last_clean":"2023-10-16T20:07:54.103476+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:54.103476+0000","last_undegraded":"2023-10-16T20:07:54.103476+0000","last_fullsized":"2023-10-16T20:07:54.103476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.022889+0000","last_change":"2023-10-16T20:07:53.031550+0000","last_active":"2023-10-16T20:07:54.022889+0000","last_peered":"2023-10-16T20:07:54.022889+0000","last_clean":"2023-10-16T20:07:54.022889+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:07:54.022889+0000","last_undegraded":"2023-10-16T20:07:54.022889+0000","last_fullsized":"2023-10-16T20:07:54.022889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:03:49.996848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269666+0000","last_change":"2023-10-16T20:07:53.053620+0000","last_active":"2023-10-16T20:07:54.269666+0000","last_peered":"2023-10-16T20:07:54.269666+0000","last_clean":"2023-10-16T20:07:54.269666+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:07:54.269666+0000","last_undegraded":"2023-10-16T20:07:54.269666+0000","last_fullsized":"2023-10-16T20:07:54.269666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103613+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:54.103613+0000","last_peered":"2023-10-16T20:07:54.103613+0000","last_clean":"2023-10-16T20:07:54.103613+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:54.103613+0000","last_undegraded":"2023-10-16T20:07:54.103613+0000","last_fullsized":"2023-10-16T20:07:54.103613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:09.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103704+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:54.103704+0000","last_peered":"2023-10-16T20:07:54.103704+0000","last_clean":"2023-10-16T20:07:54.103704+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:54.103704+0000","last_undegraded":"2023-10-16T20:07:54.103704+0000","last_fullsized":"2023-10-16T20:07:54.103704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:33.300151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269358+0000","last_change":"2023-10-16T20:07:53.038955+0000","last_active":"2023-10-16T20:07:54.269358+0000","last_peered":"2023-10-16T20:07:54.269358+0000","last_clean":"2023-10-16T20:07:54.269358+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:07:54.269358+0000","last_undegraded":"2023-10-16T20:07:54.269358+0000","last_fullsized":"2023-10-16T20:07:54.269358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103406+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:54.103406+0000","last_peered":"2023-10-16T20:07:54.103406+0000","last_clean":"2023-10-16T20:07:54.103406+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:54.103406+0000","last_undegraded":"2023-10-16T20:07:54.103406+0000","last_fullsized":"2023-10-16T20:07:54.103406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025328+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:54.025328+0000","last_peered":"2023-10-16T20:07:54.025328+0000","last_clean":"2023-10-16T20:07:54.025328+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:54.025328+0000","last_undegraded":"2023-10-16T20:07:54.025328+0000","last_fullsized":"2023-10-16T20:07:54.025328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103294+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:54.103294+0000","last_peered":"2023-10-16T20:07:54.103294+0000","last_clean":"2023-10-16T20:07:54.103294+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:54.103294+0000","last_undegraded":"2023-10-16T20:07:54.103294+0000","last_fullsized":"2023-10-16T20:07:54.103294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269416+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:54.269416+0000","last_peered":"2023-10-16T20:07:54.269416+0000","last_clean":"2023-10-16T20:07:54.269416+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:54.269416+0000","last_undegraded":"2023-10-16T20:07:54.269416+0000","last_fullsized":"2023-10-16T20:07:54.269416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:27.018295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269948+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:54.269948+0000","last_peered":"2023-10-16T20:07:54.269948+0000","last_clean":"2023-10-16T20:07:54.269948+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:54.269948+0000","last_undegraded":"2023-10-16T20:07:54.269948+0000","last_fullsized":"2023-10-16T20:07:54.269948+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025037+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:54.025037+0000","last_peered":"2023-10-16T20:07:54.025037+0000","last_clean":"2023-10-16T20:07:54.025037+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:54.025037+0000","last_undegraded":"2023-10-16T20:07:54.025037+0000","last_fullsized":"2023-10-16T20:07:54.025037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101108+0000","last_change":"2023-10-16T20:07:53.036516+0000","last_active":"2023-10-16T20:07:54.101108+0000","last_peered":"2023-10-16T20:07:54.101108+0000","last_clean":"2023-10-16T20:07:54.101108+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:07:54.101108+0000","last_undegraded":"2023-10-16T20:07:54.101108+0000","last_fullsized":"2023-10-16T20:07:54.101108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:53.007268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024266+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:54.024266+0000","last_peered":"2023-10-16T20:07:54.024266+0000","last_clean":"2023-10-16T20:07:54.024266+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:54.024266+0000","last_undegraded":"2023-10-16T20:07:54.024266+0000","last_fullsized":"2023-10-16T20:07:54.024266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103499+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:54.103499+0000","last_peered":"2023-10-16T20:07:54.103499+0000","last_clean":"2023-10-16T20:07:54.103499+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:54.103499+0000","last_undegraded":"2023-10-16T20:07:54.103499+0000","last_fullsized":"2023-10-16T20:07:54.103499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:38.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024960+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:54.024960+0000","last_peered":"2023-10-16T20:07:54.024960+0000","last_clean":"2023-10-16T20:07:54.024960+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:54.024960+0000","last_undegraded":"2023-10-16T20:07:54.024960+0000","last_fullsized":"2023-10-16T20:07:54.024960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269612+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:54.269612+0000","last_peered":"2023-10-16T20:07:54.269612+0000","last_clean":"2023-10-16T20:07:54.269612+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:54.269612+0000","last_undegraded":"2023-10-16T20:07:54.269612+0000","last_fullsized":"2023-10-16T20:07:54.269612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:12.377109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101006+0000","last_change":"2023-10-16T20:07:53.049683+0000","last_active":"2023-10-16T20:07:54.101006+0000","last_peered":"2023-10-16T20:07:54.101006+0000","last_clean":"2023-10-16T20:07:54.101006+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:07:54.101006+0000","last_undegraded":"2023-10-16T20:07:54.101006+0000","last_fullsized":"2023-10-16T20:07:54.101006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:06.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024377+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:54.024377+0000","last_peered":"2023-10-16T20:07:54.024377+0000","last_clean":"2023-10-16T20:07:54.024377+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:54.024377+0000","last_undegraded":"2023-10-16T20:07:54.024377+0000","last_fullsized":"2023-10-16T20:07:54.024377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269284+0000","last_change":"2023-10-16T20:07:53.041714+0000","last_active":"2023-10-16T20:07:54.269284+0000","last_peered":"2023-10-16T20:07:54.269284+0000","last_clean":"2023-10-16T20:07:54.269284+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:07:54.269284+0000","last_undegraded":"2023-10-16T20:07:54.269284+0000","last_fullsized":"2023-10-16T20:07:54.269284+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024374+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:54.024374+0000","last_peered":"2023-10-16T20:07:54.024374+0000","last_clean":"2023-10-16T20:07:54.024374+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:54.024374+0000","last_undegraded":"2023-10-16T20:07:54.024374+0000","last_fullsized":"2023-10-16T20:07:54.024374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103586+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:54.103586+0000","last_peered":"2023-10-16T20:07:54.103586+0000","last_clean":"2023-10-16T20:07:54.103586+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:54.103586+0000","last_undegraded":"2023-10-16T20:07:54.103586+0000","last_fullsized":"2023-10-16T20:07:54.103586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:14.506216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024418+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:54.024418+0000","last_peered":"2023-10-16T20:07:54.024418+0000","last_clean":"2023-10-16T20:07:54.024418+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:54.024418+0000","last_undegraded":"2023-10-16T20:07:54.024418+0000","last_fullsized":"2023-10-16T20:07:54.024418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024148+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:54.024148+0000","last_peered":"2023-10-16T20:07:54.024148+0000","last_clean":"2023-10-16T20:07:54.024148+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:54.024148+0000","last_undegraded":"2023-10-16T20:07:54.024148+0000","last_fullsized":"2023-10-16T20:07:54.024148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269484+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:54.269484+0000","last_peered":"2023-10-16T20:07:54.269484+0000","last_clean":"2023-10-16T20:07:54.269484+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:54.269484+0000","last_undegraded":"2023-10-16T20:07:54.269484+0000","last_fullsized":"2023-10-16T20:07:54.269484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268972+0000","last_change":"2023-10-16T20:07:53.033516+0000","last_active":"2023-10-16T20:07:54.268972+0000","last_peered":"2023-10-16T20:07:54.268972+0000","last_clean":"2023-10-16T20:07:54.268972+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:07:54.268972+0000","last_undegraded":"2023-10-16T20:07:54.268972+0000","last_fullsized":"2023-10-16T20:07:54.268972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269908+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:54.269908+0000","last_peered":"2023-10-16T20:07:54.269908+0000","last_clean":"2023-10-16T20:07:54.269908+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:54.269908+0000","last_undegraded":"2023-10-16T20:07:54.269908+0000","last_fullsized":"2023-10-16T20:07:54.269908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963697+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.963697+0000","last_peered":"2023-10-16T20:07:53.963697+0000","last_clean":"2023-10-16T20:07:53.963697+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.963697+0000","last_undegraded":"2023-10-16T20:07:53.963697+0000","last_fullsized":"2023-10-16T20:07:53.963697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269553+0000","last_change":"2023-10-16T20:07:53.041621+0000","last_active":"2023-10-16T20:07:54.269553+0000","last_peered":"2023-10-16T20:07:54.269553+0000","last_clean":"2023-10-16T20:07:54.269553+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:07:54.269553+0000","last_undegraded":"2023-10-16T20:07:54.269553+0000","last_fullsized":"2023-10-16T20:07:54.269553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:22:48.459709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051925+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:53.051925+0000","last_peered":"2023-10-16T20:07:53.051925+0000","last_clean":"2023-10-16T20:07:53.051925+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:53.051925+0000","last_undegraded":"2023-10-16T20:07:53.051925+0000","last_fullsized":"2023-10-16T20:07:53.051925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025298+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:54.025298+0000","last_peered":"2023-10-16T20:07:54.025298+0000","last_clean":"2023-10-16T20:07:54.025298+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:54.025298+0000","last_undegraded":"2023-10-16T20:07:54.025298+0000","last_fullsized":"2023-10-16T20:07:54.025298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056466+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:53.056466+0000","last_peered":"2023-10-16T20:07:53.056466+0000","last_clean":"2023-10-16T20:07:53.056466+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:53.056466+0000","last_undegraded":"2023-10-16T20:07:53.056466+0000","last_fullsized":"2023-10-16T20:07:53.056466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:17.552698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023330+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:07:54.023330+0000","last_peered":"2023-10-16T20:07:54.023330+0000","last_clean":"2023-10-16T20:07:54.023330+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:07:54.023330+0000","last_undegraded":"2023-10-16T20:07:54.023330+0000","last_fullsized":"2023-10-16T20:07:54.023330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:50:53.891138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962423+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.962423+0000","last_peered":"2023-10-16T20:07:53.962423+0000","last_clean":"2023-10-16T20:07:53.962423+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.962423+0000","last_undegraded":"2023-10-16T20:07:53.962423+0000","last_fullsized":"2023-10-16T20:07:53.962423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269292+0000","last_change":"2023-10-16T20:07:53.031450+0000","last_active":"2023-10-16T20:07:54.269292+0000","last_peered":"2023-10-16T20:07:54.269292+0000","last_clean":"2023-10-16T20:07:54.269292+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:07:54.269292+0000","last_undegraded":"2023-10-16T20:07:54.269292+0000","last_fullsized":"2023-10-16T20:07:54.269292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962521+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.962521+0000","last_peered":"2023-10-16T20:07:53.962521+0000","last_clean":"2023-10-16T20:07:53.962521+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.962521+0000","last_undegraded":"2023-10-16T20:07:53.962521+0000","last_fullsized":"2023-10-16T20:07:53.962521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103297+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:54.103297+0000","last_peered":"2023-10-16T20:07:54.103297+0000","last_clean":"2023-10-16T20:07:54.103297+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:54.103297+0000","last_undegraded":"2023-10-16T20:07:54.103297+0000","last_fullsized":"2023-10-16T20:07:54.103297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964077+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.964077+0000","last_peered":"2023-10-16T20:07:53.964077+0000","last_clean":"2023-10-16T20:07:53.964077+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.964077+0000","last_undegraded":"2023-10-16T20:07:53.964077+0000","last_fullsized":"2023-10-16T20:07:53.964077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025136+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:54.025136+0000","last_peered":"2023-10-16T20:07:54.025136+0000","last_clean":"2023-10-16T20:07:54.025136+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:54.025136+0000","last_undegraded":"2023-10-16T20:07:54.025136+0000","last_fullsized":"2023-10-16T20:07:54.025136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026238+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:53.026238+0000","last_peered":"2023-10-16T20:07:53.026238+0000","last_clean":"2023-10-16T20:07:53.026238+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:53.026238+0000","last_undegraded":"2023-10-16T20:07:53.026238+0000","last_fullsized":"2023-10-16T20:07:53.026238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.960835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023237+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:07:54.023237+0000","last_peered":"2023-10-16T20:07:54.023237+0000","last_clean":"2023-10-16T20:07:54.023237+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:07:54.023237+0000","last_undegraded":"2023-10-16T20:07:54.023237+0000","last_fullsized":"2023-10-16T20:07:54.023237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:10.581126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962309+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.962309+0000","last_peered":"2023-10-16T20:07:53.962309+0000","last_clean":"2023-10-16T20:07:53.962309+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.962309+0000","last_undegraded":"2023-10-16T20:07:53.962309+0000","last_fullsized":"2023-10-16T20:07:53.962309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101256+0000","last_change":"2023-10-16T20:07:53.038082+0000","last_active":"2023-10-16T20:07:54.101256+0000","last_peered":"2023-10-16T20:07:54.101256+0000","last_clean":"2023-10-16T20:07:54.101256+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:07:54.101256+0000","last_undegraded":"2023-10-16T20:07:54.101256+0000","last_fullsized":"2023-10-16T20:07:54.101256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:06.955879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022694+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:53.022694+0000","last_peered":"2023-10-16T20:07:53.022694+0000","last_clean":"2023-10-16T20:07:53.022694+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:53.022694+0000","last_undegraded":"2023-10-16T20:07:53.022694+0000","last_fullsized":"2023-10-16T20:07:53.022694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:26.475876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269796+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:54.269796+0000","last_peered":"2023-10-16T20:07:54.269796+0000","last_clean":"2023-10-16T20:07:54.269796+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:54.269796+0000","last_undegraded":"2023-10-16T20:07:54.269796+0000","last_fullsized":"2023-10-16T20:07:54.269796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962629+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.962629+0000","last_peered":"2023-10-16T20:07:53.962629+0000","last_clean":"2023-10-16T20:07:53.962629+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.962629+0000","last_undegraded":"2023-10-16T20:07:53.962629+0000","last_fullsized":"2023-10-16T20:07:53.962629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269544+0000","last_change":"2023-10-16T20:07:53.048262+0000","last_active":"2023-10-16T20:07:54.269544+0000","last_peered":"2023-10-16T20:07:54.269544+0000","last_clean":"2023-10-16T20:07:54.269544+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:07:54.269544+0000","last_undegraded":"2023-10-16T20:07:54.269544+0000","last_fullsized":"2023-10-16T20:07:54.269544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962580+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.962580+0000","last_peered":"2023-10-16T20:07:53.962580+0000","last_clean":"2023-10-16T20:07:53.962580+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.962580+0000","last_undegraded":"2023-10-16T20:07:53.962580+0000","last_fullsized":"2023-10-16T20:07:53.962580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025162+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:54.025162+0000","last_peered":"2023-10-16T20:07:54.025162+0000","last_clean":"2023-10-16T20:07:54.025162+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:54.025162+0000","last_undegraded":"2023-10-16T20:07:54.025162+0000","last_fullsized":"2023-10-16T20:07:54.025162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061493+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:53.061493+0000","last_peered":"2023-10-16T20:07:53.061493+0000","last_clean":"2023-10-16T20:07:53.061493+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:53.061493+0000","last_undegraded":"2023-10-16T20:07:53.061493+0000","last_fullsized":"2023-10-16T20:07:53.061493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:54.643651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269104+0000","last_change":"2023-10-16T20:07:53.048961+0000","last_active":"2023-10-16T20:07:54.269104+0000","last_peered":"2023-10-16T20:07:54.269104+0000","last_clean":"2023-10-16T20:07:54.269104+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:07:54.269104+0000","last_undegraded":"2023-10-16T20:07:54.269104+0000","last_fullsized":"2023-10-16T20:07:54.269104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:58.965748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048654+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:53.048654+0000","last_peered":"2023-10-16T20:07:53.048654+0000","last_clean":"2023-10-16T20:07:53.048654+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:53.048654+0000","last_undegraded":"2023-10-16T20:07:53.048654+0000","last_fullsized":"2023-10-16T20:07:53.048654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:19.484561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023303+0000","last_change":"2023-10-16T20:07:53.031630+0000","last_active":"2023-10-16T20:07:54.023303+0000","last_peered":"2023-10-16T20:07:54.023303+0000","last_clean":"2023-10-16T20:07:54.023303+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:07:54.023303+0000","last_undegraded":"2023-10-16T20:07:54.023303+0000","last_fullsized":"2023-10-16T20:07:54.023303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:19.312981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.025675+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:53.025675+0000","last_peered":"2023-10-16T20:07:53.025675+0000","last_clean":"2023-10-16T20:07:53.025675+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:53.025675+0000","last_undegraded":"2023-10-16T20:07:53.025675+0000","last_fullsized":"2023-10-16T20:07:53.025675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269686+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:54.269686+0000","last_peered":"2023-10-16T20:07:54.269686+0000","last_clean":"2023-10-16T20:07:54.269686+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:54.269686+0000","last_undegraded":"2023-10-16T20:07:54.269686+0000","last_fullsized":"2023-10-16T20:07:54.269686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:07.194764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963564+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.963564+0000","last_peered":"2023-10-16T20:07:53.963564+0000","last_clean":"2023-10-16T20:07:53.963564+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.963564+0000","last_undegraded":"2023-10-16T20:07:53.963564+0000","last_fullsized":"2023-10-16T20:07:53.963564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023252+0000","last_change":"2023-10-16T20:07:53.029968+0000","last_active":"2023-10-16T20:07:54.023252+0000","last_peered":"2023-10-16T20:07:54.023252+0000","last_clean":"2023-10-16T20:07:54.023252+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:07:54.023252+0000","last_undegraded":"2023-10-16T20:07:54.023252+0000","last_fullsized":"2023-10-16T20:07:54.023252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:25.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963991+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.963991+0000","last_peered":"2023-10-16T20:07:53.963991+0000","last_clean":"2023-10-16T20:07:53.963991+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.963991+0000","last_undegraded":"2023-10-16T20:07:53.963991+0000","last_fullsized":"2023-10-16T20:07:53.963991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023028+0000","last_change":"2023-10-16T20:07:53.037655+0000","last_active":"2023-10-16T20:07:54.023028+0000","last_peered":"2023-10-16T20:07:54.023028+0000","last_clean":"2023-10-16T20:07:54.023028+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:07:54.023028+0000","last_undegraded":"2023-10-16T20:07:54.023028+0000","last_fullsized":"2023-10-16T20:07:54.023028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:13.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962674+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.962674+0000","last_peered":"2023-10-16T20:07:53.962674+0000","last_clean":"2023-10-16T20:07:53.962674+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.962674+0000","last_undegraded":"2023-10-16T20:07:53.962674+0000","last_fullsized":"2023-10-16T20:07:53.962674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103796+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:54.103796+0000","last_peered":"2023-10-16T20:07:54.103796+0000","last_clean":"2023-10-16T20:07:54.103796+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:54.103796+0000","last_undegraded":"2023-10-16T20:07:54.103796+0000","last_fullsized":"2023-10-16T20:07:54.103796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:53.656150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962461+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.962461+0000","last_peered":"2023-10-16T20:07:53.962461+0000","last_clean":"2023-10-16T20:07:53.962461+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.962461+0000","last_undegraded":"2023-10-16T20:07:53.962461+0000","last_fullsized":"2023-10-16T20:07:53.962461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025395+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:54.025395+0000","last_peered":"2023-10-16T20:07:54.025395+0000","last_clean":"2023-10-16T20:07:54.025395+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:54.025395+0000","last_undegraded":"2023-10-16T20:07:54.025395+0000","last_fullsized":"2023-10-16T20:07:54.025395+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061109+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:53.061109+0000","last_peered":"2023-10-16T20:07:53.061109+0000","last_clean":"2023-10-16T20:07:53.061109+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:53.061109+0000","last_undegraded":"2023-10-16T20:07:53.061109+0000","last_fullsized":"2023-10-16T20:07:53.061109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101320+0000","last_change":"2023-10-16T20:07:53.039457+0000","last_active":"2023-10-16T20:07:54.101320+0000","last_peered":"2023-10-16T20:07:54.101320+0000","last_clean":"2023-10-16T20:07:54.101320+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:07:54.101320+0000","last_undegraded":"2023-10-16T20:07:54.101320+0000","last_fullsized":"2023-10-16T20:07:54.101320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:35.056763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026529+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:53.026529+0000","last_peered":"2023-10-16T20:07:53.026529+0000","last_clean":"2023-10-16T20:07:53.026529+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:53.026529+0000","last_undegraded":"2023-10-16T20:07:53.026529+0000","last_fullsized":"2023-10-16T20:07:53.026529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:03.961940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269527+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:54.269527+0000","last_peered":"2023-10-16T20:07:54.269527+0000","last_clean":"2023-10-16T20:07:54.269527+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:54.269527+0000","last_undegraded":"2023-10-16T20:07:54.269527+0000","last_fullsized":"2023-10-16T20:07:54.269527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:11.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051159+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:53.051159+0000","last_peered":"2023-10-16T20:07:53.051159+0000","last_clean":"2023-10-16T20:07:53.051159+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:53.051159+0000","last_undegraded":"2023-10-16T20:07:53.051159+0000","last_fullsized":"2023-10-16T20:07:53.051159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:21.527524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269159+0000","last_change":"2023-10-16T20:07:53.048171+0000","last_active":"2023-10-16T20:07:54.269159+0000","last_peered":"2023-10-16T20:07:54.269159+0000","last_clean":"2023-10-16T20:07:54.269159+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:07:54.269159+0000","last_undegraded":"2023-10-16T20:07:54.269159+0000","last_fullsized":"2023-10-16T20:07:54.269159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:04.966853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027784+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:53.027784+0000","last_peered":"2023-10-16T20:07:53.027784+0000","last_clean":"2023-10-16T20:07:53.027784+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:53.027784+0000","last_undegraded":"2023-10-16T20:07:53.027784+0000","last_fullsized":"2023-10-16T20:07:53.027784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:53.685902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103386+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:54.103386+0000","last_peered":"2023-10-16T20:07:54.103386+0000","last_clean":"2023-10-16T20:07:54.103386+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:54.103386+0000","last_undegraded":"2023-10-16T20:07:54.103386+0000","last_fullsized":"2023-10-16T20:07:54.103386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964052+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.964052+0000","last_peered":"2023-10-16T20:07:53.964052+0000","last_clean":"2023-10-16T20:07:53.964052+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.964052+0000","last_undegraded":"2023-10-16T20:07:53.964052+0000","last_fullsized":"2023-10-16T20:07:53.964052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023079+0000","last_change":"2023-10-16T20:07:53.051277+0000","last_active":"2023-10-16T20:07:54.023079+0000","last_peered":"2023-10-16T20:07:54.023079+0000","last_clean":"2023-10-16T20:07:54.023079+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:07:54.023079+0000","last_undegraded":"2023-10-16T20:07:54.023079+0000","last_fullsized":"2023-10-16T20:07:54.023079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:09.587579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.028961+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:53.028961+0000","last_peered":"2023-10-16T20:07:53.028961+0000","last_clean":"2023-10-16T20:07:53.028961+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:53.028961+0000","last_undegraded":"2023-10-16T20:07:53.028961+0000","last_fullsized":"2023-10-16T20:07:53.028961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:42.884671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269491+0000","last_change":"2023-10-16T20:07:53.042042+0000","last_active":"2023-10-16T20:07:54.269491+0000","last_peered":"2023-10-16T20:07:54.269491+0000","last_clean":"2023-10-16T20:07:54.269491+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:07:54.269491+0000","last_undegraded":"2023-10-16T20:07:54.269491+0000","last_fullsized":"2023-10-16T20:07:54.269491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962687+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.962687+0000","last_peered":"2023-10-16T20:07:53.962687+0000","last_clean":"2023-10-16T20:07:53.962687+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.962687+0000","last_undegraded":"2023-10-16T20:07:53.962687+0000","last_fullsized":"2023-10-16T20:07:53.962687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269825+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:54.269825+0000","last_peered":"2023-10-16T20:07:54.269825+0000","last_clean":"2023-10-16T20:07:54.269825+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:54.269825+0000","last_undegraded":"2023-10-16T20:07:54.269825+0000","last_fullsized":"2023-10-16T20:07:54.269825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101285+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:54.101285+0000","last_peered":"2023-10-16T20:07:54.101285+0000","last_clean":"2023-10-16T20:07:54.101285+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:54.101285+0000","last_undegraded":"2023-10-16T20:07:54.101285+0000","last_fullsized":"2023-10-16T20:07:54.101285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:19.786064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023295+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:07:54.023295+0000","last_peered":"2023-10-16T20:07:54.023295+0000","last_clean":"2023-10-16T20:07:54.023295+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:07:54.023295+0000","last_undegraded":"2023-10-16T20:07:54.023295+0000","last_fullsized":"2023-10-16T20:07:54.023295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027338+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:53.027338+0000","last_peered":"2023-10-16T20:07:53.027338+0000","last_clean":"2023-10-16T20:07:53.027338+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:53.027338+0000","last_undegraded":"2023-10-16T20:07:53.027338+0000","last_fullsized":"2023-10-16T20:07:53.027338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269278+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269278+0000","last_peered":"2023-10-16T20:07:54.269278+0000","last_clean":"2023-10-16T20:07:54.269278+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:07:54.269278+0000","last_undegraded":"2023-10-16T20:07:54.269278+0000","last_fullsized":"2023-10-16T20:07:54.269278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027463+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:53.027463+0000","last_peered":"2023-10-16T20:07:53.027463+0000","last_clean":"2023-10-16T20:07:53.027463+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:53.027463+0000","last_undegraded":"2023-10-16T20:07:53.027463+0000","last_fullsized":"2023-10-16T20:07:53.027463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268970+0000","last_change":"2023-10-16T20:07:53.036387+0000","last_active":"2023-10-16T20:07:54.268970+0000","last_peered":"2023-10-16T20:07:54.268970+0000","last_clean":"2023-10-16T20:07:54.268970+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:07:54.268970+0000","last_undegraded":"2023-10-16T20:07:54.268970+0000","last_fullsized":"2023-10-16T20:07:54.268970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963596+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.963596+0000","last_peered":"2023-10-16T20:07:53.963596+0000","last_clean":"2023-10-16T20:07:53.963596+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.963596+0000","last_undegraded":"2023-10-16T20:07:53.963596+0000","last_fullsized":"2023-10-16T20:07:53.963596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025267+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:54.025267+0000","last_peered":"2023-10-16T20:07:54.025267+0000","last_clean":"2023-10-16T20:07:54.025267+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:54.025267+0000","last_undegraded":"2023-10-16T20:07:54.025267+0000","last_fullsized":"2023-10-16T20:07:54.025267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962334+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.962334+0000","last_peered":"2023-10-16T20:07:53.962334+0000","last_clean":"2023-10-16T20:07:53.962334+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.962334+0000","last_undegraded":"2023-10-16T20:07:53.962334+0000","last_fullsized":"2023-10-16T20:07:53.962334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269794+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:54.269794+0000","last_peered":"2023-10-16T20:07:54.269794+0000","last_clean":"2023-10-16T20:07:54.269794+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:54.269794+0000","last_undegraded":"2023-10-16T20:07:54.269794+0000","last_fullsized":"2023-10-16T20:07:54.269794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022176+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:53.022176+0000","last_peered":"2023-10-16T20:07:53.022176+0000","last_clean":"2023-10-16T20:07:53.022176+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:53.022176+0000","last_undegraded":"2023-10-16T20:07:53.022176+0000","last_fullsized":"2023-10-16T20:07:53.022176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103809+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:54.103809+0000","last_peered":"2023-10-16T20:07:54.103809+0000","last_clean":"2023-10-16T20:07:54.103809+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:54.103809+0000","last_undegraded":"2023-10-16T20:07:54.103809+0000","last_fullsized":"2023-10-16T20:07:54.103809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:22.531060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964119+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.964119+0000","last_peered":"2023-10-16T20:07:53.964119+0000","last_clean":"2023-10-16T20:07:53.964119+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.964119+0000","last_undegraded":"2023-10-16T20:07:53.964119+0000","last_fullsized":"2023-10-16T20:07:53.964119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039606+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:53.039606+0000","last_peered":"2023-10-16T20:07:53.039606+0000","last_clean":"2023-10-16T20:07:53.039606+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:53.039606+0000","last_undegraded":"2023-10-16T20:07:53.039606+0000","last_fullsized":"2023-10-16T20:07:53.039606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":793337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.505}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.622}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.69399999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":201869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.40999999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.502}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.317}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.496},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51800000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.505}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.749}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.66900000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.32900000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52400000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.374},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.313},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50600000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57999999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.753}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83699999999999997}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.88500000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.374},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.627}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:06.239 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T20:08:06.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.394+0000 7f839ad14700 1 Processor -- start 2023-10-16T20:08:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.394+0000 7f839ad14700 1 -- start start 2023-10-16T20:08:06.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f839ad14700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f839406a820 0x7f83940cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f839ad14700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83940cfeb0 con 0x7f83940ca7d0 2023-10-16T20:08:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f839ad14700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839415ec50 con 0x7f839415e7f0 2023-10-16T20:08:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f839ad14700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940ce410 con 0x7f839406a820 2023-10-16T20:08:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f83992b1700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f83940ca7d0 0x7f8394071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41306/0 (socket says 172.21.15.152:41306) 2023-10-16T20:08:06.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f83992b1700 1 -- 172.21.15.152:0/2566574181 learned_addr learned my addr 172.21.15.152:0/2566574181 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:06.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f8398ab0700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f839406a820 0x7f83940cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f8398ab0700 1 -- 172.21.15.152:0/2566574181 >> v1:172.21.15.163:6789/0 conn(0x7f839415e7f0 legacy=0x7f839406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:06.401 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f8398ab0700 1 -- 172.21.15.152:0/2566574181 >> v1:172.21.15.152:6789/0 conn(0x7f83940ca7d0 legacy=0x7f8394071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f83937fe700 1 -- 172.21.15.152:0/2566574181 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207539862 0 0) 0x7f83940cfeb0 con 0x7f83940ca7d0 2023-10-16T20:08:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.395+0000 7f8398ab0700 1 -- 172.21.15.152:0/2566574181 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940af9d0 con 0x7f839406a820 2023-10-16T20:08:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f8398ab0700 1 --2- 172.21.15.152:0/2566574181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940cf7d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8388009840 tx=0x7f8388009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284dc42571da8ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f83937fe700 1 -- 172.21.15.152:0/2566574181 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011830 con 0x7f839406a820 2023-10-16T20:08:06.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f83937fe700 1 -- 172.21.15.152:0/2566574181 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388011990 con 0x7f839406a820 2023-10-16T20:08:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f83937fe700 1 -- 172.21.15.152:0/2566574181 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011d20 con 0x7f839406a820 2023-10-16T20:08:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 -- 172.21.15.152:0/2566574181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 msgr2=0x7f83940cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 --2- 172.21.15.152:0/2566574181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940cf7d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8388009840 tx=0x7f8388009b50 comp rx=0 tx=0).stop 2023-10-16T20:08:06.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 -- 172.21.15.152:0/2566574181 shutdown_connections 2023-10-16T20:08:06.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 --2- 172.21.15.152:0/2566574181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940cf7d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 -- 172.21.15.152:0/2566574181 >> 172.21.15.152:0/2566574181 conn(0x7f83940d0180 msgr2=0x7f83940d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:06.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 -- 172.21.15.152:0/2566574181 shutdown_connections 2023-10-16T20:08:06.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.396+0000 7f839ad14700 1 -- 172.21.15.152:0/2566574181 wait complete. 2023-10-16T20:08:06.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.397+0000 7f839ad14700 1 Processor -- start 2023-10-16T20:08:06.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.397+0000 7f839ad14700 1 -- start start 2023-10-16T20:08:06.411 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f839ad14700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.412 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f839ad14700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940ca7d0 0x7f83941566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.413 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f839ad14700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f839415e7f0 0x7f8394158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.413 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f839ad14700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940c56d0 con 0x7f839406a820 2023-10-16T20:08:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f839ad14700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83940b13c0 con 0x7f839415e7f0 2023-10-16T20:08:06.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f839ad14700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8394156c30 con 0x7f83940ca7d0 2023-10-16T20:08:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f8398ab0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f8398ab0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32882/0 (socket says 172.21.15.152:32882) 2023-10-16T20:08:06.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.398+0000 7f8398ab0700 1 -- 172.21.15.152:0/634366923 learned_addr learned my addr 172.21.15.152:0/634366923 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8393fff700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940ca7d0 0x7f83941566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8398ab0700 1 -- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940ca7d0 msgr2=0x7f83941566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f83992b1700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f839415e7f0 0x7f8394158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8398ab0700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940ca7d0 0x7f83941566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8398ab0700 1 -- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f839415e7f0 msgr2=0x7f8394158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8398ab0700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f839415e7f0 0x7f8394158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8398ab0700 1 -- 172.21.15.152:0/634366923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880094a0 con 0x7f839406a820 2023-10-16T20:08:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8393fff700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940ca7d0 0x7f83941566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f83992b1700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f839415e7f0 0x7f8394158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f8398ab0700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940b0ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8388009f50 tx=0x7f8388004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838801ab00 con 0x7f839406a820 2023-10-16T20:08:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838801ac60 con 0x7f839406a820 2023-10-16T20:08:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83940b10e0 con 0x7f839406a820 2023-10-16T20:08:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880243f0 con 0x7f839406a820 2023-10-16T20:08:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.399+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83940c5360 con 0x7f839406a820 2023-10-16T20:08:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.400+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83940c5520 con 0x7f839406a820 2023-10-16T20:08:06.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.400+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8388024550 con 0x7f839406a820 2023-10-16T20:08:06.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.401+0000 7f83917fa700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f837806af00 0x7f837806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.401+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f838808ae80 con 0x7f839406a820 2023-10-16T20:08:06.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.401+0000 7f8393fff700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f837806af00 0x7f837806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.401+0000 7f8393fff700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f837806af00 0x7f837806d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83940b1010 tx=0x7f8380009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.405+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8388055f80 con 0x7f839406a820 2023-10-16T20:08:06.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.590+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83940c4f00 con 0x7f837806af00 2023-10-16T20:08:06.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.597+0000 7f83917fa700 1 -- 172.21.15.152:0/634366923 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288659 (secure 0 0 0) 0x7f83800050d0 con 0x7f837806af00 2023-10-16T20:08:06.603 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:06.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f837806af00 msgr2=0x7f837806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f837806af00 0x7f837806d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83940b1010 tx=0x7f8380009040 comp rx=0 tx=0).stop 2023-10-16T20:08:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 msgr2=0x7f83940b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940b0ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8388009f50 tx=0x7f8388004750 comp rx=0 tx=0).stop 2023-10-16T20:08:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 shutdown_connections 2023-10-16T20:08:06.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f837806af00 0x7f837806d3c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f839415e7f0 0x7f8394158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f839406a820 0x7f83940b0ad0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 --2- 172.21.15.152:0/634366923 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f83940ca7d0 0x7f83941566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 >> 172.21.15.152:0/634366923 conn(0x7f83940d0180 msgr2=0x7f839406d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:06.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 shutdown_connections 2023-10-16T20:08:06.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.601+0000 7f839ad14700 1 -- 172.21.15.152:0/634366923 wait complete. 2023-10-16T20:08:06.609 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:06.615 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-10-16T20:08:04.786734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2795852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.765206"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023225+0000","last_change":"2023-10-16T20:07:53.032076+0000","last_active":"2023-10-16T20:07:54.023225+0000","last_peered":"2023-10-16T20:07:54.023225+0000","last_clean":"2023-10-16T20:07:54.023225+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:07:54.023225+0000","last_undegraded":"2023-10-16T20:07:54.023225+0000","last_fullsized":"2023-10-16T20:07:54.023225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:53.865740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023105+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:07:54.023105+0000","last_peered":"2023-10-16T20:07:54.023105+0000","last_clean":"2023-10-16T20:07:54.023105+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:07:54.023105+0000","last_undegraded":"2023-10-16T20:07:54.023105+0000","last_fullsized":"2023-10-16T20:07:54.023105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:56.088181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269135+0000","last_change":"2023-10-16T20:07:53.041956+0000","last_active":"2023-10-16T20:07:54.269135+0000","last_peered":"2023-10-16T20:07:54.269135+0000","last_clean":"2023-10-16T20:07:54.269135+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:07:54.269135+0000","last_undegraded":"2023-10-16T20:07:54.269135+0000","last_fullsized":"2023-10-16T20:07:54.269135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:09.257087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101183+0000","last_change":"2023-10-16T20:07:53.037791+0000","last_active":"2023-10-16T20:07:54.101183+0000","last_peered":"2023-10-16T20:07:54.101183+0000","last_clean":"2023-10-16T20:07:54.101183+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:07:54.101183+0000","last_undegraded":"2023-10-16T20:07:54.101183+0000","last_fullsized":"2023-10-16T20:07:54.101183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:17.460962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101028+0000","last_change":"2023-10-16T20:07:53.037496+0000","last_active":"2023-10-16T20:07:54.101028+0000","last_peered":"2023-10-16T20:07:54.101028+0000","last_clean":"2023-10-16T20:07:54.101028+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:07:54.101028+0000","last_undegraded":"2023-10-16T20:07:54.101028+0000","last_fullsized":"2023-10-16T20:07:54.101028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:32.843327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269118+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269118+0000","last_peered":"2023-10-16T20:07:54.269118+0000","last_clean":"2023-10-16T20:07:54.269118+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:07:54.269118+0000","last_undegraded":"2023-10-16T20:07:54.269118+0000","last_fullsized":"2023-10-16T20:07:54.269118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103476+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:54.103476+0000","last_peered":"2023-10-16T20:07:54.103476+0000","last_clean":"2023-10-16T20:07:54.103476+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:54.103476+0000","last_undegraded":"2023-10-16T20:07:54.103476+0000","last_fullsized":"2023-10-16T20:07:54.103476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.022889+0000","last_change":"2023-10-16T20:07:53.031550+0000","last_active":"2023-10-16T20:07:54.022889+0000","last_peered":"2023-10-16T20:07:54.022889+0000","last_clean":"2023-10-16T20:07:54.022889+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:07:54.022889+0000","last_undegraded":"2023-10-16T20:07:54.022889+0000","last_fullsized":"2023-10-16T20:07:54.022889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:03:49.996848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269666+0000","last_change":"2023-10-16T20:07:53.053620+0000","last_active":"2023-10-16T20:07:54.269666+0000","last_peered":"2023-10-16T20:07:54.269666+0000","last_clean":"2023-10-16T20:07:54.269666+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:07:54.269666+0000","last_undegraded":"2023-10-16T20:07:54.269666+0000","last_fullsized":"2023-10-16T20:07:54.269666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103613+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:54.103613+0000","last_peered":"2023-10-16T20:07:54.103613+0000","last_clean":"2023-10-16T20:07:54.103613+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:54.103613+0000","last_undegraded":"2023-10-16T20:07:54.103613+0000","last_fullsized":"2023-10-16T20:07:54.103613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:09.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103704+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:54.103704+0000","last_peered":"2023-10-16T20:07:54.103704+0000","last_clean":"2023-10-16T20:07:54.103704+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:54.103704+0000","last_undegraded":"2023-10-16T20:07:54.103704+0000","last_fullsized":"2023-10-16T20:07:54.103704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:33.300151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269358+0000","last_change":"2023-10-16T20:07:53.038955+0000","last_active":"2023-10-16T20:07:54.269358+0000","last_peered":"2023-10-16T20:07:54.269358+0000","last_clean":"2023-10-16T20:07:54.269358+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:07:54.269358+0000","last_undegraded":"2023-10-16T20:07:54.269358+0000","last_fullsized":"2023-10-16T20:07:54.269358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103406+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:54.103406+0000","last_peered":"2023-10-16T20:07:54.103406+0000","last_clean":"2023-10-16T20:07:54.103406+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:54.103406+0000","last_undegraded":"2023-10-16T20:07:54.103406+0000","last_fullsized":"2023-10-16T20:07:54.103406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025328+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:54.025328+0000","last_peered":"2023-10-16T20:07:54.025328+0000","last_clean":"2023-10-16T20:07:54.025328+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:54.025328+0000","last_undegraded":"2023-10-16T20:07:54.025328+0000","last_fullsized":"2023-10-16T20:07:54.025328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103294+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:54.103294+0000","last_peered":"2023-10-16T20:07:54.103294+0000","last_clean":"2023-10-16T20:07:54.103294+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:54.103294+0000","last_undegraded":"2023-10-16T20:07:54.103294+0000","last_fullsized":"2023-10-16T20:07:54.103294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269416+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:54.269416+0000","last_peered":"2023-10-16T20:07:54.269416+0000","last_clean":"2023-10-16T20:07:54.269416+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:54.269416+0000","last_undegraded":"2023-10-16T20:07:54.269416+0000","last_fullsized":"2023-10-16T20:07:54.269416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:27.018295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269948+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:54.269948+0000","last_peered":"2023-10-16T20:07:54.269948+0000","last_clean":"2023-10-16T20:07:54.269948+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:54.269948+0000","last_undegraded":"2023-10-16T20:07:54.269948+0000","last_fullsized":"2023-10-16T20:07:54.269948+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025037+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:54.025037+0000","last_peered":"2023-10-16T20:07:54.025037+0000","last_clean":"2023-10-16T20:07:54.025037+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:54.025037+0000","last_undegraded":"2023-10-16T20:07:54.025037+0000","last_fullsized":"2023-10-16T20:07:54.025037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101108+0000","last_change":"2023-10-16T20:07:53.036516+0000","last_active":"2023-10-16T20:07:54.101108+0000","last_peered":"2023-10-16T20:07:54.101108+0000","last_clean":"2023-10-16T20:07:54.101108+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:07:54.101108+0000","last_undegraded":"2023-10-16T20:07:54.101108+0000","last_fullsized":"2023-10-16T20:07:54.101108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:53.007268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024266+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:54.024266+0000","last_peered":"2023-10-16T20:07:54.024266+0000","last_clean":"2023-10-16T20:07:54.024266+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:54.024266+0000","last_undegraded":"2023-10-16T20:07:54.024266+0000","last_fullsized":"2023-10-16T20:07:54.024266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103499+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:54.103499+0000","last_peered":"2023-10-16T20:07:54.103499+0000","last_clean":"2023-10-16T20:07:54.103499+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:54.103499+0000","last_undegraded":"2023-10-16T20:07:54.103499+0000","last_fullsized":"2023-10-16T20:07:54.103499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:38.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024960+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:54.024960+0000","last_peered":"2023-10-16T20:07:54.024960+0000","last_clean":"2023-10-16T20:07:54.024960+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:54.024960+0000","last_undegraded":"2023-10-16T20:07:54.024960+0000","last_fullsized":"2023-10-16T20:07:54.024960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269612+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:54.269612+0000","last_peered":"2023-10-16T20:07:54.269612+0000","last_clean":"2023-10-16T20:07:54.269612+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:54.269612+0000","last_undegraded":"2023-10-16T20:07:54.269612+0000","last_fullsized":"2023-10-16T20:07:54.269612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:12.377109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101006+0000","last_change":"2023-10-16T20:07:53.049683+0000","last_active":"2023-10-16T20:07:54.101006+0000","last_peered":"2023-10-16T20:07:54.101006+0000","last_clean":"2023-10-16T20:07:54.101006+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:07:54.101006+0000","last_undegraded":"2023-10-16T20:07:54.101006+0000","last_fullsized":"2023-10-16T20:07:54.101006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:06.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024377+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:54.024377+0000","last_peered":"2023-10-16T20:07:54.024377+0000","last_clean":"2023-10-16T20:07:54.024377+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:54.024377+0000","last_undegraded":"2023-10-16T20:07:54.024377+0000","last_fullsized":"2023-10-16T20:07:54.024377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269284+0000","last_change":"2023-10-16T20:07:53.041714+0000","last_active":"2023-10-16T20:07:54.269284+0000","last_peered":"2023-10-16T20:07:54.269284+0000","last_clean":"2023-10-16T20:07:54.269284+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:07:54.269284+0000","last_undegraded":"2023-10-16T20:07:54.269284+0000","last_fullsized":"2023-10-16T20:07:54.269284+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024374+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:54.024374+0000","last_peered":"2023-10-16T20:07:54.024374+0000","last_clean":"2023-10-16T20:07:54.024374+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:54.024374+0000","last_undegraded":"2023-10-16T20:07:54.024374+0000","last_fullsized":"2023-10-16T20:07:54.024374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103586+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:54.103586+0000","last_peered":"2023-10-16T20:07:54.103586+0000","last_clean":"2023-10-16T20:07:54.103586+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:54.103586+0000","last_undegraded":"2023-10-16T20:07:54.103586+0000","last_fullsized":"2023-10-16T20:07:54.103586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:14.506216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024418+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:54.024418+0000","last_peered":"2023-10-16T20:07:54.024418+0000","last_clean":"2023-10-16T20:07:54.024418+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:54.024418+0000","last_undegraded":"2023-10-16T20:07:54.024418+0000","last_fullsized":"2023-10-16T20:07:54.024418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024148+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:54.024148+0000","last_peered":"2023-10-16T20:07:54.024148+0000","last_clean":"2023-10-16T20:07:54.024148+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:54.024148+0000","last_undegraded":"2023-10-16T20:07:54.024148+0000","last_fullsized":"2023-10-16T20:07:54.024148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269484+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:54.269484+0000","last_peered":"2023-10-16T20:07:54.269484+0000","last_clean":"2023-10-16T20:07:54.269484+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:54.269484+0000","last_undegraded":"2023-10-16T20:07:54.269484+0000","last_fullsized":"2023-10-16T20:07:54.269484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268972+0000","last_change":"2023-10-16T20:07:53.033516+0000","last_active":"2023-10-16T20:07:54.268972+0000","last_peered":"2023-10-16T20:07:54.268972+0000","last_clean":"2023-10-16T20:07:54.268972+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:07:54.268972+0000","last_undegraded":"2023-10-16T20:07:54.268972+0000","last_fullsized":"2023-10-16T20:07:54.268972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269908+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:54.269908+0000","last_peered":"2023-10-16T20:07:54.269908+0000","last_clean":"2023-10-16T20:07:54.269908+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:54.269908+0000","last_undegraded":"2023-10-16T20:07:54.269908+0000","last_fullsized":"2023-10-16T20:07:54.269908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963697+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.963697+0000","last_peered":"2023-10-16T20:07:53.963697+0000","last_clean":"2023-10-16T20:07:53.963697+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.963697+0000","last_undegraded":"2023-10-16T20:07:53.963697+0000","last_fullsized":"2023-10-16T20:07:53.963697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269553+0000","last_change":"2023-10-16T20:07:53.041621+0000","last_active":"2023-10-16T20:07:54.269553+0000","last_peered":"2023-10-16T20:07:54.269553+0000","last_clean":"2023-10-16T20:07:54.269553+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:07:54.269553+0000","last_undegraded":"2023-10-16T20:07:54.269553+0000","last_fullsized":"2023-10-16T20:07:54.269553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:22:48.459709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051925+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:53.051925+0000","last_peered":"2023-10-16T20:07:53.051925+0000","last_clean":"2023-10-16T20:07:53.051925+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:53.051925+0000","last_undegraded":"2023-10-16T20:07:53.051925+0000","last_fullsized":"2023-10-16T20:07:53.051925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025298+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:54.025298+0000","last_peered":"2023-10-16T20:07:54.025298+0000","last_clean":"2023-10-16T20:07:54.025298+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:54.025298+0000","last_undegraded":"2023-10-16T20:07:54.025298+0000","last_fullsized":"2023-10-16T20:07:54.025298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056466+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:53.056466+0000","last_peered":"2023-10-16T20:07:53.056466+0000","last_clean":"2023-10-16T20:07:53.056466+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:53.056466+0000","last_undegraded":"2023-10-16T20:07:53.056466+0000","last_fullsized":"2023-10-16T20:07:53.056466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:17.552698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023330+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:07:54.023330+0000","last_peered":"2023-10-16T20:07:54.023330+0000","last_clean":"2023-10-16T20:07:54.023330+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:07:54.023330+0000","last_undegraded":"2023-10-16T20:07:54.023330+0000","last_fullsized":"2023-10-16T20:07:54.023330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:50:53.891138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962423+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.962423+0000","last_peered":"2023-10-16T20:07:53.962423+0000","last_clean":"2023-10-16T20:07:53.962423+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.962423+0000","last_undegraded":"2023-10-16T20:07:53.962423+0000","last_fullsized":"2023-10-16T20:07:53.962423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269292+0000","last_change":"2023-10-16T20:07:53.031450+0000","last_active":"2023-10-16T20:07:54.269292+0000","last_peered":"2023-10-16T20:07:54.269292+0000","last_clean":"2023-10-16T20:07:54.269292+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:07:54.269292+0000","last_undegraded":"2023-10-16T20:07:54.269292+0000","last_fullsized":"2023-10-16T20:07:54.269292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962521+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.962521+0000","last_peered":"2023-10-16T20:07:53.962521+0000","last_clean":"2023-10-16T20:07:53.962521+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.962521+0000","last_undegraded":"2023-10-16T20:07:53.962521+0000","last_fullsized":"2023-10-16T20:07:53.962521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103297+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:54.103297+0000","last_peered":"2023-10-16T20:07:54.103297+0000","last_clean":"2023-10-16T20:07:54.103297+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:54.103297+0000","last_undegraded":"2023-10-16T20:07:54.103297+0000","last_fullsized":"2023-10-16T20:07:54.103297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964077+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.964077+0000","last_peered":"2023-10-16T20:07:53.964077+0000","last_clean":"2023-10-16T20:07:53.964077+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.964077+0000","last_undegraded":"2023-10-16T20:07:53.964077+0000","last_fullsized":"2023-10-16T20:07:53.964077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025136+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:54.025136+0000","last_peered":"2023-10-16T20:07:54.025136+0000","last_clean":"2023-10-16T20:07:54.025136+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:54.025136+0000","last_undegraded":"2023-10-16T20:07:54.025136+0000","last_fullsized":"2023-10-16T20:07:54.025136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026238+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:53.026238+0000","last_peered":"2023-10-16T20:07:53.026238+0000","last_clean":"2023-10-16T20:07:53.026238+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:53.026238+0000","last_undegraded":"2023-10-16T20:07:53.026238+0000","last_fullsized":"2023-10-16T20:07:53.026238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.960835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023237+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:07:54.023237+0000","last_peered":"2023-10-16T20:07:54.023237+0000","last_clean":"2023-10-16T20:07:54.023237+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:07:54.023237+0000","last_undegraded":"2023-10-16T20:07:54.023237+0000","last_fullsized":"2023-10-16T20:07:54.023237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:10.581126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962309+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.962309+0000","last_peered":"2023-10-16T20:07:53.962309+0000","last_clean":"2023-10-16T20:07:53.962309+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.962309+0000","last_undegraded":"2023-10-16T20:07:53.962309+0000","last_fullsized":"2023-10-16T20:07:53.962309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101256+0000","last_change":"2023-10-16T20:07:53.038082+0000","last_active":"2023-10-16T20:07:54.101256+0000","last_peered":"2023-10-16T20:07:54.101256+0000","last_clean":"2023-10-16T20:07:54.101256+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:07:54.101256+0000","last_undegraded":"2023-10-16T20:07:54.101256+0000","last_fullsized":"2023-10-16T20:07:54.101256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:06.955879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022694+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:53.022694+0000","last_peered":"2023-10-16T20:07:53.022694+0000","last_clean":"2023-10-16T20:07:53.022694+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:53.022694+0000","last_undegraded":"2023-10-16T20:07:53.022694+0000","last_fullsized":"2023-10-16T20:07:53.022694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:26.475876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269796+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:54.269796+0000","last_peered":"2023-10-16T20:07:54.269796+0000","last_clean":"2023-10-16T20:07:54.269796+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:54.269796+0000","last_undegraded":"2023-10-16T20:07:54.269796+0000","last_fullsized":"2023-10-16T20:07:54.269796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962629+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.962629+0000","last_peered":"2023-10-16T20:07:53.962629+0000","last_clean":"2023-10-16T20:07:53.962629+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.962629+0000","last_undegraded":"2023-10-16T20:07:53.962629+0000","last_fullsized":"2023-10-16T20:07:53.962629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269544+0000","last_change":"2023-10-16T20:07:53.048262+0000","last_active":"2023-10-16T20:07:54.269544+0000","last_peered":"2023-10-16T20:07:54.269544+0000","last_clean":"2023-10-16T20:07:54.269544+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:07:54.269544+0000","last_undegraded":"2023-10-16T20:07:54.269544+0000","last_fullsized":"2023-10-16T20:07:54.269544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962580+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.962580+0000","last_peered":"2023-10-16T20:07:53.962580+0000","last_clean":"2023-10-16T20:07:53.962580+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.962580+0000","last_undegraded":"2023-10-16T20:07:53.962580+0000","last_fullsized":"2023-10-16T20:07:53.962580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025162+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:54.025162+0000","last_peered":"2023-10-16T20:07:54.025162+0000","last_clean":"2023-10-16T20:07:54.025162+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:54.025162+0000","last_undegraded":"2023-10-16T20:07:54.025162+0000","last_fullsized":"2023-10-16T20:07:54.025162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061493+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:53.061493+0000","last_peered":"2023-10-16T20:07:53.061493+0000","last_clean":"2023-10-16T20:07:53.061493+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:53.061493+0000","last_undegraded":"2023-10-16T20:07:53.061493+0000","last_fullsized":"2023-10-16T20:07:53.061493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:54.643651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269104+0000","last_change":"2023-10-16T20:07:53.048961+0000","last_active":"2023-10-16T20:07:54.269104+0000","last_peered":"2023-10-16T20:07:54.269104+0000","last_clean":"2023-10-16T20:07:54.269104+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:07:54.269104+0000","last_undegraded":"2023-10-16T20:07:54.269104+0000","last_fullsized":"2023-10-16T20:07:54.269104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:58.965748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048654+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:53.048654+0000","last_peered":"2023-10-16T20:07:53.048654+0000","last_clean":"2023-10-16T20:07:53.048654+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:53.048654+0000","last_undegraded":"2023-10-16T20:07:53.048654+0000","last_fullsized":"2023-10-16T20:07:53.048654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:19.484561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023303+0000","last_change":"2023-10-16T20:07:53.031630+0000","last_active":"2023-10-16T20:07:54.023303+0000","last_peered":"2023-10-16T20:07:54.023303+0000","last_clean":"2023-10-16T20:07:54.023303+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:07:54.023303+0000","last_undegraded":"2023-10-16T20:07:54.023303+0000","last_fullsized":"2023-10-16T20:07:54.023303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:19.312981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.025675+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:53.025675+0000","last_peered":"2023-10-16T20:07:53.025675+0000","last_clean":"2023-10-16T20:07:53.025675+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:53.025675+0000","last_undegraded":"2023-10-16T20:07:53.025675+0000","last_fullsized":"2023-10-16T20:07:53.025675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269686+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:54.269686+0000","last_peered":"2023-10-16T20:07:54.269686+0000","last_clean":"2023-10-16T20:07:54.269686+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:54.269686+0000","last_undegraded":"2023-10-16T20:07:54.269686+0000","last_fullsized":"2023-10-16T20:07:54.269686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:07.194764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963564+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.963564+0000","last_peered":"2023-10-16T20:07:53.963564+0000","last_clean":"2023-10-16T20:07:53.963564+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.963564+0000","last_undegraded":"2023-10-16T20:07:53.963564+0000","last_fullsized":"2023-10-16T20:07:53.963564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023252+0000","last_change":"2023-10-16T20:07:53.029968+0000","last_active":"2023-10-16T20:07:54.023252+0000","last_peered":"2023-10-16T20:07:54.023252+0000","last_clean":"2023-10-16T20:07:54.023252+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:07:54.023252+0000","last_undegraded":"2023-10-16T20:07:54.023252+0000","last_fullsized":"2023-10-16T20:07:54.023252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:25.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963991+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.963991+0000","last_peered":"2023-10-16T20:07:53.963991+0000","last_clean":"2023-10-16T20:07:53.963991+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.963991+0000","last_undegraded":"2023-10-16T20:07:53.963991+0000","last_fullsized":"2023-10-16T20:07:53.963991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023028+0000","last_change":"2023-10-16T20:07:53.037655+0000","last_active":"2023-10-16T20:07:54.023028+0000","last_peered":"2023-10-16T20:07:54.023028+0000","last_clean":"2023-10-16T20:07:54.023028+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:07:54.023028+0000","last_undegraded":"2023-10-16T20:07:54.023028+0000","last_fullsized":"2023-10-16T20:07:54.023028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:13.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962674+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.962674+0000","last_peered":"2023-10-16T20:07:53.962674+0000","last_clean":"2023-10-16T20:07:53.962674+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.962674+0000","last_undegraded":"2023-10-16T20:07:53.962674+0000","last_fullsized":"2023-10-16T20:07:53.962674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103796+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:54.103796+0000","last_peered":"2023-10-16T20:07:54.103796+0000","last_clean":"2023-10-16T20:07:54.103796+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:54.103796+0000","last_undegraded":"2023-10-16T20:07:54.103796+0000","last_fullsized":"2023-10-16T20:07:54.103796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:53.656150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962461+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.962461+0000","last_peered":"2023-10-16T20:07:53.962461+0000","last_clean":"2023-10-16T20:07:53.962461+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.962461+0000","last_undegraded":"2023-10-16T20:07:53.962461+0000","last_fullsized":"2023-10-16T20:07:53.962461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025395+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:54.025395+0000","last_peered":"2023-10-16T20:07:54.025395+0000","last_clean":"2023-10-16T20:07:54.025395+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:54.025395+0000","last_undegraded":"2023-10-16T20:07:54.025395+0000","last_fullsized":"2023-10-16T20:07:54.025395+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061109+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:53.061109+0000","last_peered":"2023-10-16T20:07:53.061109+0000","last_clean":"2023-10-16T20:07:53.061109+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:53.061109+0000","last_undegraded":"2023-10-16T20:07:53.061109+0000","last_fullsized":"2023-10-16T20:07:53.061109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101320+0000","last_change":"2023-10-16T20:07:53.039457+0000","last_active":"2023-10-16T20:07:54.101320+0000","last_peered":"2023-10-16T20:07:54.101320+0000","last_clean":"2023-10-16T20:07:54.101320+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:07:54.101320+0000","last_undegraded":"2023-10-16T20:07:54.101320+0000","last_fullsized":"2023-10-16T20:07:54.101320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:35.056763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026529+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:53.026529+0000","last_peered":"2023-10-16T20:07:53.026529+0000","last_clean":"2023-10-16T20:07:53.026529+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:53.026529+0000","last_undegraded":"2023-10-16T20:07:53.026529+0000","last_fullsized":"2023-10-16T20:07:53.026529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:03.961940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269527+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:54.269527+0000","last_peered":"2023-10-16T20:07:54.269527+0000","last_clean":"2023-10-16T20:07:54.269527+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:54.269527+0000","last_undegraded":"2023-10-16T20:07:54.269527+0000","last_fullsized":"2023-10-16T20:07:54.269527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:11.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051159+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:53.051159+0000","last_peered":"2023-10-16T20:07:53.051159+0000","last_clean":"2023-10-16T20:07:53.051159+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:53.051159+0000","last_undegraded":"2023-10-16T20:07:53.051159+0000","last_fullsized":"2023-10-16T20:07:53.051159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:21.527524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269159+0000","last_change":"2023-10-16T20:07:53.048171+0000","last_active":"2023-10-16T20:07:54.269159+0000","last_peered":"2023-10-16T20:07:54.269159+0000","last_clean":"2023-10-16T20:07:54.269159+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:07:54.269159+0000","last_undegraded":"2023-10-16T20:07:54.269159+0000","last_fullsized":"2023-10-16T20:07:54.269159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:04.966853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027784+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:53.027784+0000","last_peered":"2023-10-16T20:07:53.027784+0000","last_clean":"2023-10-16T20:07:53.027784+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:53.027784+0000","last_undegraded":"2023-10-16T20:07:53.027784+0000","last_fullsized":"2023-10-16T20:07:53.027784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:53.685902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103386+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:54.103386+0000","last_peered":"2023-10-16T20:07:54.103386+0000","last_clean":"2023-10-16T20:07:54.103386+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:54.103386+0000","last_undegraded":"2023-10-16T20:07:54.103386+0000","last_fullsized":"2023-10-16T20:07:54.103386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964052+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.964052+0000","last_peered":"2023-10-16T20:07:53.964052+0000","last_clean":"2023-10-16T20:07:53.964052+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.964052+0000","last_undegraded":"2023-10-16T20:07:53.964052+0000","last_fullsized":"2023-10-16T20:07:53.964052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023079+0000","last_change":"2023-10-16T20:07:53.051277+0000","last_active":"2023-10-16T20:07:54.023079+0000","last_peered":"2023-10-16T20:07:54.023079+0000","last_clean":"2023-10-16T20:07:54.023079+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:07:54.023079+0000","last_undegraded":"2023-10-16T20:07:54.023079+0000","last_fullsized":"2023-10-16T20:07:54.023079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:09.587579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.028961+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:53.028961+0000","last_peered":"2023-10-16T20:07:53.028961+0000","last_clean":"2023-10-16T20:07:53.028961+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:53.028961+0000","last_undegraded":"2023-10-16T20:07:53.028961+0000","last_fullsized":"2023-10-16T20:07:53.028961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:42.884671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269491+0000","last_change":"2023-10-16T20:07:53.042042+0000","last_active":"2023-10-16T20:07:54.269491+0000","last_peered":"2023-10-16T20:07:54.269491+0000","last_clean":"2023-10-16T20:07:54.269491+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:07:54.269491+0000","last_undegraded":"2023-10-16T20:07:54.269491+0000","last_fullsized":"2023-10-16T20:07:54.269491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962687+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.962687+0000","last_peered":"2023-10-16T20:07:53.962687+0000","last_clean":"2023-10-16T20:07:53.962687+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.962687+0000","last_undegraded":"2023-10-16T20:07:53.962687+0000","last_fullsized":"2023-10-16T20:07:53.962687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269825+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:54.269825+0000","last_peered":"2023-10-16T20:07:54.269825+0000","last_clean":"2023-10-16T20:07:54.269825+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:54.269825+0000","last_undegraded":"2023-10-16T20:07:54.269825+0000","last_fullsized":"2023-10-16T20:07:54.269825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101285+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:54.101285+0000","last_peered":"2023-10-16T20:07:54.101285+0000","last_clean":"2023-10-16T20:07:54.101285+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:54.101285+0000","last_undegraded":"2023-10-16T20:07:54.101285+0000","last_fullsized":"2023-10-16T20:07:54.101285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:19.786064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023295+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:07:54.023295+0000","last_peered":"2023-10-16T20:07:54.023295+0000","last_clean":"2023-10-16T20:07:54.023295+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:07:54.023295+0000","last_undegraded":"2023-10-16T20:07:54.023295+0000","last_fullsized":"2023-10-16T20:07:54.023295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027338+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:53.027338+0000","last_peered":"2023-10-16T20:07:53.027338+0000","last_clean":"2023-10-16T20:07:53.027338+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:53.027338+0000","last_undegraded":"2023-10-16T20:07:53.027338+0000","last_fullsized":"2023-10-16T20:07:53.027338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269278+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269278+0000","last_peered":"2023-10-16T20:07:54.269278+0000","last_clean":"2023-10-16T20:07:54.269278+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:07:54.269278+0000","last_undegraded":"2023-10-16T20:07:54.269278+0000","last_fullsized":"2023-10-16T20:07:54.269278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027463+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:53.027463+0000","last_peered":"2023-10-16T20:07:53.027463+0000","last_clean":"2023-10-16T20:07:53.027463+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:53.027463+0000","last_undegraded":"2023-10-16T20:07:53.027463+0000","last_fullsized":"2023-10-16T20:07:53.027463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268970+0000","last_change":"2023-10-16T20:07:53.036387+0000","last_active":"2023-10-16T20:07:54.268970+0000","last_peered":"2023-10-16T20:07:54.268970+0000","last_clean":"2023-10-16T20:07:54.268970+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:07:54.268970+0000","last_undegraded":"2023-10-16T20:07:54.268970+0000","last_fullsized":"2023-10-16T20:07:54.268970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963596+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.963596+0000","last_peered":"2023-10-16T20:07:53.963596+0000","last_clean":"2023-10-16T20:07:53.963596+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.963596+0000","last_undegraded":"2023-10-16T20:07:53.963596+0000","last_fullsized":"2023-10-16T20:07:53.963596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025267+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:54.025267+0000","last_peered":"2023-10-16T20:07:54.025267+0000","last_clean":"2023-10-16T20:07:54.025267+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:54.025267+0000","last_undegraded":"2023-10-16T20:07:54.025267+0000","last_fullsized":"2023-10-16T20:07:54.025267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962334+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.962334+0000","last_peered":"2023-10-16T20:07:53.962334+0000","last_clean":"2023-10-16T20:07:53.962334+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.962334+0000","last_undegraded":"2023-10-16T20:07:53.962334+0000","last_fullsized":"2023-10-16T20:07:53.962334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269794+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:54.269794+0000","last_peered":"2023-10-16T20:07:54.269794+0000","last_clean":"2023-10-16T20:07:54.269794+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:54.269794+0000","last_undegraded":"2023-10-16T20:07:54.269794+0000","last_fullsized":"2023-10-16T20:07:54.269794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022176+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:53.022176+0000","last_peered":"2023-10-16T20:07:53.022176+0000","last_clean":"2023-10-16T20:07:53.022176+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:53.022176+0000","last_undegraded":"2023-10-16T20:07:53.022176+0000","last_fullsized":"2023-10-16T20:07:53.022176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103809+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:54.103809+0000","last_peered":"2023-10-16T20:07:54.103809+0000","last_clean":"2023-10-16T20:07:54.103809+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:54.103809+0000","last_undegraded":"2023-10-16T20:07:54.103809+0000","last_fullsized":"2023-10-16T20:07:54.103809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:22.531060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964119+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.964119+0000","last_peered":"2023-10-16T20:07:53.964119+0000","last_clean":"2023-10-16T20:07:53.964119+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.964119+0000","last_undegraded":"2023-10-16T20:07:53.964119+0000","last_fullsized":"2023-10-16T20:07:53.964119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039606+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:53.039606+0000","last_peered":"2023-10-16T20:07:53.039606+0000","last_clean":"2023-10-16T20:07:53.039606+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:53.039606+0000","last_undegraded":"2023-10-16T20:07:53.039606+0000","last_fullsized":"2023-10-16T20:07:53.039606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":793337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.505}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.622}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.69399999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":201869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.40999999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44800000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.502}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55000000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.317}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.34100000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.33100000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55400000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.496},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51800000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.505}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.437},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.749}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.66900000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.312}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.32900000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60199999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52400000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.374},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.313},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33100000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50600000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47899999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57999999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.625},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.753}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.83699999999999997}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.88500000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.374},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.627}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:06.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T20:08:06.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.774+0000 7f382deab700 1 Processor -- start 2023-10-16T20:08:06.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.774+0000 7f382deab700 1 -- start start 2023-10-16T20:08:06.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f382deab700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 0x7f38280cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f382deab700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f38280ca7d0 0x7f3828071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f382deab700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38280cfeb0 con 0x7f382815e7f0 2023-10-16T20:08:06.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f382deab700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38280ce410 con 0x7f38280ca7d0 2023-10-16T20:08:06.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f382deab700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382815ec70 con 0x7f382806a820 2023-10-16T20:08:06.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f3826ffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f382815e7f0 0x7f382806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41320/0 (socket says 172.21.15.152:41320) 2023-10-16T20:08:06.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.775+0000 7f3826ffd700 1 -- 172.21.15.152:0/3154094336 learned_addr learned my addr 172.21.15.152:0/3154094336 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:06.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3827fff700 1 --2- 172.21.15.152:0/3154094336 >> v2:172.21.15.163:3300/0 conn(0x7f38280ca7d0 0x7f3828071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415197929 0 0) 0x7f38280cfeb0 con 0x7f382815e7f0 2023-10-16T20:08:06.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38277fe700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 0x7f38280cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38100035b0 con 0x7f382815e7f0 2023-10-16T20:08:06.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3252009182 0 0) 0x7f38100035b0 con 0x7f382815e7f0 2023-10-16T20:08:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 msgr2=0x7f38280cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 0x7f38280cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 >> v2:172.21.15.163:3300/0 conn(0x7f38280ca7d0 msgr2=0x7f3828071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:06.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 --2- 172.21.15.152:0/3154094336 >> v2:172.21.15.163:3300/0 conn(0x7f38280ca7d0 0x7f3828071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280af9d0 con 0x7f382815e7f0 2023-10-16T20:08:06.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f3818001670 con 0x7f382815e7f0 2023-10-16T20:08:06.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 >> v1:172.21.15.152:6789/0 conn(0x7f382815e7f0 legacy=0x7f382806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 0x7f3810003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3810003f80 0x7f3810004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3810004d90 0x7f3810005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280ce410 con 0x7f3810003f80 2023-10-16T20:08:06.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382815ec70 con 0x7f3810004d90 2023-10-16T20:08:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381000ba60 con 0x7f382806a820 2023-10-16T20:08:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3826ffd700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3810003f80 0x7f3810004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f38277fe700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 0x7f3810003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3827fff700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3810004d90 0x7f3810005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3826ffd700 1 -- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 msgr2=0x7f3810003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:06.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3826ffd700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f382806a820 0x7f3810003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3826ffd700 1 -- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3810004d90 msgr2=0x7f3810005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:06.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3826ffd700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3810004d90 0x7f3810005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.776+0000 7f3826ffd700 1 -- 172.21.15.152:0/3154094336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100035b0 con 0x7f3810003f80 2023-10-16T20:08:06.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f3826ffd700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3810003f80 0x7f3810004850 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f381800c350 tx=0x7f3810005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4442a7b7da0df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800ce50 con 0x7f3810003f80 2023-10-16T20:08:06.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818005960 con 0x7f3810003f80 2023-10-16T20:08:06.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f38267fc700 1 -- 172.21.15.152:0/3154094336 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818005d10 con 0x7f3810003f80 2023-10-16T20:08:06.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f382deab700 1 -- 172.21.15.152:0/3154094336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3810003f80 msgr2=0x7f3810004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f382deab700 1 --2- 172.21.15.152:0/3154094336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3810003f80 0x7f3810004850 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f381800c350 tx=0x7f3810005880 comp rx=0 tx=0).stop 2023-10-16T20:08:06.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f3827fff700 1 -- 172.21.15.152:0/3154094336 reap_dead start 2023-10-16T20:08:06.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f382deab700 1 -- 172.21.15.152:0/3154094336 shutdown_connections 2023-10-16T20:08:06.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f382deab700 1 -- 172.21.15.152:0/3154094336 >> 172.21.15.152:0/3154094336 conn(0x7f38280d0180 msgr2=0x7f38280d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:06.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f382deab700 1 -- 172.21.15.152:0/3154094336 shutdown_connections 2023-10-16T20:08:06.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.777+0000 7f382deab700 1 -- 172.21.15.152:0/3154094336 wait complete. 2023-10-16T20:08:06.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.778+0000 7f382deab700 1 Processor -- start 2023-10-16T20:08:06.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 -- start start 2023-10-16T20:08:06.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3810003f80 0x7f38281f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38280b0e00 0x7f382806d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 0x7f38281f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38281f6cc0 con 0x7f38280c3c90 2023-10-16T20:08:06.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38281f6fa0 con 0x7f38280b0e00 2023-10-16T20:08:06.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f382deab700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38281f7280 con 0x7f3810003f80 2023-10-16T20:08:06.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f3827fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 0x7f38281f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f3827fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 0x7f38281f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32906/0 (socket says 172.21.15.152:32906) 2023-10-16T20:08:06.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.779+0000 7f3827fff700 1 -- 172.21.15.152:0/1546174115 learned_addr learned my addr 172.21.15.152:0/1546174115 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:06.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3826ffd700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38280b0e00 0x7f382806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f38277fe700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3810003f80 0x7f38281f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3827fff700 1 -- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3810003f80 msgr2=0x7f38281f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3827fff700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3810003f80 0x7f38281f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3827fff700 1 -- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38280b0e00 msgr2=0x7f382806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3827fff700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38280b0e00 0x7f382806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3827fff700 1 -- 172.21.15.152:0/1546174115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38281f7560 con 0x7f38280c3c90 2023-10-16T20:08:06.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f3827fff700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 0x7f38281f36b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f38280d00e0 tx=0x7f3820011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000e040 con 0x7f38280c3c90 2023-10-16T20:08:06.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382000f040 con 0x7f38280c3c90 2023-10-16T20:08:06.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38281f3190 con 0x7f38280c3c90 2023-10-16T20:08:06.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000fdb0 con 0x7f38280c3c90 2023-10-16T20:08:06.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.780+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382806da90 con 0x7f38280c3c90 2023-10-16T20:08:06.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.781+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382806dcb0 con 0x7f38280c3c90 2023-10-16T20:08:06.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.781+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3820022460 con 0x7f38280c3c90 2023-10-16T20:08:06.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.782+0000 7f380ffff700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f381406af00 0x7f381406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:06.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.782+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3820089de0 con 0x7f38280c3c90 2023-10-16T20:08:06.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.782+0000 7f38277fe700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f381406af00 0x7f381406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:06.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.782+0000 7f38277fe700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f381406af00 0x7f381406d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3828160fa0 tx=0x7f381c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:06.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.786+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3820054d30 con 0x7f38280c3c90 2023-10-16T20:08:06.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.979+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f382804ebb0 con 0x7f38280c3c90 2023-10-16T20:08:06.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.980+0000 7f380ffff700 1 -- 172.21.15.152:0/1546174115 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16830 (secure 0 0 0) 0x7f3820058350 con 0x7f38280c3c90 2023-10-16T20:08:06.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:06.983 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":41,"fsid":"e602e5ee-bf17-44e1-9fbf-0f448134fb28","created":"2023-10-16T20:06:07.112617+0000","modified":"2023-10-16T20:07:54.019774+0000","last_up_change":"2023-10-16T20:06:18.232563+0000","last_in_change":"2023-10-16T20:06:09.637796+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T20:06:18.806968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-16T20:07:50.358578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-16T20:07:51.386644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7ce383b-acb4-41b6-99c9-7e61339ea9a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6809","nonce":648653376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6811","nonce":648653376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6815","nonce":648653376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":648653376},{"type":"v1","addr":"172.21.15.152:6813","nonce":648653376}]},"public_addr":"172.21.15.152:6809/648653376","cluster_addr":"172.21.15.152:6811/648653376","heartbeat_back_addr":"172.21.15.152:6815/648653376","heartbeat_front_addr":"172.21.15.152:6813/648653376","state":["exists","up"]},{"osd":1,"uuid":"e4c825dd-51d9-4873-9de3-79aa63c86211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6818","nonce":3247585045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6822","nonce":3247585045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6830","nonce":3247585045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3247585045},{"type":"v1","addr":"172.21.15.152:6826","nonce":3247585045}]},"public_addr":"172.21.15.152:6818/3247585045","cluster_addr":"172.21.15.152:6822/3247585045","heartbeat_back_addr":"172.21.15.152:6830/3247585045","heartbeat_front_addr":"172.21.15.152:6826/3247585045","state":["exists","up"]},{"osd":2,"uuid":"13f9db58-f545-4780-9174-8784d4a7df2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6801","nonce":4291228321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6803","nonce":4291228321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6807","nonce":4291228321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4291228321},{"type":"v1","addr":"172.21.15.152:6805","nonce":4291228321}]},"public_addr":"172.21.15.152:6801/4291228321","cluster_addr":"172.21.15.152:6803/4291228321","heartbeat_back_addr":"172.21.15.152:6807/4291228321","heartbeat_front_addr":"172.21.15.152:6805/4291228321","state":["exists","up"]},{"osd":3,"uuid":"04a7fc4a-a60f-4072-8699-30abcad52642","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6819","nonce":2264394599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6823","nonce":2264394599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6829","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6831","nonce":2264394599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6825","nonce":2264394599},{"type":"v1","addr":"172.21.15.152:6827","nonce":2264394599}]},"public_addr":"172.21.15.152:6819/2264394599","cluster_addr":"172.21.15.152:6823/2264394599","heartbeat_back_addr":"172.21.15.152:6831/2264394599","heartbeat_front_addr":"172.21.15.152:6827/2264394599","state":["exists","up"]},{"osd":4,"uuid":"3c1c90aa-09ab-4ea3-8709-5134d14820b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6817","nonce":1994135539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6819","nonce":1994135539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6823","nonce":1994135539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1994135539},{"type":"v1","addr":"172.21.15.163:6821","nonce":1994135539}]},"public_addr":"172.21.15.163:6817/1994135539","cluster_addr":"172.21.15.163:6819/1994135539","heartbeat_back_addr":"172.21.15.163:6823/1994135539","heartbeat_front_addr":"172.21.15.163:6821/1994135539","state":["exists","up"]},{"osd":5,"uuid":"618eed1e-d3d2-43e9-b08d-5d9bc04029e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6809","nonce":792269555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6811","nonce":792269555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6815","nonce":792269555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":792269555},{"type":"v1","addr":"172.21.15.163:6813","nonce":792269555}]},"public_addr":"172.21.15.163:6809/792269555","cluster_addr":"172.21.15.163:6811/792269555","heartbeat_back_addr":"172.21.15.163:6815/792269555","heartbeat_front_addr":"172.21.15.163:6813/792269555","state":["exists","up"]},{"osd":6,"uuid":"f422d86a-0a3f-4f59-91d8-7c13f445e05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6801","nonce":2738585885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6803","nonce":2738585885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6807","nonce":2738585885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":2738585885},{"type":"v1","addr":"172.21.15.163:6805","nonce":2738585885}]},"public_addr":"172.21.15.163:6801/2738585885","cluster_addr":"172.21.15.163:6803/2738585885","heartbeat_back_addr":"172.21.15.163:6807/2738585885","heartbeat_front_addr":"172.21.15.163:6805/2738585885","state":["exists","up"]},{"osd":7,"uuid":"c8c2cce4-4ee2-4f49-a749-43e4b532c528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6825","nonce":3318028264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6827","nonce":3318028264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6831","nonce":3318028264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3318028264},{"type":"v1","addr":"172.21.15.163:6829","nonce":3318028264}]},"public_addr":"172.21.15.163:6825/3318028264","cluster_addr":"172.21.15.163:6827/3318028264","heartbeat_back_addr":"172.21.15.163:6831/3318028264","heartbeat_front_addr":"172.21.15.163:6829/3318028264","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.785473+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:16.900106+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.818054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.512333+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.811554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.859870+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.802902+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T20:06:14.887739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T20:08:06.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f381406af00 msgr2=0x7f381406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f381406af00 0x7f381406d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3828160fa0 tx=0x7f381c008040 comp rx=0 tx=0).stop 2023-10-16T20:08:06.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 msgr2=0x7f38281f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:06.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 0x7f38281f36b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f38280d00e0 tx=0x7f3820011f80 comp rx=0 tx=0).stop 2023-10-16T20:08:06.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 shutdown_connections 2023-10-16T20:08:06.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f381406af00 0x7f381406d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3810003f80 0x7f38281f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38280c3c90 0x7f38281f36b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 --2- 172.21.15.152:0/1546174115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38280b0e00 0x7f382806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:06.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 >> 172.21.15.152:0/1546174115 conn(0x7f38280d0180 msgr2=0x7f38280cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:06.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 shutdown_connections 2023-10-16T20:08:06.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:06.982+0000 7f382deab700 1 -- 172.21.15.152:0/1546174115 wait complete. 2023-10-16T20:08:07.998 INFO:tasks.ceph:Scrubbing osd.0 2023-10-16T20:08:07.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:08.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.137+0000 7f3422e9f700 1 Processor -- start 2023-10-16T20:08:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.137+0000 7f3422e9f700 1 -- start start 2023-10-16T20:08:08.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f3422e9f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f341c0ce440 0x7f341c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f3422e9f700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c161360 con 0x7f341c06b370 2023-10-16T20:08:08.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f3422e9f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c06b750 con 0x7f341c06a820 2023-10-16T20:08:08.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f3422e9f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c06dcc0 con 0x7f341c0ce440 2023-10-16T20:08:08.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f3420c3b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f341c06b370 0x7f341c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41340/0 (socket says 172.21.15.152:41340) 2023-10-16T20:08:08.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f3420c3b700 1 -- 172.21.15.152:0/803556733 learned_addr learned my addr 172.21.15.152:0/803556733 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:08.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764448657 0 0) 0x7f341c161360 con 0x7f341c06b370 2023-10-16T20:08:08.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f340c0035b0 con 0x7f341c06b370 2023-10-16T20:08:08.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f342143c700 1 --2- 172.21.15.152:0/803556733 >> v2:172.21.15.163:3300/0 conn(0x7f341c0ce440 0x7f341c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641971235 0 0) 0x7f341c06b750 con 0x7f341c06a820 2023-10-16T20:08:08.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f341c161360 con 0x7f341c06a820 2023-10-16T20:08:08.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945958431 0 0) 0x7f340c0035b0 con 0x7f341c06b370 2023-10-16T20:08:08.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.138+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 >> v2:172.21.15.163:3300/0 conn(0x7f341c0ce440 msgr2=0x7f341c15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:08.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 --2- 172.21.15.152:0/803556733 >> v2:172.21.15.163:3300/0 conn(0x7f341c0ce440 0x7f341c15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 >> v1:172.21.15.163:6789/0 conn(0x7f341c06a820 legacy=0x7f341c0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c15e300 con 0x7f341c06b370 2023-10-16T20:08:08.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f3410001670 con 0x7f341c06b370 2023-10-16T20:08:08.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 >> v1:172.21.15.152:6789/0 conn(0x7f341c06b370 legacy=0x7f341c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f340c003bc0 0x7f340c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f340c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f340c005210 0x7f340c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c06dcc0 con 0x7f340c004850 2023-10-16T20:08:08.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00c0b0 con 0x7f340c005210 2023-10-16T20:08:08.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00c270 con 0x7f340c003bc0 2023-10-16T20:08:08.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f340c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f3420c3b700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f340c003bc0 0x7f340c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f342143c700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f340c005210 0x7f340c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 -- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f340c003bc0 msgr2=0x7f340c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:08.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f340c003bc0 0x7f340c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 -- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f340c005210 msgr2=0x7f340c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:08.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f340c005210 0x7f340c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 -- 172.21.15.152:0/803556733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0035b0 con 0x7f340c004850 2023-10-16T20:08:08.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f3420c3b700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f340c003bc0 0x7f340c003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:08.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f342143c700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f340c005210 0x7f340c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f342143c700 1 -- 172.21.15.152:0/803556733 reap_dead start 2023-10-16T20:08:08.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341bfff700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f340c004cd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f341c06a1b0 tx=0x7f340c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f505d4becfaa6ce server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408001430 con 0x7f340c004850 2023-10-16T20:08:08.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080052d0 con 0x7f340c004850 2023-10-16T20:08:08.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.139+0000 7f341b7fe700 1 -- 172.21.15.152:0/803556733 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408001d40 con 0x7f340c004850 2023-10-16T20:08:08.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 -- 172.21.15.152:0/803556733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 msgr2=0x7f340c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f340c004cd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f341c06a1b0 tx=0x7f340c005880 comp rx=0 tx=0).stop 2023-10-16T20:08:08.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 -- 172.21.15.152:0/803556733 shutdown_connections 2023-10-16T20:08:08.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 --2- 172.21.15.152:0/803556733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f340c004cd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 -- 172.21.15.152:0/803556733 >> 172.21.15.152:0/803556733 conn(0x7f341c0ccbe0 msgr2=0x7f341c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 -- 172.21.15.152:0/803556733 shutdown_connections 2023-10-16T20:08:08.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.140+0000 7f3422e9f700 1 -- 172.21.15.152:0/803556733 wait complete. 2023-10-16T20:08:08.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.141+0000 7f3422e9f700 1 Processor -- start 2023-10-16T20:08:08.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.141+0000 7f3422e9f700 1 -- start start 2023-10-16T20:08:08.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3422e9f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f341c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3422e9f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f341c0ad5f0 0x7f341c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3422e9f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f341c0aea30 0x7f341c155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3422e9f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0ad1d0 con 0x7f340c004850 2023-10-16T20:08:08.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3422e9f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0ac8c0 con 0x7f341c0aea30 2023-10-16T20:08:08.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3422e9f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0aef70 con 0x7f341c0ad5f0 2023-10-16T20:08:08.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f341c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f341c15f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32922/0 (socket says 172.21.15.152:32922) 2023-10-16T20:08:08.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 -- 172.21.15.152:0/1206840238 learned_addr learned my addr 172.21.15.152:0/1206840238 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:08.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f342143c700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f341c0aea30 0x7f341c155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f341bfff700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f341c0ad5f0 0x7f341c0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 -- 172.21.15.152:0/1206840238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f341c0ad5f0 msgr2=0x7f341c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f341c0ad5f0 0x7f341c0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 -- 172.21.15.152:0/1206840238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f341c0aea30 msgr2=0x7f341c155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f341c0aea30 0x7f341c155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.142+0000 7f3420c3b700 1 -- 172.21.15.152:0/1206840238 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0acb10 con 0x7f340c004850 2023-10-16T20:08:08.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.143+0000 7f3420c3b700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f341c15f4e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f341000eaf0 tx=0x7f341000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.143+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410005e00 con 0x7f340c004850 2023-10-16T20:08:08.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.143+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341000c5d0 con 0x7f340c004850 2023-10-16T20:08:08.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.143+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c0acdf0 con 0x7f340c004850 2023-10-16T20:08:08.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.143+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000c980 con 0x7f340c004850 2023-10-16T20:08:08.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.143+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c15fa20 con 0x7f340c004850 2023-10-16T20:08:08.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.144+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f341c15e8c0 con 0x7f340c004850 2023-10-16T20:08:08.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.144+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f341000cae0 con 0x7f340c004850 2023-10-16T20:08:08.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.144+0000 7f34197fa700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f340006af30 0x7f340006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f34100894f0 con 0x7f340c004850 2023-10-16T20:08:08.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f341bfff700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f340006af30 0x7f340006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f34197fa700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f34000736c0 0x7f3400075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 --> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3400076210 con 0x7f34000736c0 2023-10-16T20:08:08.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f341008bad0 con 0x7f340c004850 2023-10-16T20:08:08.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f342143c700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f34000736c0 0x7f3400075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f341bfff700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f340006af30 0x7f340006d3f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3408000c00 tx=0x7f340800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.145+0000 7f342143c700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f34000736c0 0x7f3400075b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.146+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== osd.0 v2:172.21.15.152:6808/648653376 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3400076210 con 0x7f34000736c0 2023-10-16T20:08:08.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.160+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 --> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f341c15e5e0 con 0x7f34000736c0 2023-10-16T20:08:08.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f34197fa700 1 -- 172.21.15.152:0/1206840238 <== osd.0 v2:172.21.15.152:6808/648653376 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f341400f040 con 0x7f34000736c0 2023-10-16T20:08:08.181 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:08.181 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:08.182 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:08.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f34000736c0 msgr2=0x7f3400075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6808/648653376,v1:172.21.15.152:6809/648653376] conn(0x7f34000736c0 0x7f3400075b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f340006af30 msgr2=0x7f340006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f340006af30 0x7f340006d3f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3408000c00 tx=0x7f340800a000 comp rx=0 tx=0).stop 2023-10-16T20:08:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 msgr2=0x7f341c15f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 --2- 172.21.15.152:0/1206840238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f340c004850 0x7f341c15f4e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f341000eaf0 tx=0x7f341000ee00 comp rx=0 tx=0).stop 2023-10-16T20:08:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f342143c700 1 -- 172.21.15.152:0/1206840238 reap_dead start 2023-10-16T20:08:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 shutdown_connections 2023-10-16T20:08:08.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 >> 172.21.15.152:0/1206840238 conn(0x7f341c0ccbe0 msgr2=0x7f341c0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 shutdown_connections 2023-10-16T20:08:08.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.161+0000 7f3422e9f700 1 -- 172.21.15.152:0/1206840238 wait complete. 2023-10-16T20:08:08.187 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-16T20:08:08.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.306+0000 7f489afec700 1 Processor -- start 2023-10-16T20:08:08.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.306+0000 7f489afec700 1 -- start start 2023-10-16T20:08:08.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f489afec700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f489406a820 0x7f48940cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f489afec700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f489415e7f0 0x7f489406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f489afec700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940cfeb0 con 0x7f48940ca7d0 2023-10-16T20:08:08.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f489afec700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48940ce410 con 0x7f489415e7f0 2023-10-16T20:08:08.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f489afec700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489415ec50 con 0x7f489406a820 2023-10-16T20:08:08.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f4893fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f489415e7f0 0x7f489406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f4893fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f489415e7f0 0x7f489406ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32932/0 (socket says 172.21.15.152:32932) 2023-10-16T20:08:08.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f4893fff700 1 -- 172.21.15.152:0/1480211406 learned_addr learned my addr 172.21.15.152:0/1480211406 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:08.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f4899589700 1 --1- 172.21.15.152:0/1480211406 >> v1:172.21.15.152:6789/0 conn(0x7f48940ca7d0 0x7f4894071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41366/0 (socket says 172.21.15.152:41366) 2023-10-16T20:08:08.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.307+0000 7f4898d88700 1 --2- 172.21.15.152:0/1480211406 >> v2:172.21.15.163:3300/0 conn(0x7f489406a820 0x7f48940cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f4893fff700 1 -- 172.21.15.152:0/1480211406 >> v2:172.21.15.163:3300/0 conn(0x7f489406a820 msgr2=0x7f48940cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:08.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f4893fff700 1 --2- 172.21.15.152:0/1480211406 >> v2:172.21.15.163:3300/0 conn(0x7f489406a820 0x7f48940cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f4893fff700 1 -- 172.21.15.152:0/1480211406 >> v1:172.21.15.152:6789/0 conn(0x7f48940ca7d0 legacy=0x7f4894071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f4893fff700 1 -- 172.21.15.152:0/1480211406 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940af9d0 con 0x7f489415e7f0 2023-10-16T20:08:08.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f48937fe700 1 -- 172.21.15.152:0/1480211406 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468011013 0 0) 0x7f48940cfeb0 con 0x7f48940ca7d0 2023-10-16T20:08:08.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f4893fff700 1 --2- 172.21.15.152:0/1480211406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489415e7f0 0x7f489406ac00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4894067df0 tx=0x7f4880009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caec64b19fdf5072 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f48937fe700 1 -- 172.21.15.152:0/1480211406 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011830 con 0x7f489415e7f0 2023-10-16T20:08:08.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f48937fe700 1 -- 172.21.15.152:0/1480211406 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880011990 con 0x7f489415e7f0 2023-10-16T20:08:08.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f48937fe700 1 -- 172.21.15.152:0/1480211406 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011d20 con 0x7f489415e7f0 2023-10-16T20:08:08.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f489afec700 1 -- 172.21.15.152:0/1480211406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489415e7f0 msgr2=0x7f489406ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f489afec700 1 --2- 172.21.15.152:0/1480211406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489415e7f0 0x7f489406ac00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4894067df0 tx=0x7f4880009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f489afec700 1 -- 172.21.15.152:0/1480211406 shutdown_connections 2023-10-16T20:08:08.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f489afec700 1 --2- 172.21.15.152:0/1480211406 >> v2:172.21.15.163:3300/0 conn(0x7f489406a820 0x7f48940cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.308+0000 7f489afec700 1 --2- 172.21.15.152:0/1480211406 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489415e7f0 0x7f489406ac00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.309+0000 7f489afec700 1 -- 172.21.15.152:0/1480211406 >> 172.21.15.152:0/1480211406 conn(0x7f48940d0180 msgr2=0x7f48940d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.309+0000 7f489afec700 1 -- 172.21.15.152:0/1480211406 shutdown_connections 2023-10-16T20:08:08.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.309+0000 7f489afec700 1 -- 172.21.15.152:0/1480211406 wait complete. 2023-10-16T20:08:08.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.310+0000 7f489afec700 1 Processor -- start 2023-10-16T20:08:08.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.310+0000 7f489afec700 1 -- start start 2023-10-16T20:08:08.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 0x7f4894157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48940ca7d0 0x7f489415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f489415e7f0 0x7f4894159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c7480 con 0x7f489406a820 2023-10-16T20:08:08.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489415bae0 con 0x7f48940ca7d0 2023-10-16T20:08:08.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489415bdc0 con 0x7f489415e7f0 2023-10-16T20:08:08.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 0x7f4894157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 0x7f4894157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32938/0 (socket says 172.21.15.152:32938) 2023-10-16T20:08:08.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 -- 172.21.15.152:0/1795688236 learned_addr learned my addr 172.21.15.152:0/1795688236 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:08.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4899589700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f489415e7f0 0x7f4894159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4893fff700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48940ca7d0 0x7f489415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 -- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f489415e7f0 msgr2=0x7f4894159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f489415e7f0 0x7f4894159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 -- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48940ca7d0 msgr2=0x7f489415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48940ca7d0 0x7f489415b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 -- 172.21.15.152:0/1795688236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009550 con 0x7f489406a820 2023-10-16T20:08:08.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f4898d88700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 0x7f4894157690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f488800e9b0 tx=0x7f488800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888009710 con 0x7f489406a820 2023-10-16T20:08:08.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800c850 con 0x7f489406a820 2023-10-16T20:08:08.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489415c0a0 con 0x7f489406a820 2023-10-16T20:08:08.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800cbc0 con 0x7f489406a820 2023-10-16T20:08:08.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.311+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4894072440 con 0x7f489406a820 2023-10-16T20:08:08.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.312+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489404ebb0 con 0x7f489406a820 2023-10-16T20:08:08.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.313+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f488800cd20 con 0x7f489406a820 2023-10-16T20:08:08.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.313+0000 7f48917fa700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f487806af00 0x7f487806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.313+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4888089800 con 0x7f489406a820 2023-10-16T20:08:08.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.313+0000 7f4893fff700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f487806af00 0x7f487806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.314+0000 7f4893fff700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f487806af00 0x7f487806d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4880014040 tx=0x7f4880008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.318+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f48880547e0 con 0x7f489406a820 2023-10-16T20:08:08.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.503+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f48940af410 con 0x7f487806af00 2023-10-16T20:08:08.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.504+0000 7f48917fa700 1 -- 172.21.15.152:0/1795688236 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4880011b00 con 0x7f487806af00 2023-10-16T20:08:08.508 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f487806af00 msgr2=0x7f487806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f487806af00 0x7f487806d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4880014040 tx=0x7f4880008030 comp rx=0 tx=0).stop 2023-10-16T20:08:08.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 msgr2=0x7f4894157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 0x7f4894157690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f488800e9b0 tx=0x7f488800ed70 comp rx=0 tx=0).stop 2023-10-16T20:08:08.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 shutdown_connections 2023-10-16T20:08:08.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f487806af00 0x7f487806d3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f489415e7f0 0x7f4894159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f489406a820 0x7f4894157690 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 --2- 172.21.15.152:0/1795688236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48940ca7d0 0x7f489415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 >> 172.21.15.152:0/1795688236 conn(0x7f48940d0180 msgr2=0x7f4894158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 shutdown_connections 2023-10-16T20:08:08.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.506+0000 7f489afec700 1 -- 172.21.15.152:0/1795688236 wait complete. 2023-10-16T20:08:08.513 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 0 to deep-scrub 2023-10-16T20:08:08.520 INFO:tasks.ceph:Scrubbing osd.1 2023-10-16T20:08:08.520 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:08.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.643+0000 7f66a0cf1700 1 Processor -- start 2023-10-16T20:08:08.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.643+0000 7f66a0cf1700 1 -- start start 2023-10-16T20:08:08.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f66a0cf1700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f669c15d900 0x7f669c0d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f66a0cf1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f669c06f0e0 0x7f669c0ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f66a0cf1700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c06fff0 con 0x7f669c0cad00 2023-10-16T20:08:08.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f66a0cf1700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c15dce0 con 0x7f669c15d900 2023-10-16T20:08:08.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f66a0cf1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c06f560 con 0x7f669c06f0e0 2023-10-16T20:08:08.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f669c15d900 0x7f669c0d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f669c15d900 0x7f669c0d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32946/0 (socket says 172.21.15.152:32946) 2023-10-16T20:08:08.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 -- 172.21.15.152:0/630780630 learned_addr learned my addr 172.21.15.152:0/630780630 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:08.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f6699d9b700 1 --2- 172.21.15.152:0/630780630 >> v2:172.21.15.163:3300/0 conn(0x7f669c06f0e0 0x7f669c0ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 -- 172.21.15.152:0/630780630 >> v2:172.21.15.163:3300/0 conn(0x7f669c06f0e0 msgr2=0x7f669c0ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:08.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 --2- 172.21.15.152:0/630780630 >> v2:172.21.15.163:3300/0 conn(0x7f669c06f0e0 0x7f669c0ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 -- 172.21.15.152:0/630780630 >> v1:172.21.15.163:6789/0 conn(0x7f669c0cad00 legacy=0x7f669c161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 -- 172.21.15.152:0/630780630 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c1614e0 con 0x7f669c15d900 2023-10-16T20:08:08.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f6699d9b700 1 --2- 172.21.15.152:0/630780630 >> v2:172.21.15.163:3300/0 conn(0x7f669c06f0e0 0x7f669c0ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:08.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669a59c700 1 --2- 172.21.15.152:0/630780630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c15d900 0x7f669c0d0c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f669c06ee80 tx=0x7f668c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7e8bdeb22b1096 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669959a700 1 -- 172.21.15.152:0/630780630 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00b870 con 0x7f669c15d900 2023-10-16T20:08:08.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669959a700 1 -- 172.21.15.152:0/630780630 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00b9d0 con 0x7f669c15d900 2023-10-16T20:08:08.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.644+0000 7f669959a700 1 -- 172.21.15.152:0/630780630 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00bd60 con 0x7f669c15d900 2023-10-16T20:08:08.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 -- 172.21.15.152:0/630780630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c15d900 msgr2=0x7f669c0d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 --2- 172.21.15.152:0/630780630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c15d900 0x7f669c0d0c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f669c06ee80 tx=0x7f668c009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 -- 172.21.15.152:0/630780630 shutdown_connections 2023-10-16T20:08:08.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 --2- 172.21.15.152:0/630780630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c15d900 0x7f669c0d0c90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 --2- 172.21.15.152:0/630780630 >> v2:172.21.15.163:3300/0 conn(0x7f669c06f0e0 0x7f669c0ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 -- 172.21.15.152:0/630780630 >> 172.21.15.152:0/630780630 conn(0x7f669c0d0170 msgr2=0x7f669c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 -- 172.21.15.152:0/630780630 shutdown_connections 2023-10-16T20:08:08.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.645+0000 7f66a0cf1700 1 -- 172.21.15.152:0/630780630 wait complete. 2023-10-16T20:08:08.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.646+0000 7f66a0cf1700 1 Processor -- start 2023-10-16T20:08:08.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 -- start start 2023-10-16T20:08:08.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f669c06f0e0 0x7f669c159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c0cad00 0x7f669c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f669c15d900 0x7f669c15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c15fe00 con 0x7f669c0cad00 2023-10-16T20:08:08.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c15e410 con 0x7f669c15d900 2023-10-16T20:08:08.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f66a0cf1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0c6390 con 0x7f669c06f0e0 2023-10-16T20:08:08.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f6699d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c0cad00 0x7f669c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f6699d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c0cad00 0x7f669c0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32954/0 (socket says 172.21.15.152:32954) 2023-10-16T20:08:08.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.647+0000 7f6699d9b700 1 -- 172.21.15.152:0/3408188692 learned_addr learned my addr 172.21.15.152:0/3408188692 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:08.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f669a59c700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f669c06f0e0 0x7f669c159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f669ad9d700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f669c15d900 0x7f669c15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f6699d9b700 1 -- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f669c06f0e0 msgr2=0x7f669c159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f6699d9b700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f669c06f0e0 0x7f669c159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f6699d9b700 1 -- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f669c15d900 msgr2=0x7f669c15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f6699d9b700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f669c15d900 0x7f669c15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f6699d9b700 1 -- 172.21.15.152:0/3408188692 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009550 con 0x7f669c0cad00 2023-10-16T20:08:08.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f669a59c700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f669c06f0e0 0x7f669c159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:08.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f669ad9d700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f669c15d900 0x7f669c15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:08.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f6699d9b700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c0cad00 0x7f669c0c5730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f669000e840 tx=0x7f669000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690013610 con 0x7f669c0cad00 2023-10-16T20:08:08.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690013770 con 0x7f669c0cad00 2023-10-16T20:08:08.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c0c5dd0 con 0x7f669c0cad00 2023-10-16T20:08:08.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690013b20 con 0x7f669c0cad00 2023-10-16T20:08:08.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.648+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c15e0a0 con 0x7f669c0cad00 2023-10-16T20:08:08.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.649+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f669c06fa30 con 0x7f669c0cad00 2023-10-16T20:08:08.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.649+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6690013c80 con 0x7f669c0cad00 2023-10-16T20:08:08.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f668affd700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f667c06af30 0x7f667c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6690089410 con 0x7f669c0cad00 2023-10-16T20:08:08.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f669a59c700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f667c06af30 0x7f667c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f668affd700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f667c0736c0 0x7f667c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 --> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f667c076210 con 0x7f667c0736c0 2023-10-16T20:08:08.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669008b9f0 con 0x7f669c0cad00 2023-10-16T20:08:08.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f669ad9d700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f667c0736c0 0x7f667c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f669a59c700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f667c06af30 0x7f667c06d3f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f668c014040 tx=0x7f668c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.650+0000 7f669ad9d700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f667c0736c0 0x7f667c075b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.651+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== osd.1 v2:172.21.15.152:6816/3247585045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f667c076210 con 0x7f667c0736c0 2023-10-16T20:08:08.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 --> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f669c06f750 con 0x7f667c0736c0 2023-10-16T20:08:08.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f668affd700 1 -- 172.21.15.152:0/3408188692 <== osd.1 v2:172.21.15.152:6816/3247585045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6694003a00 con 0x7f667c0736c0 2023-10-16T20:08:08.671 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:08.672 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:08.672 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:08.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f667c0736c0 msgr2=0x7f667c075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6816/3247585045,v1:172.21.15.152:6818/3247585045] conn(0x7f667c0736c0 0x7f667c075b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f667c06af30 msgr2=0x7f667c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f667c06af30 0x7f667c06d3f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f668c014040 tx=0x7f668c008030 comp rx=0 tx=0).stop 2023-10-16T20:08:08.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c0cad00 msgr2=0x7f669c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 --2- 172.21.15.152:0/3408188692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f669c0cad00 0x7f669c0c5730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f669000e840 tx=0x7f669000ec00 comp rx=0 tx=0).stop 2023-10-16T20:08:08.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f669ad9d700 1 -- 172.21.15.152:0/3408188692 reap_dead start 2023-10-16T20:08:08.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 shutdown_connections 2023-10-16T20:08:08.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 >> 172.21.15.152:0/3408188692 conn(0x7f669c0d0170 msgr2=0x7f669c15b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 shutdown_connections 2023-10-16T20:08:08.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.666+0000 7f66a0cf1700 1 -- 172.21.15.152:0/3408188692 wait complete. 2023-10-16T20:08:08.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-16T20:08:08.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.800+0000 7f1d83ff3700 1 Processor -- start 2023-10-16T20:08:08.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.801+0000 7f1d83ff3700 1 -- start start 2023-10-16T20:08:08.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.801+0000 7f1d83ff3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0cf7d0 0x7f1d7c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.801+0000 7f1d83ff3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1d7c0ca7d0 0x7f1d7c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.801+0000 7f1d83ff3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0cfeb0 con 0x7f1d7c06a820 2023-10-16T20:08:08.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.801+0000 7f1d83ff3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0ce410 con 0x7f1d7c0ca7d0 2023-10-16T20:08:08.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.801+0000 7f1d83ff3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cfc30 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d81d8f700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1d7c06a820 0x7f1d7c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41392/0 (socket says 172.21.15.152:41392) 2023-10-16T20:08:08.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d81d8f700 1 -- 172.21.15.152:0/2595756332 learned_addr learned my addr 172.21.15.152:0/2595756332 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:08.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d8158e700 1 --2- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0cf7d0 0x7f1d7c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d82590700 1 --2- 172.21.15.152:0/2595756332 >> v2:172.21.15.163:3300/0 conn(0x7f1d7c0ca7d0 0x7f1d7c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d80d8d700 1 -- 172.21.15.152:0/2595756332 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471745445 0 0) 0x7f1d7c0cfeb0 con 0x7f1d7c06a820 2023-10-16T20:08:08.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d80d8d700 1 -- 172.21.15.152:0/2595756332 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d680035b0 con 0x7f1d7c06a820 2023-10-16T20:08:08.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d82590700 1 -- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0cf7d0 msgr2=0x7f1d7c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:08.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d82590700 1 --2- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0cf7d0 0x7f1d7c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d82590700 1 -- 172.21.15.152:0/2595756332 >> v1:172.21.15.152:6789/0 conn(0x7f1d7c06a820 legacy=0x7f1d7c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d82590700 1 -- 172.21.15.152:0/2595756332 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0af9d0 con 0x7f1d7c0ca7d0 2023-10-16T20:08:08.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d82590700 1 --2- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c0ca7d0 0x7f1d7c071ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009d90 tx=0x7f1d7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccaf27afcbf3a9ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d80d8d700 1 -- 172.21.15.152:0/2595756332 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400e070 con 0x7f1d7c0ca7d0 2023-10-16T20:08:08.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d80d8d700 1 -- 172.21.15.152:0/2595756332 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400bb20 con 0x7f1d7c0ca7d0 2023-10-16T20:08:08.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.802+0000 7f1d80d8d700 1 -- 172.21.15.152:0/2595756332 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012430 con 0x7f1d7c0ca7d0 2023-10-16T20:08:08.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 -- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c0ca7d0 msgr2=0x7f1d7c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c0ca7d0 0x7f1d7c071ea0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009d90 tx=0x7f1d7400b330 comp rx=0 tx=0).stop 2023-10-16T20:08:08.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 -- 172.21.15.152:0/2595756332 shutdown_connections 2023-10-16T20:08:08.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c0ca7d0 0x7f1d7c071ea0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/2595756332 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0cf7d0 0x7f1d7c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 -- 172.21.15.152:0/2595756332 >> 172.21.15.152:0/2595756332 conn(0x7f1d7c0d0180 msgr2=0x7f1d7c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:08.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 -- 172.21.15.152:0/2595756332 shutdown_connections 2023-10-16T20:08:08.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.803+0000 7f1d83ff3700 1 -- 172.21.15.152:0/2595756332 wait complete. 2023-10-16T20:08:08.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.804+0000 7f1d83ff3700 1 Processor -- start 2023-10-16T20:08:08.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.804+0000 7f1d83ff3700 1 -- start start 2023-10-16T20:08:08.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d83ff3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c06a820 0x7f1d7c15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d83ff3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0ca7d0 0x7f1d7c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d83ff3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 0x7f1d7c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d83ff3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c15b040 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d83ff3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c160030 con 0x7f1d7c06a820 2023-10-16T20:08:08.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d83ff3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b0bf0 con 0x7f1d7c0ca7d0 2023-10-16T20:08:08.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 0x7f1d7c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 0x7f1d7c155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32972/0 (socket says 172.21.15.152:32972) 2023-10-16T20:08:08.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 -- 172.21.15.152:0/4688233 learned_addr learned my addr 172.21.15.152:0/4688233 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:08.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d8158e700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0ca7d0 0x7f1d7c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d81d8f700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c06a820 0x7f1d7c15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 -- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0ca7d0 msgr2=0x7f1d7c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0ca7d0 0x7f1d7c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 -- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c06a820 msgr2=0x7f1d7c15eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:08.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c06a820 0x7f1d7c15eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:08.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d82590700 1 -- 172.21.15.152:0/4688233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009a70 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.805+0000 7f1d81d8f700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c06a820 0x7f1d7c15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:08.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.806+0000 7f1d82590700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 0x7f1d7c155540 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1d74014040 tx=0x7f1d74004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.806+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012430 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.806+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74020070 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.806+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74004280 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.806+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c15f4b0 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.806+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c15fa70 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.807+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c04ebb0 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.807+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d740043e0 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.807+0000 7f1d727fc700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d6006af00 0x7f1d6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:08.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.808+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f1d74022070 con 0x7f1d7c0cf7d0 2023-10-16T20:08:08.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.808+0000 7f1d81d8f700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d6006af00 0x7f1d6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:08.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.808+0000 7f1d81d8f700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d6006af00 0x7f1d6006d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0011e0 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:08.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:08.812+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d74056380 con 0x7f1d7c0cf7d0 2023-10-16T20:08:09.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.003+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d7c0af6f0 con 0x7f1d6006af00 2023-10-16T20:08:09.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.003+0000 7f1d727fc700 1 -- 172.21.15.152:0/4688233 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1d6c001c90 con 0x7f1d6006af00 2023-10-16T20:08:09.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.005+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d6006af00 msgr2=0x7f1d6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.005+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d6006af00 0x7f1d6006d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0011e0 tx=0x7f1d6c009040 comp rx=0 tx=0).stop 2023-10-16T20:08:09.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.005+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 msgr2=0x7f1d7c155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.005+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 0x7f1d7c155540 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1d74014040 tx=0x7f1d74004b20 comp rx=0 tx=0).stop 2023-10-16T20:08:09.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 shutdown_connections 2023-10-16T20:08:09.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f1d6006af00 0x7f1d6006d3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d7c0cf7d0 0x7f1d7c155540 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d7c06a820 0x7f1d7c15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 --2- 172.21.15.152:0/4688233 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f1d7c0ca7d0 0x7f1d7c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 >> 172.21.15.152:0/4688233 conn(0x7f1d7c0d0180 msgr2=0x7f1d7c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 shutdown_connections 2023-10-16T20:08:09.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.006+0000 7f1d83ff3700 1 -- 172.21.15.152:0/4688233 wait complete. 2023-10-16T20:08:09.015 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 1 to deep-scrub 2023-10-16T20:08:09.020 INFO:tasks.ceph:Scrubbing osd.2 2023-10-16T20:08:09.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:09.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.146+0000 7f6da68a1700 1 Processor -- start 2023-10-16T20:08:09.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.146+0000 7f6da68a1700 1 -- start start 2023-10-16T20:08:09.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da68a1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6da015b4e0 0x7f6da006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da68a1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da00cd770 0x7f6da00b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da68a1700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6da00b3220 0x7f6da00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da68a1700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da00b36b0 con 0x7f6da00b3220 2023-10-16T20:08:09.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da68a1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da0070620 con 0x7f6da015b4e0 2023-10-16T20:08:09.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da68a1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0070900 con 0x7f6da00cd770 2023-10-16T20:08:09.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6da00b3220 0x7f6da00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6da00b3220 0x7f6da00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32980/0 (socket says 172.21.15.152:32980) 2023-10-16T20:08:09.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 -- 172.21.15.152:0/4098096442 learned_addr learned my addr 172.21.15.152:0/4098096442 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:09.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6d9ffff700 1 --2- 172.21.15.152:0/4098096442 >> v2:172.21.15.163:3300/0 conn(0x7f6da015b4e0 0x7f6da006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6d9f7fe700 1 --2- 172.21.15.152:0/4098096442 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da00cd770 0x7f6da00b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 -- 172.21.15.152:0/4098096442 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da00cd770 msgr2=0x7f6da00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:09.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 --2- 172.21.15.152:0/4098096442 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da00cd770 0x7f6da00b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 -- 172.21.15.152:0/4098096442 >> v2:172.21.15.163:3300/0 conn(0x7f6da015b4e0 msgr2=0x7f6da006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:09.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 --2- 172.21.15.152:0/4098096442 >> v2:172.21.15.163:3300/0 conn(0x7f6da015b4e0 0x7f6da006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 -- 172.21.15.152:0/4098096442 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0070be0 con 0x7f6da00b3220 2023-10-16T20:08:09.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6da4e3e700 1 --2- 172.21.15.152:0/4098096442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00b3220 0x7f6da00cee30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6da00c4d60 tx=0x7f6d9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ae70b2361954de server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6d9effd700 1 -- 172.21.15.152:0/4098096442 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800e070 con 0x7f6da00b3220 2023-10-16T20:08:09.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6d9effd700 1 -- 172.21.15.152:0/4098096442 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9800b910 con 0x7f6da00b3220 2023-10-16T20:08:09.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.147+0000 7f6d9effd700 1 -- 172.21.15.152:0/4098096442 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800bcc0 con 0x7f6da00b3220 2023-10-16T20:08:09.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 -- 172.21.15.152:0/4098096442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00b3220 msgr2=0x7f6da00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 --2- 172.21.15.152:0/4098096442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00b3220 0x7f6da00cee30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6da00c4d60 tx=0x7f6d9800b330 comp rx=0 tx=0).stop 2023-10-16T20:08:09.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 -- 172.21.15.152:0/4098096442 shutdown_connections 2023-10-16T20:08:09.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 --2- 172.21.15.152:0/4098096442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00b3220 0x7f6da00cee30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 --2- 172.21.15.152:0/4098096442 >> v2:172.21.15.163:3300/0 conn(0x7f6da015b4e0 0x7f6da006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 --2- 172.21.15.152:0/4098096442 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da00cd770 0x7f6da00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 -- 172.21.15.152:0/4098096442 >> 172.21.15.152:0/4098096442 conn(0x7f6da00cdce0 msgr2=0x7f6da00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 -- 172.21.15.152:0/4098096442 shutdown_connections 2023-10-16T20:08:09.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.148+0000 7f6da68a1700 1 -- 172.21.15.152:0/4098096442 wait complete. 2023-10-16T20:08:09.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.150+0000 7f6da68a1700 1 Processor -- start 2023-10-16T20:08:09.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.150+0000 7f6da68a1700 1 -- start start 2023-10-16T20:08:09.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da68a1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6da00b3220 0x7f6da0153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da68a1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00cd770 0x7f6da0154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da68a1700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da015b4e0 0x7f6da0156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da68a1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da01f21f0 con 0x7f6da00cd770 2023-10-16T20:08:09.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da68a1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0153c60 con 0x7f6da00b3220 2023-10-16T20:08:09.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da68a1700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da01e0820 con 0x7f6da015b4e0 2023-10-16T20:08:09.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00cd770 0x7f6da0154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00cd770 0x7f6da0154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32984/0 (socket says 172.21.15.152:32984) 2023-10-16T20:08:09.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 -- 172.21.15.152:0/808453368 learned_addr learned my addr 172.21.15.152:0/808453368 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:09.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9ffff700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6da00b3220 0x7f6da0153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6da4e3e700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da015b4e0 0x7f6da0156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 -- 172.21.15.152:0/808453368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da015b4e0 msgr2=0x7f6da0156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f6da015b4e0 0x7f6da0156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 -- 172.21.15.152:0/808453368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6da00b3220 msgr2=0x7f6da0153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6da00b3220 0x7f6da0153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 -- 172.21.15.152:0/808453368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d98009b30 con 0x7f6da00cd770 2023-10-16T20:08:09.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9f7fe700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00cd770 0x7f6da0154770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400e980 tx=0x7f6d9400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.151+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94009710 con 0x7f6da00cd770 2023-10-16T20:08:09.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.152+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94013680 con 0x7f6da00cd770 2023-10-16T20:08:09.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.152+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94013a30 con 0x7f6da00cd770 2023-10-16T20:08:09.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.152+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da01e0b00 con 0x7f6da00cd770 2023-10-16T20:08:09.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.152+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da01e10c0 con 0x7f6da00cd770 2023-10-16T20:08:09.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.152+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6da00702f0 con 0x7f6da00cd770 2023-10-16T20:08:09.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.153+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6d94013b90 con 0x7f6da00cd770 2023-10-16T20:08:09.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.153+0000 7f6d9cff9700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6d8c06af00 0x7f6d8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.153+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6d940896b0 con 0x7f6da00cd770 2023-10-16T20:08:09.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.153+0000 7f6d9ffff700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6d8c06af00 0x7f6d8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.154+0000 7f6d9cff9700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7f6d8c073690 0x7f6d8c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.154+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 --> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d8c0761e0 con 0x7f6d8c073690 2023-10-16T20:08:09.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.154+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d9408bd70 con 0x7f6da00cd770 2023-10-16T20:08:09.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.154+0000 7f6da4e3e700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7f6d8c073690 0x7f6d8c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.154+0000 7f6d9ffff700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6d8c06af00 0x7f6d8c06d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6da00cb730 tx=0x7f6d90009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.154+0000 7f6da4e3e700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7f6d8c073690 0x7f6d8c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.155+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== osd.2 v2:172.21.15.152:6800/4291228321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6d8c0761e0 con 0x7f6d8c073690 2023-10-16T20:08:09.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.169+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 --> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6da0070ec0 con 0x7f6d8c073690 2023-10-16T20:08:09.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.169+0000 7f6d9cff9700 1 -- 172.21.15.152:0/808453368 <== osd.2 v2:172.21.15.152:6800/4291228321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6d980099b0 con 0x7f6d8c073690 2023-10-16T20:08:09.178 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:09.179 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:09.179 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:09.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7f6d8c073690 msgr2=0x7f6d8c075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6800/4291228321,v1:172.21.15.152:6801/4291228321] conn(0x7f6d8c073690 0x7f6d8c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6d8c06af00 msgr2=0x7f6d8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f6d8c06af00 0x7f6d8c06d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6da00cb730 tx=0x7f6d90009210 comp rx=0 tx=0).stop 2023-10-16T20:08:09.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00cd770 msgr2=0x7f6da0154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 --2- 172.21.15.152:0/808453368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6da00cd770 0x7f6da0154770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400e980 tx=0x7f6d9400ec90 comp rx=0 tx=0).stop 2023-10-16T20:08:09.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da4e3e700 1 -- 172.21.15.152:0/808453368 reap_dead start 2023-10-16T20:08:09.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 shutdown_connections 2023-10-16T20:08:09.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 >> 172.21.15.152:0/808453368 conn(0x7f6da00cdce0 msgr2=0x7f6da00c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 shutdown_connections 2023-10-16T20:08:09.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.170+0000 7f6da68a1700 1 -- 172.21.15.152:0/808453368 wait complete. 2023-10-16T20:08:09.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-16T20:08:09.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.306+0000 7fb473ab7700 1 Processor -- start 2023-10-16T20:08:09.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.306+0000 7fb473ab7700 1 -- start start 2023-10-16T20:08:09.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb473ab7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c06a820 0x7fb46c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb473ab7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb46c15e7f0 0x7fb46c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb473ab7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c0cfeb0 con 0x7fb46c0ca7d0 2023-10-16T20:08:09.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb473ab7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0ce410 con 0x7fb46c15e7f0 2023-10-16T20:08:09.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb473ab7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c15ec70 con 0x7fb46c06a820 2023-10-16T20:08:09.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb471052700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb46c15e7f0 0x7fb46c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.307+0000 7fb471853700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c06a820 0x7fb46c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb472054700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fb46c0ca7d0 0x7fb46c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:56606/0 (socket says 172.21.15.152:56606) 2023-10-16T20:08:09.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471853700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c06a820 0x7fb46c0cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:49876/0 (socket says 172.21.15.152:49876) 2023-10-16T20:08:09.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb472054700 1 -- 172.21.15.152:0/1349895244 learned_addr learned my addr 172.21.15.152:0/1349895244 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:09.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471052700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb46c15e7f0 0x7fb46c06ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.152:33994/0 (socket says 172.21.15.152:33994) 2023-10-16T20:08:09.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471052700 1 -- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c06a820 msgr2=0x7fb46c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:09.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471052700 1 --2- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c06a820 0x7fb46c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471052700 1 -- 172.21.15.152:0/1349895244 >> v1:172.21.15.163:6789/0 conn(0x7fb46c0ca7d0 legacy=0x7fb46c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471052700 1 -- 172.21.15.152:0/1349895244 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0af9d0 con 0x7fb46c15e7f0 2023-10-16T20:08:09.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb470851700 1 -- 172.21.15.152:0/1349895244 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858861612 0 0) 0x7fb46c0cfeb0 con 0x7fb46c0ca7d0 2023-10-16T20:08:09.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb471052700 1 --2- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c15e7f0 0x7fb46c06ac00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb468009840 tx=0x7fb468009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7146d407fcfdf0f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb470851700 1 -- 172.21.15.152:0/1349895244 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468011830 con 0x7fb46c15e7f0 2023-10-16T20:08:09.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb470851700 1 -- 172.21.15.152:0/1349895244 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468011990 con 0x7fb46c15e7f0 2023-10-16T20:08:09.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.308+0000 7fb470851700 1 -- 172.21.15.152:0/1349895244 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468011d20 con 0x7fb46c15e7f0 2023-10-16T20:08:09.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 -- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c15e7f0 msgr2=0x7fb46c06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 --2- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c15e7f0 0x7fb46c06ac00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb468009840 tx=0x7fb468009b50 comp rx=0 tx=0).stop 2023-10-16T20:08:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 -- 172.21.15.152:0/1349895244 shutdown_connections 2023-10-16T20:08:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 --2- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c06a820 0x7fb46c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 --2- 172.21.15.152:0/1349895244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c15e7f0 0x7fb46c06ac00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 -- 172.21.15.152:0/1349895244 >> 172.21.15.152:0/1349895244 conn(0x7fb46c0d0180 msgr2=0x7fb46c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 -- 172.21.15.152:0/1349895244 shutdown_connections 2023-10-16T20:08:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.309+0000 7fb473ab7700 1 -- 172.21.15.152:0/1349895244 wait complete. 2023-10-16T20:08:09.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.310+0000 7fb473ab7700 1 Processor -- start 2023-10-16T20:08:09.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.310+0000 7fb473ab7700 1 -- start start 2023-10-16T20:08:09.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb473ab7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c06a820 0x7fb46c0ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb473ab7700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c0ca7d0 0x7fb46c1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb473ab7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 0x7fb46c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb473ab7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c15bb40 con 0x7fb46c15e7f0 2023-10-16T20:08:09.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb473ab7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0ca040 con 0x7fb46c06a820 2023-10-16T20:08:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb473ab7700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c157c50 con 0x7fb46c0ca7d0 2023-10-16T20:08:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 0x7fb46c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 0x7fb46c157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33002/0 (socket says 172.21.15.152:33002) 2023-10-16T20:08:09.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 -- 172.21.15.152:0/3136409433 learned_addr learned my addr 172.21.15.152:0/3136409433 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:09.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb471853700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c06a820 0x7fb46c0ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb471052700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c0ca7d0 0x7fb46c1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 -- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c0ca7d0 msgr2=0x7fb46c1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c0ca7d0 0x7fb46c1571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 -- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c06a820 msgr2=0x7fb46c0ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c06a820 0x7fb46c0ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 -- 172.21.15.152:0/3136409433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4680094a0 con 0x7fb46c15e7f0 2023-10-16T20:08:09.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb471853700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c06a820 0x7fb46c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:09.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb472054700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 0x7fb46c157710 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb46400cbd0 tx=0x7fb46400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400ab70 con 0x7fb46c15e7f0 2023-10-16T20:08:09.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.311+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400acd0 con 0x7fb46c15e7f0 2023-10-16T20:08:09.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.312+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c0addb0 con 0x7fb46c15e7f0 2023-10-16T20:08:09.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.312+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464007310 con 0x7fb46c15e7f0 2023-10-16T20:08:09.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.312+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c15b480 con 0x7fb46c15e7f0 2023-10-16T20:08:09.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.312+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c15bc80 con 0x7fb46c15e7f0 2023-10-16T20:08:09.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.313+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb464007470 con 0x7fb46c15e7f0 2023-10-16T20:08:09.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.313+0000 7fb4627fc700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb45006af00 0x7fb45006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.313+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb464089420 con 0x7fb46c15e7f0 2023-10-16T20:08:09.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.313+0000 7fb471853700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb45006af00 0x7fb45006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.314+0000 7fb471853700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb45006af00 0x7fb45006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009c30 tx=0x7fb45c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.318+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb46c15bc80 con 0x7fb46c15e7f0 2023-10-16T20:08:09.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.507+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb46c0af410 con 0x7fb45006af00 2023-10-16T20:08:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.508+0000 7fb4627fc700 1 -- 172.21.15.152:0/3136409433 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb45c004030 con 0x7fb45006af00 2023-10-16T20:08:09.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb45006af00 msgr2=0x7fb45006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb45006af00 0x7fb45006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009c30 tx=0x7fb45c008040 comp rx=0 tx=0).stop 2023-10-16T20:08:09.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 msgr2=0x7fb46c157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 0x7fb46c157710 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb46400cbd0 tx=0x7fb46400cf90 comp rx=0 tx=0).stop 2023-10-16T20:08:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 shutdown_connections 2023-10-16T20:08:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb45006af00 0x7fb45006d3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c15e7f0 0x7fb46c157710 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb46c06a820 0x7fb46c0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 --2- 172.21.15.152:0/3136409433 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb46c0ca7d0 0x7fb46c1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 >> 172.21.15.152:0/3136409433 conn(0x7fb46c0d0180 msgr2=0x7fb46c0cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 shutdown_connections 2023-10-16T20:08:09.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.510+0000 7fb473ab7700 1 -- 172.21.15.152:0/3136409433 wait complete. 2023-10-16T20:08:09.516 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 2 to deep-scrub 2023-10-16T20:08:09.524 INFO:tasks.ceph:Scrubbing osd.3 2023-10-16T20:08:09.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:09.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.647+0000 7f5117fdc700 1 Processor -- start 2023-10-16T20:08:09.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.647+0000 7f5117fdc700 1 -- start start 2023-10-16T20:08:09.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5117fdc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f511006a820 0x7f511015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5117fdc700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5110161360 con 0x7f51100cdd30 2023-10-16T20:08:09.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5117fdc700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511006b750 con 0x7f511006b370 2023-10-16T20:08:09.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5117fdc700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511006dcc0 con 0x7f511006a820 2023-10-16T20:08:09.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5115577700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f511006a820 0x7f511015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5116579700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f51100cdd30 0x7f51101617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41438/0 (socket says 172.21.15.152:41438) 2023-10-16T20:08:09.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.648+0000 7f5116579700 1 -- 172.21.15.152:0/1476197681 learned_addr learned my addr 172.21.15.152:0/1476197681 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:09.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5115577700 1 -- 172.21.15.152:0/1476197681 >> v1:172.21.15.163:6789/0 conn(0x7f511006b370 legacy=0x7f511006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5115577700 1 -- 172.21.15.152:0/1476197681 >> v1:172.21.15.152:6789/0 conn(0x7f51100cdd30 legacy=0x7f51101617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5114d76700 1 -- 172.21.15.152:0/1476197681 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081390625 0 0) 0x7f5110161360 con 0x7f51100cdd30 2023-10-16T20:08:09.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5115577700 1 -- 172.21.15.152:0/1476197681 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511015e300 con 0x7f511006a820 2023-10-16T20:08:09.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5115577700 1 --2- 172.21.15.152:0/1476197681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f511006a820 0x7f511015dcb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f510c009840 tx=0x7f510c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aff89545125b656 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5114d76700 1 -- 172.21.15.152:0/1476197681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c011830 con 0x7f511006a820 2023-10-16T20:08:09.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5114d76700 1 -- 172.21.15.152:0/1476197681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c011990 con 0x7f511006a820 2023-10-16T20:08:09.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5114d76700 1 -- 172.21.15.152:0/1476197681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c011d20 con 0x7f511006a820 2023-10-16T20:08:09.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5117fdc700 1 -- 172.21.15.152:0/1476197681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f511006a820 msgr2=0x7f511015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5117fdc700 1 --2- 172.21.15.152:0/1476197681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f511006a820 0x7f511015dcb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f510c009840 tx=0x7f510c009b50 comp rx=0 tx=0).stop 2023-10-16T20:08:09.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5117fdc700 1 -- 172.21.15.152:0/1476197681 shutdown_connections 2023-10-16T20:08:09.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5117fdc700 1 --2- 172.21.15.152:0/1476197681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f511006a820 0x7f511015dcb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.649+0000 7f5117fdc700 1 -- 172.21.15.152:0/1476197681 >> 172.21.15.152:0/1476197681 conn(0x7f51100ccbe0 msgr2=0x7f51100ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.650+0000 7f5117fdc700 1 -- 172.21.15.152:0/1476197681 shutdown_connections 2023-10-16T20:08:09.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.650+0000 7f5117fdc700 1 -- 172.21.15.152:0/1476197681 wait complete. 2023-10-16T20:08:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.651+0000 7f5117fdc700 1 Processor -- start 2023-10-16T20:08:09.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.651+0000 7f5117fdc700 1 -- start start 2023-10-16T20:08:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.651+0000 7f5117fdc700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511006a820 0x7f5110154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.651+0000 7f5117fdc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511006b370 0x7f51100c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.651+0000 7f5117fdc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51100cdd30 0x7f51100cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5117fdc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100afc20 con 0x7f51100cdd30 2023-10-16T20:08:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5117fdc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b0a80 con 0x7f511006b370 2023-10-16T20:08:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5117fdc700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100afe70 con 0x7f511006a820 2023-10-16T20:08:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51100cdd30 0x7f51100cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51100cdd30 0x7f51100cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33016/0 (socket says 172.21.15.152:33016) 2023-10-16T20:08:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 -- 172.21.15.152:0/3382540108 learned_addr learned my addr 172.21.15.152:0/3382540108 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5115577700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511006b370 0x7f51100c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5115d78700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511006a820 0x7f5110154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 -- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511006a820 msgr2=0x7f5110154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511006a820 0x7f5110154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 -- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511006b370 msgr2=0x7f51100c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f511006b370 0x7f51100c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 -- 172.21.15.152:0/3382540108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0094a0 con 0x7f51100cdd30 2023-10-16T20:08:09.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5115d78700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f511006a820 0x7f5110154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:09.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5116579700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51100cdd30 0x7f51100cb630 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f510800cc70 tx=0x7f510800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510800ada0 con 0x7f51100cdd30 2023-10-16T20:08:09.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510800ce70 con 0x7f51100cdd30 2023-10-16T20:08:09.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100b0150 con 0x7f51100cdd30 2023-10-16T20:08:09.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51080072f0 con 0x7f51100cdd30 2023-10-16T20:08:09.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.652+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51100b0710 con 0x7f51100cdd30 2023-10-16T20:08:09.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.653+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f511015e8c0 con 0x7f51100cdd30 2023-10-16T20:08:09.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5108007450 con 0x7f51100cdd30 2023-10-16T20:08:09.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f51067fc700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f50f406af30 0x7f50f406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5108089bc0 con 0x7f51100cdd30 2023-10-16T20:08:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f5115d78700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f50f406af30 0x7f50f406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f51067fc700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7f50f40736c0 0x7f50f4075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 --> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50f4076210 con 0x7f50f40736c0 2023-10-16T20:08:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f510808a010 con 0x7f51100cdd30 2023-10-16T20:08:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f5115577700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7f50f40736c0 0x7f50f4075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.654+0000 7f5115d78700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f50f406af30 0x7f50f406d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51100cc2c0 tx=0x7f5100009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.655+0000 7f5115577700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7f50f40736c0 0x7f50f4075b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.655+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== osd.3 v2:172.21.15.152:6817/2264394599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f50f4076210 con 0x7f50f40736c0 2023-10-16T20:08:09.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 --> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f511015e5e0 con 0x7f50f40736c0 2023-10-16T20:08:09.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f51067fc700 1 -- 172.21.15.152:0/3382540108 <== osd.3 v2:172.21.15.152:6817/2264394599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f510c011b80 con 0x7f50f40736c0 2023-10-16T20:08:09.672 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:09.673 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:09.673 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7f50f40736c0 msgr2=0x7f50f4075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6817/2264394599,v1:172.21.15.152:6819/2264394599] conn(0x7f50f40736c0 0x7f50f4075b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f50f406af30 msgr2=0x7f50f406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f50f406af30 0x7f50f406d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51100cc2c0 tx=0x7f5100009040 comp rx=0 tx=0).stop 2023-10-16T20:08:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51100cdd30 msgr2=0x7f51100cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 --2- 172.21.15.152:0/3382540108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51100cdd30 0x7f51100cb630 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f510800cc70 tx=0x7f510800a340 comp rx=0 tx=0).stop 2023-10-16T20:08:09.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5116579700 1 -- 172.21.15.152:0/3382540108 reap_dead start 2023-10-16T20:08:09.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 shutdown_connections 2023-10-16T20:08:09.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 >> 172.21.15.152:0/3382540108 conn(0x7f51100ccbe0 msgr2=0x7f5110157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 shutdown_connections 2023-10-16T20:08:09.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.670+0000 7f5117fdc700 1 -- 172.21.15.152:0/3382540108 wait complete. 2023-10-16T20:08:09.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-16T20:08:09.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.805+0000 7fb25a6b3700 1 Processor -- start 2023-10-16T20:08:09.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.805+0000 7fb25a6b3700 1 -- start start 2023-10-16T20:08:09.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb25a6b3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb25406b4f0 0x7fb2540af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb25a6b3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25406a950 con 0x7fb25415d6c0 2023-10-16T20:08:09.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb25a6b3700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2540cc9d0 con 0x7fb2540ca710 2023-10-16T20:08:09.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb25a6b3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540cf500 con 0x7fb25406b4f0 2023-10-16T20:08:09.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb253fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb25415d6c0 0x7fb2540cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41452/0 (socket says 172.21.15.152:41452) 2023-10-16T20:08:09.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb253fff700 1 -- 172.21.15.152:0/1487707457 learned_addr learned my addr 172.21.15.152:0/1487707457 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:09.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb258c50700 1 --2- 172.21.15.152:0/1487707457 >> v2:172.21.15.163:3300/0 conn(0x7fb25406b4f0 0x7fb2540af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb252ffd700 1 -- 172.21.15.152:0/1487707457 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098768534 0 0) 0x7fb25406a950 con 0x7fb25415d6c0 2023-10-16T20:08:09.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb252ffd700 1 -- 172.21.15.152:0/1487707457 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb23c0035b0 con 0x7fb25415d6c0 2023-10-16T20:08:09.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb252ffd700 1 -- 172.21.15.152:0/1487707457 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3881788947 0 0) 0x7fb23c0035b0 con 0x7fb25415d6c0 2023-10-16T20:08:09.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb258c50700 1 -- 172.21.15.152:0/1487707457 >> v1:172.21.15.163:6789/0 conn(0x7fb2540ca710 legacy=0x7fb25406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb258c50700 1 -- 172.21.15.152:0/1487707457 >> v1:172.21.15.152:6789/0 conn(0x7fb25415d6c0 legacy=0x7fb2540cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.806+0000 7fb258c50700 1 -- 172.21.15.152:0/1487707457 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540cc410 con 0x7fb25406b4f0 2023-10-16T20:08:09.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb258c50700 1 --2- 172.21.15.152:0/1487707457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25406b4f0 0x7fb2540af390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009d90 tx=0x7fb24c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01fe892fd3fd977 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb252ffd700 1 -- 172.21.15.152:0/1487707457 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00e070 con 0x7fb25406b4f0 2023-10-16T20:08:09.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb252ffd700 1 -- 172.21.15.152:0/1487707457 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c003a20 con 0x7fb25406b4f0 2023-10-16T20:08:09.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb252ffd700 1 -- 172.21.15.152:0/1487707457 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248001670 con 0x7fb25406b4f0 2023-10-16T20:08:09.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 -- 172.21.15.152:0/1487707457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25406b4f0 msgr2=0x7fb2540af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/1487707457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25406b4f0 0x7fb2540af390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009d90 tx=0x7fb24c00b330 comp rx=0 tx=0).stop 2023-10-16T20:08:09.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 -- 172.21.15.152:0/1487707457 shutdown_connections 2023-10-16T20:08:09.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/1487707457 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25406b4f0 0x7fb2540af390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 -- 172.21.15.152:0/1487707457 >> 172.21.15.152:0/1487707457 conn(0x7fb2540ccbd0 msgr2=0x7fb2540ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:09.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 -- 172.21.15.152:0/1487707457 shutdown_connections 2023-10-16T20:08:09.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.807+0000 7fb25a6b3700 1 -- 172.21.15.152:0/1487707457 wait complete. 2023-10-16T20:08:09.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.809+0000 7fb25a6b3700 1 Processor -- start 2023-10-16T20:08:09.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.809+0000 7fb25a6b3700 1 -- start start 2023-10-16T20:08:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb25a6b3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb25406b4f0 0x7fb2541f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb25a6b3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 0x7fb2540716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb25a6b3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25415d6c0 0x7fb254071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb25a6b3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541f71b0 con 0x7fb2540ca710 2023-10-16T20:08:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb25a6b3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541f6530 con 0x7fb25415d6c0 2023-10-16T20:08:09.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb25a6b3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541f6810 con 0x7fb25406b4f0 2023-10-16T20:08:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 0x7fb2540716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 0x7fb2540716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33030/0 (socket says 172.21.15.152:33030) 2023-10-16T20:08:09.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 -- 172.21.15.152:0/3388709099 learned_addr learned my addr 172.21.15.152:0/3388709099 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb253fff700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb25406b4f0 0x7fb2541f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb258c50700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25415d6c0 0x7fb254071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 -- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb25406b4f0 msgr2=0x7fb2541f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb25406b4f0 0x7fb2541f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 -- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25415d6c0 msgr2=0x7fb254071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25415d6c0 0x7fb254071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.810+0000 7fb2537fe700 1 -- 172.21.15.152:0/3388709099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c009a70 con 0x7fb2540ca710 2023-10-16T20:08:09.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.811+0000 7fb2537fe700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 0x7fb2540716f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c750 tx=0x7fb24400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.811+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440054e0 con 0x7fb2540ca710 2023-10-16T20:08:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.811+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244003680 con 0x7fb2540ca710 2023-10-16T20:08:09.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.811+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2541f6af0 con 0x7fb2540ca710 2023-10-16T20:08:09.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.811+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244003a30 con 0x7fb2540ca710 2023-10-16T20:08:09.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.811+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2540c80a0 con 0x7fb2540ca710 2023-10-16T20:08:09.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.812+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2541f72f0 con 0x7fb2540ca710 2023-10-16T20:08:09.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.812+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb244003b90 con 0x7fb2540ca710 2023-10-16T20:08:09.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.813+0000 7fb250ff9700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb24006af00 0x7fb24006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:09.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.813+0000 7fb253fff700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb24006af00 0x7fb24006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:09.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.813+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb244088cc0 con 0x7fb2540ca710 2023-10-16T20:08:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.813+0000 7fb253fff700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb24006af00 0x7fb24006d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb248001200 tx=0x7fb248001130 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:09.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:09.817+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2541f72f0 con 0x7fb2540ca710 2023-10-16T20:08:10.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.005+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2540cc6f0 con 0x7fb24006af00 2023-10-16T20:08:10.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.005+0000 7fb250ff9700 1 -- 172.21.15.152:0/3388709099 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb24800f610 con 0x7fb24006af00 2023-10-16T20:08:10.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb24006af00 msgr2=0x7fb24006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb24006af00 0x7fb24006d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb248001200 tx=0x7fb248001130 comp rx=0 tx=0).stop 2023-10-16T20:08:10.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 msgr2=0x7fb2540716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 0x7fb2540716f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c750 tx=0x7fb24400ca60 comp rx=0 tx=0).stop 2023-10-16T20:08:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 shutdown_connections 2023-10-16T20:08:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb24006af00 0x7fb24006d3c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb25406b4f0 0x7fb2541f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb25415d6c0 0x7fb254071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 --2- 172.21.15.152:0/3388709099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2540ca710 0x7fb2540716f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.007+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 >> 172.21.15.152:0/3388709099 conn(0x7fb2540ccbd0 msgr2=0x7fb2540ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.008+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 shutdown_connections 2023-10-16T20:08:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.008+0000 7fb25a6b3700 1 -- 172.21.15.152:0/3388709099 wait complete. 2023-10-16T20:08:10.013 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 3 to deep-scrub 2023-10-16T20:08:10.021 INFO:tasks.ceph:Scrubbing osd.4 2023-10-16T20:08:10.022 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:10.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.145+0000 7fbf0aa39700 1 Processor -- start 2023-10-16T20:08:10.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.145+0000 7fbf0aa39700 1 -- start start 2023-10-16T20:08:10.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.146+0000 7fbf0aa39700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf0415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.146+0000 7fbf0aa39700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbf04071810 0x7fbf04071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf0aa39700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0415b8e0 con 0x7fbf0415df10 2023-10-16T20:08:10.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf0aa39700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf040721d0 con 0x7fbf04071810 2023-10-16T20:08:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf0aa39700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0406ef90 con 0x7fbf04158070 2023-10-16T20:08:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbf04071810 0x7fbf04071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbf04071810 0x7fbf04071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33036/0 (socket says 172.21.15.152:33036) 2023-10-16T20:08:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 -- 172.21.15.152:0/2656938172 learned_addr learned my addr 172.21.15.152:0/2656938172 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 -- 172.21.15.152:0/2656938172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 msgr2=0x7fbf0415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf03fff700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf0415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf0415b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 -- 172.21.15.152:0/2656938172 >> v1:172.21.15.163:6789/0 conn(0x7fbf0415df10 legacy=0x7fbf0415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 -- 172.21.15.152:0/2656938172 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0406f270 con 0x7fbf04071810 2023-10-16T20:08:10.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf03fff700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf0415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf037fe700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf04071810 0x7fbf04071c90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbef80098f0 tx=0x7fbef8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85aee73024deb88b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf02ffd700 1 -- 172.21.15.152:0/2656938172 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8004230 con 0x7fbf04071810 2023-10-16T20:08:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf02ffd700 1 -- 172.21.15.152:0/2656938172 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8004390 con 0x7fbf04071810 2023-10-16T20:08:10.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.147+0000 7fbf02ffd700 1 -- 172.21.15.152:0/2656938172 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80036a0 con 0x7fbf04071810 2023-10-16T20:08:10.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2656938172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf04071810 msgr2=0x7fbf04071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf04071810 0x7fbf04071c90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbef80098f0 tx=0x7fbef8009c00 comp rx=0 tx=0).stop 2023-10-16T20:08:10.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2656938172 shutdown_connections 2023-10-16T20:08:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf0415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 --2- 172.21.15.152:0/2656938172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf04071810 0x7fbf04071c90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2656938172 >> 172.21.15.152:0/2656938172 conn(0x7fbf040ccc90 msgr2=0x7fbf040cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2656938172 shutdown_connections 2023-10-16T20:08:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.148+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2656938172 wait complete. 2023-10-16T20:08:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.149+0000 7fbf0aa39700 1 Processor -- start 2023-10-16T20:08:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.149+0000 7fbf0aa39700 1 -- start start 2023-10-16T20:08:10.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf0aa39700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf04071810 0x7fbf040c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf0aa39700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf040b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf0aa39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0415df10 0x7fbf04142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf0aa39700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b5580 con 0x7fbf0415df10 2023-10-16T20:08:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf0aa39700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b57f0 con 0x7fbf04071810 2023-10-16T20:08:10.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf0aa39700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b5ad0 con 0x7fbf04158070 2023-10-16T20:08:10.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0415df10 0x7fbf04142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0415df10 0x7fbf04142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33046/0 (socket says 172.21.15.152:33046) 2023-10-16T20:08:10.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 -- 172.21.15.152:0/2565564497 learned_addr learned my addr 172.21.15.152:0/2565564497 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf03fff700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf04071810 0x7fbf040c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf037fe700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf040b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 -- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 msgr2=0x7fbf040b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbf04158070 0x7fbf040b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 -- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf04071810 msgr2=0x7fbf040c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf04071810 0x7fbf040c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 -- 172.21.15.152:0/2565564497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009550 con 0x7fbf0415df10 2023-10-16T20:08:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.150+0000 7fbf08fd6700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0415df10 0x7fbf04142f60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00cc10 tx=0x7fbefc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.151+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00aa60 con 0x7fbf0415df10 2023-10-16T20:08:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.151+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00abc0 con 0x7fbf0415df10 2023-10-16T20:08:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.151+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf040b5db0 con 0x7fbf0415df10 2023-10-16T20:08:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.151+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc012420 con 0x7fbf0415df10 2023-10-16T20:08:10.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.151+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf040ca160 con 0x7fbf0415df10 2023-10-16T20:08:10.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.151+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf0406f830 con 0x7fbf0415df10 2023-10-16T20:08:10.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.152+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbefc012580 con 0x7fbf0415df10 2023-10-16T20:08:10.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.152+0000 7fbf00ff9700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbef006af30 0x7fbef006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbefc08a410 con 0x7fbf0415df10 2023-10-16T20:08:10.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf03fff700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbef006af30 0x7fbef006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf00ff9700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7fbef00736c0 0x7fbef0075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 --> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbef0076210 con 0x7fbef00736c0 2023-10-16T20:08:10.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbefc08a860 con 0x7fbf0415df10 2023-10-16T20:08:10.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf03fff700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbef006af30 0x7fbef006d3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006fd0 tx=0x7fbef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf037fe700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7fbef00736c0 0x7fbef0075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.153+0000 7fbf037fe700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7fbef00736c0 0x7fbef0075b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.154+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== osd.4 v2:172.21.15.163:6816/1994135539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbef0076210 con 0x7fbef00736c0 2023-10-16T20:08:10.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.169+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 --> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf0406f550 con 0x7fbef00736c0 2023-10-16T20:08:10.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf00ff9700 1 -- 172.21.15.152:0/2565564497 <== osd.4 v2:172.21.15.163:6816/1994135539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbef80045e0 con 0x7fbef00736c0 2023-10-16T20:08:10.180 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:10.181 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7fbef00736c0 msgr2=0x7fbef0075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.163:6816/1994135539,v1:172.21.15.163:6817/1994135539] conn(0x7fbef00736c0 0x7fbef0075b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbef006af30 msgr2=0x7fbef006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbef006af30 0x7fbef006d3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006fd0 tx=0x7fbef4008040 comp rx=0 tx=0).stop 2023-10-16T20:08:10.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0415df10 msgr2=0x7fbf04142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 --2- 172.21.15.152:0/2565564497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf0415df10 0x7fbf04142f60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00cc10 tx=0x7fbefc00cf20 comp rx=0 tx=0).stop 2023-10-16T20:08:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf08fd6700 1 -- 172.21.15.152:0/2565564497 reap_dead start 2023-10-16T20:08:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 shutdown_connections 2023-10-16T20:08:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 >> 172.21.15.152:0/2565564497 conn(0x7fbf040ccc90 msgr2=0x7fbf0415b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 shutdown_connections 2023-10-16T20:08:10.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.170+0000 7fbf0aa39700 1 -- 172.21.15.152:0/2565564497 wait complete. 2023-10-16T20:08:10.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-16T20:08:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.306+0000 7fcff0210700 1 Processor -- start 2023-10-16T20:08:10.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.306+0000 7fcff0210700 1 -- start start 2023-10-16T20:08:10.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcff0210700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcfe806a820 0x7fcfe80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcff0210700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe80ca7d0 0x7fcfe8071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcff0210700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe80cfeb0 con 0x7fcfe815e7f0 2023-10-16T20:08:10.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcff0210700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe80ce410 con 0x7fcfe806a820 2023-10-16T20:08:10.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcff0210700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe815ec50 con 0x7fcfe80ca7d0 2023-10-16T20:08:10.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcfe806a820 0x7fcfe80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcfe806a820 0x7fcfe80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33052/0 (socket says 172.21.15.152:33052) 2023-10-16T20:08:10.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 -- 172.21.15.152:0/1185021448 learned_addr learned my addr 172.21.15.152:0/1185021448 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfee7ad700 1 --2- 172.21.15.152:0/1185021448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe80ca7d0 0x7fcfe8071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 -- 172.21.15.152:0/1185021448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe80ca7d0 msgr2=0x7fcfe8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 --2- 172.21.15.152:0/1185021448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe80ca7d0 0x7fcfe8071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 -- 172.21.15.152:0/1185021448 >> v1:172.21.15.163:6789/0 conn(0x7fcfe815e7f0 legacy=0x7fcfe806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 -- 172.21.15.152:0/1185021448 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80af9d0 con 0x7fcfe806a820 2023-10-16T20:08:10.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfedfac700 1 --2- 172.21.15.152:0/1185021448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe80cf7d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40098f0 tx=0x7fcfe4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d3a854cc559ead server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.307+0000 7fcfecfaa700 1 -- 172.21.15.152:0/1185021448 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4004230 con 0x7fcfe806a820 2023-10-16T20:08:10.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcfecfaa700 1 -- 172.21.15.152:0/1185021448 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe4004390 con 0x7fcfe806a820 2023-10-16T20:08:10.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcfecfaa700 1 -- 172.21.15.152:0/1185021448 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40036a0 con 0x7fcfe806a820 2023-10-16T20:08:10.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 -- 172.21.15.152:0/1185021448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 msgr2=0x7fcfe80cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 --2- 172.21.15.152:0/1185021448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe80cf7d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40098f0 tx=0x7fcfe4009c00 comp rx=0 tx=0).stop 2023-10-16T20:08:10.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 -- 172.21.15.152:0/1185021448 shutdown_connections 2023-10-16T20:08:10.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 --2- 172.21.15.152:0/1185021448 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe80ca7d0 0x7fcfe8071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 --2- 172.21.15.152:0/1185021448 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe80cf7d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 -- 172.21.15.152:0/1185021448 >> 172.21.15.152:0/1185021448 conn(0x7fcfe80d0180 msgr2=0x7fcfe80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 -- 172.21.15.152:0/1185021448 shutdown_connections 2023-10-16T20:08:10.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.308+0000 7fcff0210700 1 -- 172.21.15.152:0/1185021448 wait complete. 2023-10-16T20:08:10.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.309+0000 7fcff0210700 1 Processor -- start 2023-10-16T20:08:10.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.309+0000 7fcff0210700 1 -- start start 2023-10-16T20:08:10.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcff0210700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcff0210700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfe80ca7d0 0x7fcfe80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcff0210700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe815e7f0 0x7fcfe80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcff0210700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8155cb0 con 0x7fcfe806a820 2023-10-16T20:08:10.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcff0210700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80ad7c0 con 0x7fcfe80ca7d0 2023-10-16T20:08:10.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcff0210700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe806ef20 con 0x7fcfe815e7f0 2023-10-16T20:08:10.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcfedfac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcfedfac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe8155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33058/0 (socket says 172.21.15.152:33058) 2023-10-16T20:08:10.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcfedfac700 1 -- 172.21.15.152:0/3104381550 learned_addr learned my addr 172.21.15.152:0/3104381550 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcfed7ab700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfe80ca7d0 0x7fcfe80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcfee7ad700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe815e7f0 0x7fcfe80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.310+0000 7fcfedfac700 1 -- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe815e7f0 msgr2=0x7fcfe80cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfedfac700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe815e7f0 0x7fcfe80cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfedfac700 1 -- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfe80ca7d0 msgr2=0x7fcfe80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfedfac700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfe80ca7d0 0x7fcfe80cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfedfac700 1 -- 172.21.15.152:0/3104381550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4009550 con 0x7fcfe806a820 2023-10-16T20:08:10.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfedfac700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe8155770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcfe806c8d0 tx=0x7fcfe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4003cd0 con 0x7fcfe806a820 2023-10-16T20:08:10.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe401f070 con 0x7fcfe806a820 2023-10-16T20:08:10.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe80ace90 con 0x7fcfe806a820 2023-10-16T20:08:10.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400b8a0 con 0x7fcfe806a820 2023-10-16T20:08:10.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.311+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe80ad450 con 0x7fcfe806a820 2023-10-16T20:08:10.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.312+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe80c9990 con 0x7fcfe806a820 2023-10-16T20:08:10.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.312+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcfe4021030 con 0x7fcfe806a820 2023-10-16T20:08:10.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.313+0000 7fcfde7fc700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcfcc06af00 0x7fcfcc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.313+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fcfe408ac10 con 0x7fcfe806a820 2023-10-16T20:08:10.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.313+0000 7fcfed7ab700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcfcc06af00 0x7fcfcc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.313+0000 7fcfed7ab700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcfcc06af00 0x7fcfcc06d3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80c3ac0 tx=0x7fcfd80090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.317+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcfe4055bf0 con 0x7fcfe806a820 2023-10-16T20:08:10.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.507+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe80af6f0 con 0x7fcfcc06af00 2023-10-16T20:08:10.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.507+0000 7fcfde7fc700 1 -- 172.21.15.152:0/3104381550 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcfd8009e00 con 0x7fcfcc06af00 2023-10-16T20:08:10.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.509+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcfcc06af00 msgr2=0x7fcfcc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.509+0000 7fcff0210700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcfcc06af00 0x7fcfcc06d3c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80c3ac0 tx=0x7fcfd80090e0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.509+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 msgr2=0x7fcfe8155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.509+0000 7fcff0210700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe8155770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcfe806c8d0 tx=0x7fcfe4004750 comp rx=0 tx=0).stop 2023-10-16T20:08:10.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.509+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 shutdown_connections 2023-10-16T20:08:10.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.509+0000 7fcff0210700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fcfcc06af00 0x7fcfcc06d3c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.510+0000 7fcff0210700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fcfe815e7f0 0x7fcfe80cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.510+0000 7fcff0210700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe806a820 0x7fcfe8155770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.510+0000 7fcff0210700 1 --2- 172.21.15.152:0/3104381550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcfe80ca7d0 0x7fcfe80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.510+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 >> 172.21.15.152:0/3104381550 conn(0x7fcfe80d0180 msgr2=0x7fcfe80b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.510+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 shutdown_connections 2023-10-16T20:08:10.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.510+0000 7fcff0210700 1 -- 172.21.15.152:0/3104381550 wait complete. 2023-10-16T20:08:10.515 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 4 to deep-scrub 2023-10-16T20:08:10.523 INFO:tasks.ceph:Scrubbing osd.5 2023-10-16T20:08:10.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:10.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.647+0000 7fd14fb70700 1 Processor -- start 2023-10-16T20:08:10.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.647+0000 7fd14fb70700 1 -- start start 2023-10-16T20:08:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14fb70700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd14815a250 0x7fd1480717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14fb70700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd14815dec0 0x7fd14806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.653 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14fb70700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1480cba90 con 0x7fd14815e350 2023-10-16T20:08:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14fb70700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1480cb510 con 0x7fd14815a250 2023-10-16T20:08:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14fb70700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14815ee40 con 0x7fd14815dec0 2023-10-16T20:08:10.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14d90c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd14815a250 0x7fd1480717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14d90c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd14815a250 0x7fd1480717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33066/0 (socket says 172.21.15.152:33066) 2023-10-16T20:08:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.648+0000 7fd14d90c700 1 -- 172.21.15.152:0/2415186538 learned_addr learned my addr 172.21.15.152:0/2415186538 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14d10b700 1 --2- 172.21.15.152:0/2415186538 >> v2:172.21.15.163:3300/0 conn(0x7fd14815dec0 0x7fd14806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14d90c700 1 -- 172.21.15.152:0/2415186538 >> v2:172.21.15.163:3300/0 conn(0x7fd14815dec0 msgr2=0x7fd14806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14d90c700 1 --2- 172.21.15.152:0/2415186538 >> v2:172.21.15.163:3300/0 conn(0x7fd14815dec0 0x7fd14806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14d90c700 1 -- 172.21.15.152:0/2415186538 >> v1:172.21.15.163:6789/0 conn(0x7fd14815e350 legacy=0x7fd1480cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14d90c700 1 -- 172.21.15.152:0/2415186538 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14815e880 con 0x7fd14815a250 2023-10-16T20:08:10.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14d90c700 1 --2- 172.21.15.152:0/2415186538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815a250 0x7fd1480717b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd1480af840 tx=0x7fd138009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f28c57efed9c762 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14c90a700 1 -- 172.21.15.152:0/2415186538 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800b870 con 0x7fd14815a250 2023-10-16T20:08:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14c90a700 1 -- 172.21.15.152:0/2415186538 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800b9d0 con 0x7fd14815a250 2023-10-16T20:08:10.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.649+0000 7fd14c90a700 1 -- 172.21.15.152:0/2415186538 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800bd60 con 0x7fd14815a250 2023-10-16T20:08:10.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 -- 172.21.15.152:0/2415186538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815a250 msgr2=0x7fd1480717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 --2- 172.21.15.152:0/2415186538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815a250 0x7fd1480717b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd1480af840 tx=0x7fd138009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 -- 172.21.15.152:0/2415186538 shutdown_connections 2023-10-16T20:08:10.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 --2- 172.21.15.152:0/2415186538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815a250 0x7fd1480717b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 --2- 172.21.15.152:0/2415186538 >> v2:172.21.15.163:3300/0 conn(0x7fd14815dec0 0x7fd14806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 -- 172.21.15.152:0/2415186538 >> 172.21.15.152:0/2415186538 conn(0x7fd1480ccbe0 msgr2=0x7fd1480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 -- 172.21.15.152:0/2415186538 shutdown_connections 2023-10-16T20:08:10.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.650+0000 7fd14fb70700 1 -- 172.21.15.152:0/2415186538 wait complete. 2023-10-16T20:08:10.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.651+0000 7fd14fb70700 1 Processor -- start 2023-10-16T20:08:10.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.651+0000 7fd14fb70700 1 -- start start 2023-10-16T20:08:10.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd14815a250 0x7fd148167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd14815dec0 0x7fd14814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815e350 0x7fd148166990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480b3310 con 0x7fd14815e350 2023-10-16T20:08:10.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480c5e40 con 0x7fd14815dec0 2023-10-16T20:08:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd148166260 con 0x7fd14815a250 2023-10-16T20:08:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815e350 0x7fd148166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815e350 0x7fd148166990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33076/0 (socket says 172.21.15.152:33076) 2023-10-16T20:08:10.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 -- 172.21.15.152:0/4021199711 learned_addr learned my addr 172.21.15.152:0/4021199711 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14d10b700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd14815dec0 0x7fd14814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14d90c700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd14815a250 0x7fd148167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 -- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd14815a250 msgr2=0x7fd148167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd14815a250 0x7fd148167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 -- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd14815dec0 msgr2=0x7fd14814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd14815dec0 0x7fd14814a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 -- 172.21.15.152:0/4021199711 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009550 con 0x7fd14815e350 2023-10-16T20:08:10.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14e10d700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815e350 0x7fd148166990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd14000cc50 tx=0x7fd14000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140003c00 con 0x7fd14815e350 2023-10-16T20:08:10.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140003d60 con 0x7fd14815e350 2023-10-16T20:08:10.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1480c6050 con 0x7fd14815e350 2023-10-16T20:08:10.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.652+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14000aab0 con 0x7fd14815e350 2023-10-16T20:08:10.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.653+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1480c69c0 con 0x7fd14815e350 2023-10-16T20:08:10.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.653+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1480cb720 con 0x7fd14815e350 2023-10-16T20:08:10.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd14000ac10 con 0x7fd14815e350 2023-10-16T20:08:10.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd13e7fc700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd12c06af00 0x7fd12c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd1400896a0 con 0x7fd14815e350 2023-10-16T20:08:10.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd14d90c700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd12c06af00 0x7fd12c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd13e7fc700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7fd12c073690 0x7fd12c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 --> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd12c0761e0 con 0x7fd12c073690 2023-10-16T20:08:10.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.654+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd14008bd60 con 0x7fd14815e350 2023-10-16T20:08:10.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.655+0000 7fd14d10b700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7fd12c073690 0x7fd12c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.655+0000 7fd14d90c700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd12c06af00 0x7fd12c06d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd138000c00 tx=0x7fd138008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.655+0000 7fd14d10b700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7fd12c073690 0x7fd12c075b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.656+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== osd.5 v2:172.21.15.163:6808/792269555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd12c0761e0 con 0x7fd12c073690 2023-10-16T20:08:10.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.670+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 --> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd14815eb60 con 0x7fd12c073690 2023-10-16T20:08:10.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd13e7fc700 1 -- 172.21.15.152:0/4021199711 <== osd.5 v2:172.21.15.163:6808/792269555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd1440076b0 con 0x7fd12c073690 2023-10-16T20:08:10.674 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:10.675 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:10.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7fd12c073690 msgr2=0x7fd12c075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.163:6808/792269555,v1:172.21.15.163:6809/792269555] conn(0x7fd12c073690 0x7fd12c075b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd12c06af00 msgr2=0x7fd12c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd12c06af00 0x7fd12c06d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd138000c00 tx=0x7fd138008030 comp rx=0 tx=0).stop 2023-10-16T20:08:10.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815e350 msgr2=0x7fd148166990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 --2- 172.21.15.152:0/4021199711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd14815e350 0x7fd148166990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd14000cc50 tx=0x7fd14000cf60 comp rx=0 tx=0).stop 2023-10-16T20:08:10.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14e10d700 1 -- 172.21.15.152:0/4021199711 reap_dead start 2023-10-16T20:08:10.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 shutdown_connections 2023-10-16T20:08:10.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 >> 172.21.15.152:0/4021199711 conn(0x7fd1480ccbe0 msgr2=0x7fd14806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 shutdown_connections 2023-10-16T20:08:10.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.671+0000 7fd14fb70700 1 -- 172.21.15.152:0/4021199711 wait complete. 2023-10-16T20:08:10.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-16T20:08:10.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.805+0000 7ff1ccee6700 1 Processor -- start 2023-10-16T20:08:10.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.805+0000 7ff1ccee6700 1 -- start start 2023-10-16T20:08:10.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.806+0000 7ff1ccee6700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff1c806a820 0x7ff1c80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.806+0000 7ff1ccee6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c80cfeb0 con 0x7ff1c815e7f0 2023-10-16T20:08:10.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.806+0000 7ff1ccee6700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c815ec50 con 0x7ff1c80ca7d0 2023-10-16T20:08:10.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.806+0000 7ff1ccee6700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c80ce410 con 0x7ff1c806a820 2023-10-16T20:08:10.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.806+0000 7ff1c5d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff1c815e7f0 0x7ff1c806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41514/0 (socket says 172.21.15.152:41514) 2023-10-16T20:08:10.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.806+0000 7ff1c5d9b700 1 -- 172.21.15.152:0/932826910 learned_addr learned my addr 172.21.15.152:0/932826910 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 --2- 172.21.15.152:0/932826910 >> v2:172.21.15.163:3300/0 conn(0x7ff1c806a820 0x7ff1c80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477806162 0 0) 0x7ff1c80cfeb0 con 0x7ff1c815e7f0 2023-10-16T20:08:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b00035b0 con 0x7ff1c815e7f0 2023-10-16T20:08:10.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55095389 0 0) 0x7ff1b00035b0 con 0x7ff1c815e7f0 2023-10-16T20:08:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 >> v2:172.21.15.163:3300/0 conn(0x7ff1c806a820 msgr2=0x7ff1c80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 --2- 172.21.15.152:0/932826910 >> v2:172.21.15.163:3300/0 conn(0x7ff1c806a820 0x7ff1c80cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 >> v1:172.21.15.163:6789/0 conn(0x7ff1c80ca7d0 legacy=0x7ff1c8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80af9d0 con 0x7ff1c815e7f0 2023-10-16T20:08:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7ff1b8001670 con 0x7ff1c815e7f0 2023-10-16T20:08:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 >> v1:172.21.15.152:6789/0 conn(0x7ff1c815e7f0 legacy=0x7ff1c806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1b0003a00 0x7ff1b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1b0004850 0x7ff1b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0005210 0x7ff1b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80ce410 con 0x7ff1b0003a00 2023-10-16T20:08:10.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b000c1b0 con 0x7ff1b0005210 2023-10-16T20:08:10.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b000c370 con 0x7ff1b0004850 2023-10-16T20:08:10.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1b0003a00 0x7ff1b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c5d9b700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1b0004850 0x7ff1b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c6d9d700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0005210 0x7ff1b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 -- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1b0004850 msgr2=0x7ff1b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1b0004850 0x7ff1b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 -- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0005210 msgr2=0x7ff1b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:10.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0005210 0x7ff1b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c6d9d700 1 -- 172.21.15.152:0/932826910 reap_dead start 2023-10-16T20:08:10.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c659c700 1 -- 172.21.15.152:0/932826910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00035b0 con 0x7ff1b0003a00 2023-10-16T20:08:10.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.807+0000 7ff1c5d9b700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1b0004850 0x7ff1b0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:10.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1c659c700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1b0003a00 0x7ff1b0003e20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009b60 tx=0x7ff1b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da69f7295c3b960 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00e6c0 con 0x7ff1b0003a00 2023-10-16T20:08:10.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00e820 con 0x7ff1b0003a00 2023-10-16T20:08:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1c559a700 1 -- 172.21.15.152:0/932826910 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00eb90 con 0x7ff1b0003a00 2023-10-16T20:08:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 -- 172.21.15.152:0/932826910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1b0003a00 msgr2=0x7ff1b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1b0003a00 0x7ff1b0003e20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009b60 tx=0x7ff1b0005880 comp rx=0 tx=0).stop 2023-10-16T20:08:10.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 -- 172.21.15.152:0/932826910 shutdown_connections 2023-10-16T20:08:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/932826910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1b0003a00 0x7ff1b0003e20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 -- 172.21.15.152:0/932826910 >> 172.21.15.152:0/932826910 conn(0x7ff1c80d0180 msgr2=0x7ff1c80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 -- 172.21.15.152:0/932826910 shutdown_connections 2023-10-16T20:08:10.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.808+0000 7ff1ccee6700 1 -- 172.21.15.152:0/932826910 wait complete. 2023-10-16T20:08:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 Processor -- start 2023-10-16T20:08:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 -- start start 2023-10-16T20:08:10.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0003a00 0x7ff1c80ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1c81f28f0 0x7ff1c815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 0x7ff1c80c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c81608e0 con 0x7ff1c8160460 2023-10-16T20:08:10.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80c5580 con 0x7ff1b0003a00 2023-10-16T20:08:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.810+0000 7ff1ccee6700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80c5860 con 0x7ff1c81f28f0 2023-10-16T20:08:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 0x7ff1c80c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 0x7ff1c80c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33098/0 (socket says 172.21.15.152:33098) 2023-10-16T20:08:10.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 -- 172.21.15.152:0/797868821 learned_addr learned my addr 172.21.15.152:0/797868821 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c659c700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0003a00 0x7ff1c80ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c5d9b700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1c81f28f0 0x7ff1c815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 -- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1c81f28f0 msgr2=0x7ff1c815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1c81f28f0 0x7ff1c815ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 -- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0003a00 msgr2=0x7ff1c80ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0003a00 0x7ff1c80ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:10.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 -- 172.21.15.152:0/797868821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80c5b40 con 0x7ff1c8160460 2023-10-16T20:08:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c5d9b700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1c81f28f0 0x7ff1c815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1c6d9d700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 0x7ff1c80c3c90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80d00e0 tx=0x7ff1c000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0003c60 con 0x7ff1c8160460 2023-10-16T20:08:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0003e00 con 0x7ff1c8160460 2023-10-16T20:08:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c80c5e20 con 0x7ff1c8160460 2023-10-16T20:08:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0005310 con 0x7ff1c8160460 2023-10-16T20:08:10.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.811+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80add40 con 0x7ff1c8160460 2023-10-16T20:08:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.812+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c80c6340 con 0x7ff1c8160460 2023-10-16T20:08:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.813+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff1c0005470 con 0x7ff1c8160460 2023-10-16T20:08:10.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.813+0000 7ff1b6ffd700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff1a806af00 0x7ff1a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.813+0000 7ff1c659c700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff1a806af00 0x7ff1a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:10.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.813+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff1c0089630 con 0x7ff1c8160460 2023-10-16T20:08:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.814+0000 7ff1c659c700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff1a806af00 0x7ff1a806d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0090b0 tx=0x7ff1bc01e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:10.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:10.818+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1c80c6340 con 0x7ff1c8160460 2023-10-16T20:08:11.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.008+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1c80af6f0 con 0x7ff1a806af00 2023-10-16T20:08:11.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.009+0000 7ff1b6ffd700 1 -- 172.21.15.152:0/797868821 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff1bc00ea10 con 0x7ff1a806af00 2023-10-16T20:08:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff1a806af00 msgr2=0x7ff1a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff1a806af00 0x7ff1a806d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0090b0 tx=0x7ff1bc01e040 comp rx=0 tx=0).stop 2023-10-16T20:08:11.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 msgr2=0x7ff1c80c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 0x7ff1c80c3c90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80d00e0 tx=0x7ff1c000edd0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 shutdown_connections 2023-10-16T20:08:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff1a806af00 0x7ff1a806d3c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1c8160460 0x7ff1c80c3c90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1b0003a00 0x7ff1c80ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 --2- 172.21.15.152:0/797868821 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff1c81f28f0 0x7ff1c815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 >> 172.21.15.152:0/797868821 conn(0x7ff1c80d0180 msgr2=0x7ff1c815db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 shutdown_connections 2023-10-16T20:08:11.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.011+0000 7ff1ccee6700 1 -- 172.21.15.152:0/797868821 wait complete. 2023-10-16T20:08:11.017 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 5 to deep-scrub 2023-10-16T20:08:11.025 INFO:tasks.ceph:Scrubbing osd.6 2023-10-16T20:08:11.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:11.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.150+0000 7fc2af546700 1 Processor -- start 2023-10-16T20:08:11.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.150+0000 7fc2af546700 1 -- start start 2023-10-16T20:08:11.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2af546700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc2a80ce440 0x7fc2a815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2af546700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a8161360 con 0x7fc2a806a820 2023-10-16T20:08:11.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2af546700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a806b750 con 0x7fc2a806b370 2023-10-16T20:08:11.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2af546700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a806dcc0 con 0x7fc2a80ce440 2023-10-16T20:08:11.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2adae3700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc2a80ce440 0x7fc2a815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2acae1700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc2a806a820 0x7fc2a80cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41532/0 (socket says 172.21.15.152:41532) 2023-10-16T20:08:11.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2acae1700 1 -- 172.21.15.152:0/1071649185 learned_addr learned my addr 172.21.15.152:0/1071649185 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:11.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2adae3700 1 -- 172.21.15.152:0/1071649185 >> v1:172.21.15.163:6789/0 conn(0x7fc2a806b370 legacy=0x7fc2a806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:11.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2adae3700 1 -- 172.21.15.152:0/1071649185 >> v1:172.21.15.152:6789/0 conn(0x7fc2a806a820 legacy=0x7fc2a80cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc29ffff700 1 -- 172.21.15.152:0/1071649185 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475582152 0 0) 0x7fc2a8161360 con 0x7fc2a806a820 2023-10-16T20:08:11.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.151+0000 7fc2adae3700 1 -- 172.21.15.152:0/1071649185 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a815e300 con 0x7fc2a80ce440 2023-10-16T20:08:11.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2adae3700 1 --2- 172.21.15.152:0/1071649185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a80ce440 0x7fc2a815dcb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009dc0 tx=0x7fc2a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331a723d4e1bfb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc29ffff700 1 -- 172.21.15.152:0/1071649185 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000e070 con 0x7fc2a80ce440 2023-10-16T20:08:11.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc29ffff700 1 -- 172.21.15.152:0/1071649185 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000bb50 con 0x7fc2a80ce440 2023-10-16T20:08:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc29ffff700 1 -- 172.21.15.152:0/1071649185 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0003a20 con 0x7fc2a80ce440 2023-10-16T20:08:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 -- 172.21.15.152:0/1071649185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a80ce440 msgr2=0x7fc2a815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 --2- 172.21.15.152:0/1071649185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a80ce440 0x7fc2a815dcb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009dc0 tx=0x7fc2a000b330 comp rx=0 tx=0).stop 2023-10-16T20:08:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 -- 172.21.15.152:0/1071649185 shutdown_connections 2023-10-16T20:08:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 --2- 172.21.15.152:0/1071649185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a80ce440 0x7fc2a815dcb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 -- 172.21.15.152:0/1071649185 >> 172.21.15.152:0/1071649185 conn(0x7fc2a80ccbe0 msgr2=0x7fc2a80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 -- 172.21.15.152:0/1071649185 shutdown_connections 2023-10-16T20:08:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.152+0000 7fc2af546700 1 -- 172.21.15.152:0/1071649185 wait complete. 2023-10-16T20:08:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.154+0000 7fc2af546700 1 Processor -- start 2023-10-16T20:08:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.154+0000 7fc2af546700 1 -- start start 2023-10-16T20:08:11.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2af546700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a806a820 0x7fc2a81567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2af546700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2a806b370 0x7fc2a80b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2af546700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2a80ce440 0x7fc2a80cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2af546700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80b5190 con 0x7fc2a806a820 2023-10-16T20:08:11.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2af546700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80b3cf0 con 0x7fc2a806b370 2023-10-16T20:08:11.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2af546700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a815f830 con 0x7fc2a80ce440 2023-10-16T20:08:11.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a806a820 0x7fc2a81567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a806a820 0x7fc2a81567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33108/0 (socket says 172.21.15.152:33108) 2023-10-16T20:08:11.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 -- 172.21.15.152:0/286678889 learned_addr learned my addr 172.21.15.152:0/286678889 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:11.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2acae1700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2a806b370 0x7fc2a80b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2adae3700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2a80ce440 0x7fc2a80cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 -- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2a80ce440 msgr2=0x7fc2a80cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fc2a80ce440 0x7fc2a80cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 -- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2a806b370 msgr2=0x7fc2a80b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2a806b370 0x7fc2a80b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.155+0000 7fc2ad2e2700 1 -- 172.21.15.152:0/286678889 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009a70 con 0x7fc2a806a820 2023-10-16T20:08:11.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.156+0000 7fc2ad2e2700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a806a820 0x7fc2a81567f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b4a0 tx=0x7fc2a400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.156+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011830 con 0x7fc2a806a820 2023-10-16T20:08:11.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.156+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4011990 con 0x7fc2a806a820 2023-10-16T20:08:11.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.156+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80b4580 con 0x7fc2a806a820 2023-10-16T20:08:11.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.156+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011d40 con 0x7fc2a806a820 2023-10-16T20:08:11.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.156+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a80b4b40 con 0x7fc2a806a820 2023-10-16T20:08:11.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.157+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2a815e8c0 con 0x7fc2a806a820 2023-10-16T20:08:11.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.157+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc2a401a400 con 0x7fc2a806a820 2023-10-16T20:08:11.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc29dffb700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc28c06af30 0x7fc28c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc2a40892f0 con 0x7fc2a806a820 2023-10-16T20:08:11.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc2acae1700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc28c06af30 0x7fc28c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc29dffb700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fc28c0736c0 0x7fc28c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 --> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc28c076210 con 0x7fc28c0736c0 2023-10-16T20:08:11.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a408b9b0 con 0x7fc2a806a820 2023-10-16T20:08:11.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc2acae1700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc28c06af30 0x7fc28c06d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc298000f60 tx=0x7fc298007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc2adae3700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fc28c0736c0 0x7fc28c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.158+0000 7fc2adae3700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fc28c0736c0 0x7fc28c075b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.159+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== osd.6 v2:172.21.15.163:6800/2738585885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc28c076210 con 0x7fc28c0736c0 2023-10-16T20:08:11.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.174+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 --> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2a815e5e0 con 0x7fc28c0736c0 2023-10-16T20:08:11.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.174+0000 7fc29dffb700 1 -- 172.21.15.152:0/286678889 <== osd.6 v2:172.21.15.163:6800/2738585885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc2a0003c80 con 0x7fc28c0736c0 2023-10-16T20:08:11.177 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:11.178 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:11.178 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:11.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.174+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fc28c0736c0 msgr2=0x7fc28c075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.174+0000 7fc2af546700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.163:6800/2738585885,v1:172.21.15.163:6801/2738585885] conn(0x7fc28c0736c0 0x7fc28c075b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc28c06af30 msgr2=0x7fc28c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fc28c06af30 0x7fc28c06d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc298000f60 tx=0x7fc298007e70 comp rx=0 tx=0).stop 2023-10-16T20:08:11.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a806a820 msgr2=0x7fc2a81567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 --2- 172.21.15.152:0/286678889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2a806a820 0x7fc2a81567f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b4a0 tx=0x7fc2a400b7b0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2adae3700 1 -- 172.21.15.152:0/286678889 reap_dead start 2023-10-16T20:08:11.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 shutdown_connections 2023-10-16T20:08:11.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 >> 172.21.15.152:0/286678889 conn(0x7fc2a80ccbe0 msgr2=0x7fc2a8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 shutdown_connections 2023-10-16T20:08:11.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.175+0000 7fc2af546700 1 -- 172.21.15.152:0/286678889 wait complete. 2023-10-16T20:08:11.188 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-16T20:08:11.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.308+0000 7f4157a3d700 1 Processor -- start 2023-10-16T20:08:11.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.308+0000 7f4157a3d700 1 -- start start 2023-10-16T20:08:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4157a3d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 0x7f415006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4157a3d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500cb3b0 con 0x7f41500ced40 2023-10-16T20:08:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4157a3d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500cb690 con 0x7f415015dea0 2023-10-16T20:08:11.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4157a3d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500cb970 con 0x7f41500ce960 2023-10-16T20:08:11.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4154fd8700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f41500ced40 0x7f41500cab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41548/0 (socket says 172.21.15.152:41548) 2023-10-16T20:08:11.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4154fd8700 1 -- 172.21.15.152:0/2596597722 learned_addr learned my addr 172.21.15.152:0/2596597722 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:11.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f41557d9700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 0x7f415006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488181320 0 0) 0x7f41500cb3b0 con 0x7f41500ced40 2023-10-16T20:08:11.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f413c0035b0 con 0x7f41500ced40 2023-10-16T20:08:11.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006285071 0 0) 0x7f413c0035b0 con 0x7f41500ced40 2023-10-16T20:08:11.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 msgr2=0x7f415006e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:11.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 0x7f415006e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 >> v1:172.21.15.163:6789/0 conn(0x7f415015dea0 legacy=0x7f4150157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500cbc50 con 0x7f41500ced40 2023-10-16T20:08:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f4140001670 con 0x7f41500ced40 2023-10-16T20:08:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.309+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 >> v1:172.21.15.152:6789/0 conn(0x7f41500ced40 legacy=0x7f41500cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.323 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f413c003a30 0x7f413c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 0x7f413c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413c004d90 0x7f413c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500cb970 con 0x7f413c004d90 2023-10-16T20:08:11.324 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c00bac0 con 0x7f413c003a30 2023-10-16T20:08:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c00bc30 con 0x7f41500ce960 2023-10-16T20:08:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413c004d90 0x7f413c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4154fd8700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 0x7f413c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.325 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f41557d9700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f413c003a30 0x7f413c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 -- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 msgr2=0x7f413c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f41500ce960 0x7f413c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 -- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f413c003a30 msgr2=0x7f413c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f413c003a30 0x7f413c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 -- 172.21.15.152:0/2596597722 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0035b0 con 0x7f413c004d90 2023-10-16T20:08:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4155fda700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413c004d90 0x7f413c005210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f414800c290 tx=0x7f413c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976342b28dd505ed server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148001e70 con 0x7f413c004d90 2023-10-16T20:08:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800ce50 con 0x7f413c004d90 2023-10-16T20:08:11.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.310+0000 7f4147fff700 1 -- 172.21.15.152:0/2596597722 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148012660 con 0x7f413c004d90 2023-10-16T20:08:11.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4157a3d700 1 -- 172.21.15.152:0/2596597722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413c004d90 msgr2=0x7f413c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2596597722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f413c004d90 0x7f413c005210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f414800c290 tx=0x7f413c005880 comp rx=0 tx=0).stop 2023-10-16T20:08:11.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4155fda700 1 -- 172.21.15.152:0/2596597722 reap_dead start 2023-10-16T20:08:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4157a3d700 1 -- 172.21.15.152:0/2596597722 shutdown_connections 2023-10-16T20:08:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4157a3d700 1 -- 172.21.15.152:0/2596597722 >> 172.21.15.152:0/2596597722 conn(0x7f41500cfcd0 msgr2=0x7f41500d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4157a3d700 1 -- 172.21.15.152:0/2596597722 shutdown_connections 2023-10-16T20:08:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.311+0000 7f4157a3d700 1 -- 172.21.15.152:0/2596597722 wait complete. 2023-10-16T20:08:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.312+0000 7f4157a3d700 1 Processor -- start 2023-10-16T20:08:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.312+0000 7f4157a3d700 1 -- start start 2023-10-16T20:08:11.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4157a3d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4150159f90 0x7f41500ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4157a3d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 0x7f41500af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4157a3d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f415015a370 0x7f41500b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4157a3d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500b01f0 con 0x7f41500c7070 2023-10-16T20:08:11.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4157a3d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500b04d0 con 0x7f415015a370 2023-10-16T20:08:11.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4157a3d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41500c49e0 con 0x7f4150159f90 2023-10-16T20:08:11.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 0x7f41500af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 0x7f41500af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33130/0 (socket says 172.21.15.152:33130) 2023-10-16T20:08:11.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 -- 172.21.15.152:0/2262292558 learned_addr learned my addr 172.21.15.152:0/2262292558 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:11.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f41557d9700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4150159f90 0x7f41500ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4155fda700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f415015a370 0x7f41500b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 -- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4150159f90 msgr2=0x7f41500ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4150159f90 0x7f41500ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 -- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f415015a370 msgr2=0x7f41500b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f415015a370 0x7f41500b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.313+0000 7f4154fd8700 1 -- 172.21.15.152:0/2262292558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500c4cc0 con 0x7f41500c7070 2023-10-16T20:08:11.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.314+0000 7f4154fd8700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 0x7f41500af9a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f41400048d0 tx=0x7f4140007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.314+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140012560 con 0x7f41500c7070 2023-10-16T20:08:11.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.314+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400126c0 con 0x7f41500c7070 2023-10-16T20:08:11.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.314+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41500c4fa0 con 0x7f41500c7070 2023-10-16T20:08:11.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.314+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140012a30 con 0x7f41500c7070 2023-10-16T20:08:11.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.314+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41500b49e0 con 0x7f41500c7070 2023-10-16T20:08:11.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.315+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500c51c0 con 0x7f41500c7070 2023-10-16T20:08:11.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.315+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4140012b90 con 0x7f41500c7070 2023-10-16T20:08:11.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.315+0000 7f4145ffb700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f413406af00 0x7f413406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.315+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f41400896a0 con 0x7f41500c7070 2023-10-16T20:08:11.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.316+0000 7f41557d9700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f413406af00 0x7f413406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.316+0000 7f41557d9700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f413406af00 0x7f413406d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f415015abb0 tx=0x7f414c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.320+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4140054600 con 0x7f41500c7070 2023-10-16T20:08:11.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.509+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f41500cbf30 con 0x7f413406af00 2023-10-16T20:08:11.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.509+0000 7f4145ffb700 1 -- 172.21.15.152:0/2262292558 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f414c019070 con 0x7f413406af00 2023-10-16T20:08:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f413406af00 msgr2=0x7f413406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f413406af00 0x7f413406d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f415015abb0 tx=0x7f414c009210 comp rx=0 tx=0).stop 2023-10-16T20:08:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 msgr2=0x7f41500af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 0x7f41500af9a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f41400048d0 tx=0x7f4140007570 comp rx=0 tx=0).stop 2023-10-16T20:08:11.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 shutdown_connections 2023-10-16T20:08:11.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f413406af00 0x7f413406d3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4150159f90 0x7f41500ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f415015a370 0x7f41500b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 --2- 172.21.15.152:0/2262292558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41500c7070 0x7f41500af9a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 >> 172.21.15.152:0/2262292558 conn(0x7f41500cfcd0 msgr2=0x7f415015bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 shutdown_connections 2023-10-16T20:08:11.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.512+0000 7f4157a3d700 1 -- 172.21.15.152:0/2262292558 wait complete. 2023-10-16T20:08:11.518 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 6 to deep-scrub 2023-10-16T20:08:11.526 INFO:tasks.ceph:Scrubbing osd.7 2023-10-16T20:08:11.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-16T20:08:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.650+0000 7fbdd531d700 1 Processor -- start 2023-10-16T20:08:11.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.650+0000 7fbdd531d700 1 -- start start 2023-10-16T20:08:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.650+0000 7fbdd531d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbdd00b32e0 0x7fbdd015e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.650+0000 7fbdd531d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00cf560 0x7fbdd006bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.650+0000 7fbdd531d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00d15e0 con 0x7fbdd00d0d40 2023-10-16T20:08:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.650+0000 7fbdd531d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00d2160 con 0x7fbdd00b32e0 2023-10-16T20:08:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdd531d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00d18c0 con 0x7fbdd00cf560 2023-10-16T20:08:11.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00cf560 0x7fbdd006bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdceffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbdd00b32e0 0x7fbdd015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00cf560 0x7fbdd006bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3301/0 says I am v2:172.21.15.152:50022/0 (socket says 172.21.15.152:50022) 2023-10-16T20:08:11.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdce7fc700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fbdd00d0d40 0x7fbdd00cee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.152:56746/0 (socket says 172.21.15.152:56746) 2023-10-16T20:08:11.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdcf7fe700 1 -- 172.21.15.152:0/3439369156 learned_addr learned my addr 172.21.15.152:0/3439369156 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:11.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdceffd700 1 -- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00cf560 msgr2=0x7fbdd006bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:11.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdceffd700 1 --2- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00cf560 0x7fbdd006bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdceffd700 1 -- 172.21.15.152:0/3439369156 >> v1:172.21.15.163:6789/0 conn(0x7fbdd00d0d40 legacy=0x7fbdd00cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdceffd700 1 -- 172.21.15.152:0/3439369156 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00d1ba0 con 0x7fbdd00b32e0 2023-10-16T20:08:11.658 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.651+0000 7fbdceffd700 1 --2- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00b32e0 0x7fbdd015e710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009840 tx=0x7fbdc4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=979b85d86874e123 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdcdffb700 1 -- 172.21.15.152:0/3439369156 <== mon.1 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4011830 con 0x7fbdd00b32e0 2023-10-16T20:08:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdcdffb700 1 -- 172.21.15.152:0/3439369156 <== mon.1 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4011990 con 0x7fbdd00b32e0 2023-10-16T20:08:11.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdcdffb700 1 -- 172.21.15.152:0/3439369156 <== mon.1 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4011d20 con 0x7fbdd00b32e0 2023-10-16T20:08:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 -- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00b32e0 msgr2=0x7fbdd015e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 --2- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00b32e0 0x7fbdd015e710 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009840 tx=0x7fbdc4009b50 comp rx=0 tx=0).stop 2023-10-16T20:08:11.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 -- 172.21.15.152:0/3439369156 shutdown_connections 2023-10-16T20:08:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 --2- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00cf560 0x7fbdd006bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 --2- 172.21.15.152:0/3439369156 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00b32e0 0x7fbdd015e710 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 -- 172.21.15.152:0/3439369156 >> 172.21.15.152:0/3439369156 conn(0x7fbdd006a820 msgr2=0x7fbdd006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 -- 172.21.15.152:0/3439369156 shutdown_connections 2023-10-16T20:08:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.652+0000 7fbdd531d700 1 -- 172.21.15.152:0/3439369156 wait complete. 2023-10-16T20:08:11.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.653+0000 7fbdd531d700 1 Processor -- start 2023-10-16T20:08:11.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 -- start start 2023-10-16T20:08:11.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00b32e0 0x7fbdd01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00cf560 0x7fbdd00ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdd00d0d40 0x7fbdd00ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00b5f60 con 0x7fbdd00d0d40 2023-10-16T20:08:11.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00b6240 con 0x7fbdd00cf560 2023-10-16T20:08:11.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdd531d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00b6520 con 0x7fbdd00b32e0 2023-10-16T20:08:11.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdd00d0d40 0x7fbdd00ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdd00d0d40 0x7fbdd00ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33140/0 (socket says 172.21.15.152:33140) 2023-10-16T20:08:11.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdcf7fe700 1 -- 172.21.15.152:0/3770613753 learned_addr learned my addr 172.21.15.152:0/3770613753 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:11.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdce7fc700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00cf560 0x7fbdd00ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.654+0000 7fbdceffd700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00b32e0 0x7fbdd01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.669 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdcf7fe700 1 -- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00b32e0 msgr2=0x7fbdd01595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdcf7fe700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fbdd00b32e0 0x7fbdd01595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdcf7fe700 1 -- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00cf560 msgr2=0x7fbdd00ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdcf7fe700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbdd00cf560 0x7fbdd00ac950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdcf7fe700 1 -- 172.21.15.152:0/3770613753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40094a0 con 0x7fbdd00d0d40 2023-10-16T20:08:11.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdcf7fe700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdd00d0d40 0x7fbdd00ace90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800efc0 tx=0x7fbdc800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8003c20 con 0x7fbdd00d0d40 2023-10-16T20:08:11.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800f040 con 0x7fbdd00d0d40 2023-10-16T20:08:11.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd00b6800 con 0x7fbdd00d0d40 2023-10-16T20:08:11.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8009e30 con 0x7fbdd00d0d40 2023-10-16T20:08:11.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.655+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0146c70 con 0x7fbdd00d0d40 2023-10-16T20:08:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.656+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdd00b36c0 con 0x7fbdd00d0d40 2023-10-16T20:08:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.656+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbdc800c880 con 0x7fbdd00d0d40 2023-10-16T20:08:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdb77fe700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fbdc8089950 con 0x7fbdd00d0d40 2023-10-16T20:08:11.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdceffd700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdb77fe700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7fbdbc073690 0x7fbdbc075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 --> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdbc0761e0 con 0x7fbdbc073690 2023-10-16T20:08:11.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdc808e2c0 con 0x7fbdd00d0d40 2023-10-16T20:08:11.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdce7fc700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7fbdbc073690 0x7fbdbc075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.657+0000 7fbdceffd700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4000c00 tx=0x7fbdc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.658+0000 7fbdce7fc700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7fbdbc073690 0x7fbdbc075b10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.658+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== osd.7 v2:172.21.15.163:6824/3318028264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbdbc0761e0 con 0x7fbdbc073690 2023-10-16T20:08:11.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.673+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 --> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbdd00d1e80 con 0x7fbdbc073690 2023-10-16T20:08:11.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.673+0000 7fbdb77fe700 1 -- 172.21.15.152:0/3770613753 <== osd.7 v2:172.21.15.163:6824/3318028264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbdc0004b10 con 0x7fbdbc073690 2023-10-16T20:08:11.677 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-10-16T20:08:11.677 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T20:08:11.678 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-10-16T20:08:11.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7fbdbc073690 msgr2=0x7fbdbc075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.163:6824/3318028264,v1:172.21.15.163:6825/3318028264] conn(0x7fbdbc073690 0x7fbdbc075b10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbdbc06af00 msgr2=0x7fbdbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4000c00 tx=0x7fbdc4008030 comp rx=0 tx=0).stop 2023-10-16T20:08:11.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdd00d0d40 msgr2=0x7fbdd00ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 --2- 172.21.15.152:0/3770613753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdd00d0d40 0x7fbdd00ace90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800efc0 tx=0x7fbdc800c3a0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdcf7fe700 1 -- 172.21.15.152:0/3770613753 reap_dead start 2023-10-16T20:08:11.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 shutdown_connections 2023-10-16T20:08:11.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 >> 172.21.15.152:0/3770613753 conn(0x7fbdd006a820 msgr2=0x7fbdd015fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 shutdown_connections 2023-10-16T20:08:11.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.674+0000 7fbdd531d700 1 -- 172.21.15.152:0/3770613753 wait complete. 2023-10-16T20:08:11.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-16T20:08:11.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.807+0000 7f9b2261d700 1 Processor -- start 2023-10-16T20:08:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b2261d700 1 -- start start 2023-10-16T20:08:11.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b2261d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9b1c06a820 0x7f9b1c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b2261d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9b1c15e7f0 0x7f9b1c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b2261d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0cfeb0 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b2261d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0ce410 con 0x7f9b1c15e7f0 2023-10-16T20:08:11.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b2261d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c15ec50 con 0x7f9b1c06a820 2023-10-16T20:08:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.808+0000 7f9b1b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9b1c15e7f0 0x7f9b1c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b20bba700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9b1c0ca7d0 0x7f9b1c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41582/0 (socket says 172.21.15.152:41582) 2023-10-16T20:08:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b20bba700 1 -- 172.21.15.152:0/415443779 learned_addr learned my addr 172.21.15.152:0/415443779 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:11.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1bfff700 1 --2- 172.21.15.152:0/415443779 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c06a820 0x7f9b1c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/415443779 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c06a820 msgr2=0x7f9b1c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1b7fe700 1 --2- 172.21.15.152:0/415443779 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c06a820 0x7f9b1c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/415443779 >> v1:172.21.15.152:6789/0 conn(0x7f9b1c0ca7d0 legacy=0x7f9b1c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1affd700 1 -- 172.21.15.152:0/415443779 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966135912 0 0) 0x7f9b1c0cfeb0 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/415443779 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0af9d0 con 0x7f9b1c15e7f0 2023-10-16T20:08:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1b7fe700 1 --2- 172.21.15.152:0/415443779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c15e7f0 0x7f9b1c06ac00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c067df0 tx=0x7f9b10009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37189488011d4320 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1affd700 1 -- 172.21.15.152:0/415443779 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10011830 con 0x7f9b1c15e7f0 2023-10-16T20:08:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1affd700 1 -- 172.21.15.152:0/415443779 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b10011990 con 0x7f9b1c15e7f0 2023-10-16T20:08:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.809+0000 7f9b1affd700 1 -- 172.21.15.152:0/415443779 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10011d20 con 0x7f9b1c15e7f0 2023-10-16T20:08:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 -- 172.21.15.152:0/415443779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c15e7f0 msgr2=0x7f9b1c06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 --2- 172.21.15.152:0/415443779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c15e7f0 0x7f9b1c06ac00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c067df0 tx=0x7f9b10009b20 comp rx=0 tx=0).stop 2023-10-16T20:08:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 -- 172.21.15.152:0/415443779 shutdown_connections 2023-10-16T20:08:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 --2- 172.21.15.152:0/415443779 >> v2:172.21.15.163:3300/0 conn(0x7f9b1c06a820 0x7f9b1c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 --2- 172.21.15.152:0/415443779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c15e7f0 0x7f9b1c06ac00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 -- 172.21.15.152:0/415443779 >> 172.21.15.152:0/415443779 conn(0x7f9b1c0d0180 msgr2=0x7f9b1c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 -- 172.21.15.152:0/415443779 shutdown_connections 2023-10-16T20:08:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.810+0000 7f9b2261d700 1 -- 172.21.15.152:0/415443779 wait complete. 2023-10-16T20:08:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.811+0000 7f9b2261d700 1 Processor -- start 2023-10-16T20:08:11.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.811+0000 7f9b2261d700 1 -- start start 2023-10-16T20:08:11.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b2261d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c06a820 0x7f9b1c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b2261d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 0x7f9b1c1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b2261d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c15e7f0 0x7f9b1c1f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b2261d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c06e700 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b2261d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c06d650 con 0x7f9b1c06a820 2023-10-16T20:08:11.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b2261d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c06d930 con 0x7f9b1c15e7f0 2023-10-16T20:08:11.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 0x7f9b1c1f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 0x7f9b1c1f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33156/0 (socket says 172.21.15.152:33156) 2023-10-16T20:08:11.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/2091663116 learned_addr learned my addr 172.21.15.152:0/2091663116 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:11.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1bfff700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c06a820 0x7f9b1c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b20bba700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c15e7f0 0x7f9b1c1f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c15e7f0 msgr2=0x7f9b1c1f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c15e7f0 0x7f9b1c1f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c06a820 msgr2=0x7f9b1c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c06a820 0x7f9b1c06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:11.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 -- 172.21.15.152:0/2091663116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100094a0 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1bfff700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c06a820 0x7f9b1c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.812+0000 7f9b1b7fe700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 0x7f9b1c1f6840 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9b10014040 tx=0x7f9b10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.813+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100038a0 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.813+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1001e070 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.813+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c06dc10 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.813+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10003c20 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.813+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c06def0 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.814+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c04ebb0 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.814+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9b1002d450 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.814+0000 7f9b18ff9700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b0806af00 0x7f9b0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.814+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9b1008a730 con 0x7f9b1c0ca7d0 2023-10-16T20:08:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.814+0000 7f9b1bfff700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b0806af00 0x7f9b0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.815+0000 7f9b1bfff700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b0806af00 0x7f9b0806d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0099f0 tx=0x7f9b0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:11.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:11.819+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9b10055710 con 0x7f9b1c0ca7d0 2023-10-16T20:08:12.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.008+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b1c0af410 con 0x7f9b0806af00 2023-10-16T20:08:12.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.009+0000 7f9b18ff9700 1 -- 172.21.15.152:0/2091663116 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9b0c009680 con 0x7f9b0806af00 2023-10-16T20:08:12.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b0806af00 msgr2=0x7f9b0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b0806af00 0x7f9b0806d3c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0099f0 tx=0x7f9b0c008040 comp rx=0 tx=0).stop 2023-10-16T20:08:12.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 msgr2=0x7f9b1c1f6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 0x7f9b1c1f6840 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9b10014040 tx=0x7f9b10004750 comp rx=0 tx=0).stop 2023-10-16T20:08:12.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 shutdown_connections 2023-10-16T20:08:12.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f9b0806af00 0x7f9b0806d3c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f9b1c15e7f0 0x7f9b1c1f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b1c06a820 0x7f9b1c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 --2- 172.21.15.152:0/2091663116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b1c0ca7d0 0x7f9b1c1f6840 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 >> 172.21.15.152:0/2091663116 conn(0x7f9b1c0d0180 msgr2=0x7f9b1c071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:12.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 shutdown_connections 2023-10-16T20:08:12.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.011+0000 7f9b2261d700 1 -- 172.21.15.152:0/2091663116 wait complete. 2023-10-16T20:08:12.016 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 7 to deep-scrub 2023-10-16T20:08:12.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:12.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.145+0000 7fb1bfe44700 1 Processor -- start 2023-10-16T20:08:12.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.145+0000 7fb1bfe44700 1 -- start start 2023-10-16T20:08:12.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bfe44700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1b8152470 0x7fb1b80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:12.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bfe44700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb1b80b3410 0x7fb1b80b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:12.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bfe44700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b8070d70 con 0x7fb1b80cb8d0 2023-10-16T20:08:12.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bfe44700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b8071200 con 0x7fb1b8152470 2023-10-16T20:08:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bfe44700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80cbd80 con 0x7fb1b80b3410 2023-10-16T20:08:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1b8152470 0x7fb1b80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1b8152470 0x7fb1b80cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33162/0 (socket says 172.21.15.152:33162) 2023-10-16T20:08:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/3953155354 learned_addr learned my addr 172.21.15.152:0/3953155354 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1be3e1700 1 --2- 172.21.15.152:0/3953155354 >> v2:172.21.15.163:3300/0 conn(0x7fb1b80b3410 0x7fb1b80b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/3953155354 >> v2:172.21.15.163:3300/0 conn(0x7fb1b80b3410 msgr2=0x7fb1b80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 --2- 172.21.15.152:0/3953155354 >> v2:172.21.15.163:3300/0 conn(0x7fb1b80b3410 0x7fb1b80b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/3953155354 >> v1:172.21.15.163:6789/0 conn(0x7fb1b80cb8d0 legacy=0x7fb1b80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:12.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/3953155354 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8070440 con 0x7fb1b8152470 2023-10-16T20:08:12.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.146+0000 7fb1bdbe0700 1 --2- 172.21.15.152:0/3953155354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b8152470 0x7fb1b80cd570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80b0730 tx=0x7fb1b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfcd5d6788605a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:12.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bcbde700 1 -- 172.21.15.152:0/3953155354 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4004230 con 0x7fb1b8152470 2023-10-16T20:08:12.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bcbde700 1 -- 172.21.15.152:0/3953155354 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b4004390 con 0x7fb1b8152470 2023-10-16T20:08:12.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bcbde700 1 -- 172.21.15.152:0/3953155354 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40036a0 con 0x7fb1b8152470 2023-10-16T20:08:12.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 -- 172.21.15.152:0/3953155354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b8152470 msgr2=0x7fb1b80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/3953155354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b8152470 0x7fb1b80cd570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80b0730 tx=0x7fb1b4009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 -- 172.21.15.152:0/3953155354 shutdown_connections 2023-10-16T20:08:12.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/3953155354 >> v2:172.21.15.163:3300/0 conn(0x7fb1b80b3410 0x7fb1b80b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/3953155354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b8152470 0x7fb1b80cd570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 -- 172.21.15.152:0/3953155354 >> 172.21.15.152:0/3953155354 conn(0x7fb1b80cdd00 msgr2=0x7fb1b80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:12.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 -- 172.21.15.152:0/3953155354 shutdown_connections 2023-10-16T20:08:12.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.147+0000 7fb1bfe44700 1 -- 172.21.15.152:0/3953155354 wait complete. 2023-10-16T20:08:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.148+0000 7fb1bfe44700 1 Processor -- start 2023-10-16T20:08:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.148+0000 7fb1bfe44700 1 -- start start 2023-10-16T20:08:12.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bfe44700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 0x7fb1b814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bfe44700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1b80cb8d0 0x7fb1b814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bfe44700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1b8152470 0x7fb1b814f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bfe44700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ca280 con 0x7fb1b80b3410 2023-10-16T20:08:12.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bfe44700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ca560 con 0x7fb1b80cb8d0 2023-10-16T20:08:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bfe44700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80ca840 con 0x7fb1b8152470 2023-10-16T20:08:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bdbe0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 0x7fb1b814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bdbe0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 0x7fb1b814d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33166/0 (socket says 172.21.15.152:33166) 2023-10-16T20:08:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.149+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/1935630227 learned_addr learned my addr 172.21.15.152:0/1935630227 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1be3e1700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1b8152470 0x7fb1b814f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bd3df700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1b80cb8d0 0x7fb1b814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1b8152470 msgr2=0x7fb1b814f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bdbe0700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1b8152470 0x7fb1b814f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1b80cb8d0 msgr2=0x7fb1b814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bdbe0700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1b80cb8d0 0x7fb1b814ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bdbe0700 1 -- 172.21.15.152:0/1935630227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4009550 con 0x7fb1b80b3410 2023-10-16T20:08:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1be3e1700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1b8152470 0x7fb1b814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bd3df700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1b80cb8d0 0x7fb1b814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bdbe0700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 0x7fb1b814d2e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009130 tx=0x7fb1b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4003dc0 con 0x7fb1b80b3410 2023-10-16T20:08:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b401f070 con 0x7fb1b80b3410 2023-10-16T20:08:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b80cab20 con 0x7fb1b80b3410 2023-10-16T20:08:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4011870 con 0x7fb1b80b3410 2023-10-16T20:08:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.150+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b814d820 con 0x7fb1b80b3410 2023-10-16T20:08:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.151+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b804ebb0 con 0x7fb1b80b3410 2023-10-16T20:08:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.151+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1b4021030 con 0x7fb1b80b3410 2023-10-16T20:08:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.152+0000 7fb1ae7fc700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb19c06af00 0x7fb19c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:12.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.152+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb1b408ad40 con 0x7fb1b80b3410 2023-10-16T20:08:12.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.152+0000 7fb1bd3df700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb19c06af00 0x7fb19c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:12.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.152+0000 7fb1bd3df700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb19c06af00 0x7fb19c06d3c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80cc4b0 tx=0x7fb1a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:12.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.156+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1b4055d20 con 0x7fb1b80b3410 2023-10-16T20:08:12.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.342+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1b8070a00 con 0x7fb19c06af00 2023-10-16T20:08:12.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.349+0000 7fb1ae7fc700 1 -- 172.21.15.152:0/1935630227 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288704 (secure 0 0 0) 0x7fb1a8014420 con 0x7fb19c06af00 2023-10-16T20:08:12.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:12.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb19c06af00 msgr2=0x7fb19c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb19c06af00 0x7fb19c06d3c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80cc4b0 tx=0x7fb1a8009040 comp rx=0 tx=0).stop 2023-10-16T20:08:12.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 msgr2=0x7fb1b814d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:12.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 0x7fb1b814d2e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009130 tx=0x7fb1b4004750 comp rx=0 tx=0).stop 2023-10-16T20:08:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 shutdown_connections 2023-10-16T20:08:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fb19c06af00 0x7fb19c06d3c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fb1b8152470 0x7fb1b814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80b3410 0x7fb1b814d2e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 --2- 172.21.15.152:0/1935630227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1b80cb8d0 0x7fb1b814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:12.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 >> 172.21.15.152:0/1935630227 conn(0x7fb1b80cdd00 msgr2=0x7fb1b80cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:12.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 shutdown_connections 2023-10-16T20:08:12.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:12.353+0000 7fb1bfe44700 1 -- 172.21.15.152:0/1935630227 wait complete. 2023-10-16T20:08:12.361 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:12.366 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-10-16T20:08:10.787931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2795852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002436"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023225+0000","last_change":"2023-10-16T20:07:53.032076+0000","last_active":"2023-10-16T20:07:54.023225+0000","last_peered":"2023-10-16T20:07:54.023225+0000","last_clean":"2023-10-16T20:07:54.023225+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:07:54.023225+0000","last_undegraded":"2023-10-16T20:07:54.023225+0000","last_fullsized":"2023-10-16T20:07:54.023225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:53.865740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023105+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:07:54.023105+0000","last_peered":"2023-10-16T20:07:54.023105+0000","last_clean":"2023-10-16T20:07:54.023105+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:07:54.023105+0000","last_undegraded":"2023-10-16T20:07:54.023105+0000","last_fullsized":"2023-10-16T20:07:54.023105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:49:56.088181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269135+0000","last_change":"2023-10-16T20:07:53.041956+0000","last_active":"2023-10-16T20:07:54.269135+0000","last_peered":"2023-10-16T20:07:54.269135+0000","last_clean":"2023-10-16T20:07:54.269135+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:07:54.269135+0000","last_undegraded":"2023-10-16T20:07:54.269135+0000","last_fullsized":"2023-10-16T20:07:54.269135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:09.257087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101183+0000","last_change":"2023-10-16T20:07:53.037791+0000","last_active":"2023-10-16T20:07:54.101183+0000","last_peered":"2023-10-16T20:07:54.101183+0000","last_clean":"2023-10-16T20:07:54.101183+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:07:54.101183+0000","last_undegraded":"2023-10-16T20:07:54.101183+0000","last_fullsized":"2023-10-16T20:07:54.101183+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:14:17.460962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101028+0000","last_change":"2023-10-16T20:07:53.037496+0000","last_active":"2023-10-16T20:07:54.101028+0000","last_peered":"2023-10-16T20:07:54.101028+0000","last_clean":"2023-10-16T20:07:54.101028+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:07:54.101028+0000","last_undegraded":"2023-10-16T20:07:54.101028+0000","last_fullsized":"2023-10-16T20:07:54.101028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:32.843327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269118+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269118+0000","last_peered":"2023-10-16T20:07:54.269118+0000","last_clean":"2023-10-16T20:07:54.269118+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:07:54.269118+0000","last_undegraded":"2023-10-16T20:07:54.269118+0000","last_fullsized":"2023-10-16T20:07:54.269118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103476+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:07:54.103476+0000","last_peered":"2023-10-16T20:07:54.103476+0000","last_clean":"2023-10-16T20:07:54.103476+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:07:54.103476+0000","last_undegraded":"2023-10-16T20:07:54.103476+0000","last_fullsized":"2023-10-16T20:07:54.103476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.022889+0000","last_change":"2023-10-16T20:07:53.031550+0000","last_active":"2023-10-16T20:07:54.022889+0000","last_peered":"2023-10-16T20:07:54.022889+0000","last_clean":"2023-10-16T20:07:54.022889+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:07:54.022889+0000","last_undegraded":"2023-10-16T20:07:54.022889+0000","last_fullsized":"2023-10-16T20:07:54.022889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:03:49.996848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269666+0000","last_change":"2023-10-16T20:07:53.053620+0000","last_active":"2023-10-16T20:07:54.269666+0000","last_peered":"2023-10-16T20:07:54.269666+0000","last_clean":"2023-10-16T20:07:54.269666+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:07:54.269666+0000","last_undegraded":"2023-10-16T20:07:54.269666+0000","last_fullsized":"2023-10-16T20:07:54.269666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103613+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:07:54.103613+0000","last_peered":"2023-10-16T20:07:54.103613+0000","last_clean":"2023-10-16T20:07:54.103613+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:07:54.103613+0000","last_undegraded":"2023-10-16T20:07:54.103613+0000","last_fullsized":"2023-10-16T20:07:54.103613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:30:09.717922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103704+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:07:54.103704+0000","last_peered":"2023-10-16T20:07:54.103704+0000","last_clean":"2023-10-16T20:07:54.103704+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:07:54.103704+0000","last_undegraded":"2023-10-16T20:07:54.103704+0000","last_fullsized":"2023-10-16T20:07:54.103704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:33.300151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269358+0000","last_change":"2023-10-16T20:07:53.038955+0000","last_active":"2023-10-16T20:07:54.269358+0000","last_peered":"2023-10-16T20:07:54.269358+0000","last_clean":"2023-10-16T20:07:54.269358+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:07:54.269358+0000","last_undegraded":"2023-10-16T20:07:54.269358+0000","last_fullsized":"2023-10-16T20:07:54.269358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103406+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:07:54.103406+0000","last_peered":"2023-10-16T20:07:54.103406+0000","last_clean":"2023-10-16T20:07:54.103406+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:07:54.103406+0000","last_undegraded":"2023-10-16T20:07:54.103406+0000","last_fullsized":"2023-10-16T20:07:54.103406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025328+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:07:54.025328+0000","last_peered":"2023-10-16T20:07:54.025328+0000","last_clean":"2023-10-16T20:07:54.025328+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:07:54.025328+0000","last_undegraded":"2023-10-16T20:07:54.025328+0000","last_fullsized":"2023-10-16T20:07:54.025328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103294+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:07:54.103294+0000","last_peered":"2023-10-16T20:07:54.103294+0000","last_clean":"2023-10-16T20:07:54.103294+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:07:54.103294+0000","last_undegraded":"2023-10-16T20:07:54.103294+0000","last_fullsized":"2023-10-16T20:07:54.103294+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269416+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:07:54.269416+0000","last_peered":"2023-10-16T20:07:54.269416+0000","last_clean":"2023-10-16T20:07:54.269416+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:07:54.269416+0000","last_undegraded":"2023-10-16T20:07:54.269416+0000","last_fullsized":"2023-10-16T20:07:54.269416+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:27.018295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269948+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:07:54.269948+0000","last_peered":"2023-10-16T20:07:54.269948+0000","last_clean":"2023-10-16T20:07:54.269948+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:07:54.269948+0000","last_undegraded":"2023-10-16T20:07:54.269948+0000","last_fullsized":"2023-10-16T20:07:54.269948+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:03.260612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025037+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:07:54.025037+0000","last_peered":"2023-10-16T20:07:54.025037+0000","last_clean":"2023-10-16T20:07:54.025037+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:07:54.025037+0000","last_undegraded":"2023-10-16T20:07:54.025037+0000","last_fullsized":"2023-10-16T20:07:54.025037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:11:40.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101108+0000","last_change":"2023-10-16T20:07:53.036516+0000","last_active":"2023-10-16T20:07:54.101108+0000","last_peered":"2023-10-16T20:07:54.101108+0000","last_clean":"2023-10-16T20:07:54.101108+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:07:54.101108+0000","last_undegraded":"2023-10-16T20:07:54.101108+0000","last_fullsized":"2023-10-16T20:07:54.101108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:41:53.007268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024266+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:07:54.024266+0000","last_peered":"2023-10-16T20:07:54.024266+0000","last_clean":"2023-10-16T20:07:54.024266+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:07:54.024266+0000","last_undegraded":"2023-10-16T20:07:54.024266+0000","last_fullsized":"2023-10-16T20:07:54.024266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103499+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:07:54.103499+0000","last_peered":"2023-10-16T20:07:54.103499+0000","last_clean":"2023-10-16T20:07:54.103499+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:07:54.103499+0000","last_undegraded":"2023-10-16T20:07:54.103499+0000","last_fullsized":"2023-10-16T20:07:54.103499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:34:38.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024960+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:07:54.024960+0000","last_peered":"2023-10-16T20:07:54.024960+0000","last_clean":"2023-10-16T20:07:54.024960+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:07:54.024960+0000","last_undegraded":"2023-10-16T20:07:54.024960+0000","last_fullsized":"2023-10-16T20:07:54.024960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:56.871839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269612+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:07:54.269612+0000","last_peered":"2023-10-16T20:07:54.269612+0000","last_clean":"2023-10-16T20:07:54.269612+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:07:54.269612+0000","last_undegraded":"2023-10-16T20:07:54.269612+0000","last_fullsized":"2023-10-16T20:07:54.269612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:12.377109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101006+0000","last_change":"2023-10-16T20:07:53.049683+0000","last_active":"2023-10-16T20:07:54.101006+0000","last_peered":"2023-10-16T20:07:54.101006+0000","last_clean":"2023-10-16T20:07:54.101006+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:07:54.101006+0000","last_undegraded":"2023-10-16T20:07:54.101006+0000","last_fullsized":"2023-10-16T20:07:54.101006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:06.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024377+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:07:54.024377+0000","last_peered":"2023-10-16T20:07:54.024377+0000","last_clean":"2023-10-16T20:07:54.024377+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:07:54.024377+0000","last_undegraded":"2023-10-16T20:07:54.024377+0000","last_fullsized":"2023-10-16T20:07:54.024377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269284+0000","last_change":"2023-10-16T20:07:53.041714+0000","last_active":"2023-10-16T20:07:54.269284+0000","last_peered":"2023-10-16T20:07:54.269284+0000","last_clean":"2023-10-16T20:07:54.269284+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:07:54.269284+0000","last_undegraded":"2023-10-16T20:07:54.269284+0000","last_fullsized":"2023-10-16T20:07:54.269284+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024374+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:07:54.024374+0000","last_peered":"2023-10-16T20:07:54.024374+0000","last_clean":"2023-10-16T20:07:54.024374+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:07:54.024374+0000","last_undegraded":"2023-10-16T20:07:54.024374+0000","last_fullsized":"2023-10-16T20:07:54.024374+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:01:51.806398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103586+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:07:54.103586+0000","last_peered":"2023-10-16T20:07:54.103586+0000","last_clean":"2023-10-16T20:07:54.103586+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:07:54.103586+0000","last_undegraded":"2023-10-16T20:07:54.103586+0000","last_fullsized":"2023-10-16T20:07:54.103586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:14.506216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024418+0000","last_change":"2023-10-16T20:07:53.036408+0000","last_active":"2023-10-16T20:07:54.024418+0000","last_peered":"2023-10-16T20:07:54.024418+0000","last_clean":"2023-10-16T20:07:54.024418+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:07:54.024418+0000","last_undegraded":"2023-10-16T20:07:54.024418+0000","last_fullsized":"2023-10-16T20:07:54.024418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:29.011240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.024148+0000","last_change":"2023-10-16T20:07:53.044465+0000","last_active":"2023-10-16T20:07:54.024148+0000","last_peered":"2023-10-16T20:07:54.024148+0000","last_clean":"2023-10-16T20:07:54.024148+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:07:54.024148+0000","last_undegraded":"2023-10-16T20:07:54.024148+0000","last_fullsized":"2023-10-16T20:07:54.024148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269484+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:07:54.269484+0000","last_peered":"2023-10-16T20:07:54.269484+0000","last_clean":"2023-10-16T20:07:54.269484+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:07:54.269484+0000","last_undegraded":"2023-10-16T20:07:54.269484+0000","last_fullsized":"2023-10-16T20:07:54.269484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:37:20.080195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268972+0000","last_change":"2023-10-16T20:07:53.033516+0000","last_active":"2023-10-16T20:07:54.268972+0000","last_peered":"2023-10-16T20:07:54.268972+0000","last_clean":"2023-10-16T20:07:54.268972+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:07:54.268972+0000","last_undegraded":"2023-10-16T20:07:54.268972+0000","last_fullsized":"2023-10-16T20:07:54.268972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:34:37.647167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269908+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:07:54.269908+0000","last_peered":"2023-10-16T20:07:54.269908+0000","last_clean":"2023-10-16T20:07:54.269908+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:07:54.269908+0000","last_undegraded":"2023-10-16T20:07:54.269908+0000","last_fullsized":"2023-10-16T20:07:54.269908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:37:58.047728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963697+0000","last_change":"2023-10-16T20:07:52.034030+0000","last_active":"2023-10-16T20:07:53.963697+0000","last_peered":"2023-10-16T20:07:53.963697+0000","last_clean":"2023-10-16T20:07:53.963697+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:07:53.963697+0000","last_undegraded":"2023-10-16T20:07:53.963697+0000","last_fullsized":"2023-10-16T20:07:53.963697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:16:55.866926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269553+0000","last_change":"2023-10-16T20:07:53.041621+0000","last_active":"2023-10-16T20:07:54.269553+0000","last_peered":"2023-10-16T20:07:54.269553+0000","last_clean":"2023-10-16T20:07:54.269553+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:07:54.269553+0000","last_undegraded":"2023-10-16T20:07:54.269553+0000","last_fullsized":"2023-10-16T20:07:54.269553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:22:48.459709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051925+0000","last_change":"2023-10-16T20:07:52.036456+0000","last_active":"2023-10-16T20:07:53.051925+0000","last_peered":"2023-10-16T20:07:53.051925+0000","last_clean":"2023-10-16T20:07:53.051925+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:07:53.051925+0000","last_undegraded":"2023-10-16T20:07:53.051925+0000","last_fullsized":"2023-10-16T20:07:53.051925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:14.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025298+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:07:54.025298+0000","last_peered":"2023-10-16T20:07:54.025298+0000","last_clean":"2023-10-16T20:07:54.025298+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:07:54.025298+0000","last_undegraded":"2023-10-16T20:07:54.025298+0000","last_fullsized":"2023-10-16T20:07:54.025298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:31.704797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.056466+0000","last_change":"2023-10-16T20:07:52.033196+0000","last_active":"2023-10-16T20:07:53.056466+0000","last_peered":"2023-10-16T20:07:53.056466+0000","last_clean":"2023-10-16T20:07:53.056466+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:07:53.056466+0000","last_undegraded":"2023-10-16T20:07:53.056466+0000","last_fullsized":"2023-10-16T20:07:53.056466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:17.552698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023330+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:07:54.023330+0000","last_peered":"2023-10-16T20:07:54.023330+0000","last_clean":"2023-10-16T20:07:54.023330+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:07:54.023330+0000","last_undegraded":"2023-10-16T20:07:54.023330+0000","last_fullsized":"2023-10-16T20:07:54.023330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:50:53.891138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962423+0000","last_change":"2023-10-16T20:07:52.041368+0000","last_active":"2023-10-16T20:07:53.962423+0000","last_peered":"2023-10-16T20:07:53.962423+0000","last_clean":"2023-10-16T20:07:53.962423+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:07:53.962423+0000","last_undegraded":"2023-10-16T20:07:53.962423+0000","last_fullsized":"2023-10-16T20:07:53.962423+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269292+0000","last_change":"2023-10-16T20:07:53.031450+0000","last_active":"2023-10-16T20:07:54.269292+0000","last_peered":"2023-10-16T20:07:54.269292+0000","last_clean":"2023-10-16T20:07:54.269292+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:07:54.269292+0000","last_undegraded":"2023-10-16T20:07:54.269292+0000","last_fullsized":"2023-10-16T20:07:54.269292+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:17.812401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962521+0000","last_change":"2023-10-16T20:07:52.036646+0000","last_active":"2023-10-16T20:07:53.962521+0000","last_peered":"2023-10-16T20:07:53.962521+0000","last_clean":"2023-10-16T20:07:53.962521+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:07:53.962521+0000","last_undegraded":"2023-10-16T20:07:53.962521+0000","last_fullsized":"2023-10-16T20:07:53.962521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:54.933075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103297+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:07:54.103297+0000","last_peered":"2023-10-16T20:07:54.103297+0000","last_clean":"2023-10-16T20:07:54.103297+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:07:54.103297+0000","last_undegraded":"2023-10-16T20:07:54.103297+0000","last_fullsized":"2023-10-16T20:07:54.103297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964077+0000","last_change":"2023-10-16T20:07:52.039273+0000","last_active":"2023-10-16T20:07:53.964077+0000","last_peered":"2023-10-16T20:07:53.964077+0000","last_clean":"2023-10-16T20:07:53.964077+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:07:53.964077+0000","last_undegraded":"2023-10-16T20:07:53.964077+0000","last_fullsized":"2023-10-16T20:07:53.964077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:19:30.699884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025136+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:07:54.025136+0000","last_peered":"2023-10-16T20:07:54.025136+0000","last_clean":"2023-10-16T20:07:54.025136+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:07:54.025136+0000","last_undegraded":"2023-10-16T20:07:54.025136+0000","last_fullsized":"2023-10-16T20:07:54.025136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:46.274536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026238+0000","last_change":"2023-10-16T20:07:52.035663+0000","last_active":"2023-10-16T20:07:53.026238+0000","last_peered":"2023-10-16T20:07:53.026238+0000","last_clean":"2023-10-16T20:07:53.026238+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:07:53.026238+0000","last_undegraded":"2023-10-16T20:07:53.026238+0000","last_fullsized":"2023-10-16T20:07:53.026238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.960835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023237+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:07:54.023237+0000","last_peered":"2023-10-16T20:07:54.023237+0000","last_clean":"2023-10-16T20:07:54.023237+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:07:54.023237+0000","last_undegraded":"2023-10-16T20:07:54.023237+0000","last_fullsized":"2023-10-16T20:07:54.023237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:10.581126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962309+0000","last_change":"2023-10-16T20:07:52.028243+0000","last_active":"2023-10-16T20:07:53.962309+0000","last_peered":"2023-10-16T20:07:53.962309+0000","last_clean":"2023-10-16T20:07:53.962309+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:07:53.962309+0000","last_undegraded":"2023-10-16T20:07:53.962309+0000","last_fullsized":"2023-10-16T20:07:53.962309+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:10:14.236585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101256+0000","last_change":"2023-10-16T20:07:53.038082+0000","last_active":"2023-10-16T20:07:54.101256+0000","last_peered":"2023-10-16T20:07:54.101256+0000","last_clean":"2023-10-16T20:07:54.101256+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:07:54.101256+0000","last_undegraded":"2023-10-16T20:07:54.101256+0000","last_fullsized":"2023-10-16T20:07:54.101256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:06.955879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022694+0000","last_change":"2023-10-16T20:07:52.043288+0000","last_active":"2023-10-16T20:07:53.022694+0000","last_peered":"2023-10-16T20:07:53.022694+0000","last_clean":"2023-10-16T20:07:53.022694+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:07:53.022694+0000","last_undegraded":"2023-10-16T20:07:53.022694+0000","last_fullsized":"2023-10-16T20:07:53.022694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:26.475876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269796+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:07:54.269796+0000","last_peered":"2023-10-16T20:07:54.269796+0000","last_clean":"2023-10-16T20:07:54.269796+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:07:54.269796+0000","last_undegraded":"2023-10-16T20:07:54.269796+0000","last_fullsized":"2023-10-16T20:07:54.269796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:35.604886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962629+0000","last_change":"2023-10-16T20:07:52.040543+0000","last_active":"2023-10-16T20:07:53.962629+0000","last_peered":"2023-10-16T20:07:53.962629+0000","last_clean":"2023-10-16T20:07:53.962629+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:07:53.962629+0000","last_undegraded":"2023-10-16T20:07:53.962629+0000","last_fullsized":"2023-10-16T20:07:53.962629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:26.013382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269544+0000","last_change":"2023-10-16T20:07:53.048262+0000","last_active":"2023-10-16T20:07:54.269544+0000","last_peered":"2023-10-16T20:07:54.269544+0000","last_clean":"2023-10-16T20:07:54.269544+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:07:54.269544+0000","last_undegraded":"2023-10-16T20:07:54.269544+0000","last_fullsized":"2023-10-16T20:07:54.269544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:25.129848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962580+0000","last_change":"2023-10-16T20:07:52.041532+0000","last_active":"2023-10-16T20:07:53.962580+0000","last_peered":"2023-10-16T20:07:53.962580+0000","last_clean":"2023-10-16T20:07:53.962580+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:07:53.962580+0000","last_undegraded":"2023-10-16T20:07:53.962580+0000","last_fullsized":"2023-10-16T20:07:53.962580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:04:25.337287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025162+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:07:54.025162+0000","last_peered":"2023-10-16T20:07:54.025162+0000","last_clean":"2023-10-16T20:07:54.025162+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:07:54.025162+0000","last_undegraded":"2023-10-16T20:07:54.025162+0000","last_fullsized":"2023-10-16T20:07:54.025162+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:18.010326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061493+0000","last_change":"2023-10-16T20:07:52.040497+0000","last_active":"2023-10-16T20:07:53.061493+0000","last_peered":"2023-10-16T20:07:53.061493+0000","last_clean":"2023-10-16T20:07:53.061493+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:07:53.061493+0000","last_undegraded":"2023-10-16T20:07:53.061493+0000","last_fullsized":"2023-10-16T20:07:53.061493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:05:54.643651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269104+0000","last_change":"2023-10-16T20:07:53.048961+0000","last_active":"2023-10-16T20:07:54.269104+0000","last_peered":"2023-10-16T20:07:54.269104+0000","last_clean":"2023-10-16T20:07:54.269104+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:07:54.269104+0000","last_undegraded":"2023-10-16T20:07:54.269104+0000","last_fullsized":"2023-10-16T20:07:54.269104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:58.965748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.048654+0000","last_change":"2023-10-16T20:07:52.040238+0000","last_active":"2023-10-16T20:07:53.048654+0000","last_peered":"2023-10-16T20:07:53.048654+0000","last_clean":"2023-10-16T20:07:53.048654+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:07:53.048654+0000","last_undegraded":"2023-10-16T20:07:53.048654+0000","last_fullsized":"2023-10-16T20:07:53.048654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:19.484561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023303+0000","last_change":"2023-10-16T20:07:53.031630+0000","last_active":"2023-10-16T20:07:54.023303+0000","last_peered":"2023-10-16T20:07:54.023303+0000","last_clean":"2023-10-16T20:07:54.023303+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:07:54.023303+0000","last_undegraded":"2023-10-16T20:07:54.023303+0000","last_fullsized":"2023-10-16T20:07:54.023303+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:19.312981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.025675+0000","last_change":"2023-10-16T20:07:52.038186+0000","last_active":"2023-10-16T20:07:53.025675+0000","last_peered":"2023-10-16T20:07:53.025675+0000","last_clean":"2023-10-16T20:07:53.025675+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:07:53.025675+0000","last_undegraded":"2023-10-16T20:07:53.025675+0000","last_fullsized":"2023-10-16T20:07:53.025675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269686+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:07:54.269686+0000","last_peered":"2023-10-16T20:07:54.269686+0000","last_clean":"2023-10-16T20:07:54.269686+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:07:54.269686+0000","last_undegraded":"2023-10-16T20:07:54.269686+0000","last_fullsized":"2023-10-16T20:07:54.269686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:07.194764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963564+0000","last_change":"2023-10-16T20:07:52.033348+0000","last_active":"2023-10-16T20:07:53.963564+0000","last_peered":"2023-10-16T20:07:53.963564+0000","last_clean":"2023-10-16T20:07:53.963564+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:07:53.963564+0000","last_undegraded":"2023-10-16T20:07:53.963564+0000","last_fullsized":"2023-10-16T20:07:53.963564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:29:07.467316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023252+0000","last_change":"2023-10-16T20:07:53.029968+0000","last_active":"2023-10-16T20:07:54.023252+0000","last_peered":"2023-10-16T20:07:54.023252+0000","last_clean":"2023-10-16T20:07:54.023252+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:07:54.023252+0000","last_undegraded":"2023-10-16T20:07:54.023252+0000","last_fullsized":"2023-10-16T20:07:54.023252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:25.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963991+0000","last_change":"2023-10-16T20:07:52.039081+0000","last_active":"2023-10-16T20:07:53.963991+0000","last_peered":"2023-10-16T20:07:53.963991+0000","last_clean":"2023-10-16T20:07:53.963991+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:07:53.963991+0000","last_undegraded":"2023-10-16T20:07:53.963991+0000","last_fullsized":"2023-10-16T20:07:53.963991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:25.204390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023028+0000","last_change":"2023-10-16T20:07:53.037655+0000","last_active":"2023-10-16T20:07:54.023028+0000","last_peered":"2023-10-16T20:07:54.023028+0000","last_clean":"2023-10-16T20:07:54.023028+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:07:54.023028+0000","last_undegraded":"2023-10-16T20:07:54.023028+0000","last_fullsized":"2023-10-16T20:07:54.023028+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:00:13.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962674+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:07:53.962674+0000","last_peered":"2023-10-16T20:07:53.962674+0000","last_clean":"2023-10-16T20:07:53.962674+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:07:53.962674+0000","last_undegraded":"2023-10-16T20:07:53.962674+0000","last_fullsized":"2023-10-16T20:07:53.962674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:10.804027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103796+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:07:54.103796+0000","last_peered":"2023-10-16T20:07:54.103796+0000","last_clean":"2023-10-16T20:07:54.103796+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:07:54.103796+0000","last_undegraded":"2023-10-16T20:07:54.103796+0000","last_fullsized":"2023-10-16T20:07:54.103796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:53.656150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962461+0000","last_change":"2023-10-16T20:07:52.038949+0000","last_active":"2023-10-16T20:07:53.962461+0000","last_peered":"2023-10-16T20:07:53.962461+0000","last_clean":"2023-10-16T20:07:53.962461+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:07:53.962461+0000","last_undegraded":"2023-10-16T20:07:53.962461+0000","last_fullsized":"2023-10-16T20:07:53.962461+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:03.821926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025395+0000","last_change":"2023-10-16T20:07:53.032929+0000","last_active":"2023-10-16T20:07:54.025395+0000","last_peered":"2023-10-16T20:07:54.025395+0000","last_clean":"2023-10-16T20:07:54.025395+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:07:54.025395+0000","last_undegraded":"2023-10-16T20:07:54.025395+0000","last_fullsized":"2023-10-16T20:07:54.025395+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:32:26.209303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.061109+0000","last_change":"2023-10-16T20:07:52.036327+0000","last_active":"2023-10-16T20:07:53.061109+0000","last_peered":"2023-10-16T20:07:53.061109+0000","last_clean":"2023-10-16T20:07:53.061109+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:07:53.061109+0000","last_undegraded":"2023-10-16T20:07:53.061109+0000","last_fullsized":"2023-10-16T20:07:53.061109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:53:57.100161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101320+0000","last_change":"2023-10-16T20:07:53.039457+0000","last_active":"2023-10-16T20:07:54.101320+0000","last_peered":"2023-10-16T20:07:54.101320+0000","last_clean":"2023-10-16T20:07:54.101320+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:07:54.101320+0000","last_undegraded":"2023-10-16T20:07:54.101320+0000","last_fullsized":"2023-10-16T20:07:54.101320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:27:35.056763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.026529+0000","last_change":"2023-10-16T20:07:52.035157+0000","last_active":"2023-10-16T20:07:53.026529+0000","last_peered":"2023-10-16T20:07:53.026529+0000","last_clean":"2023-10-16T20:07:53.026529+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:07:53.026529+0000","last_undegraded":"2023-10-16T20:07:53.026529+0000","last_fullsized":"2023-10-16T20:07:53.026529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:03.961940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269527+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:07:54.269527+0000","last_peered":"2023-10-16T20:07:54.269527+0000","last_clean":"2023-10-16T20:07:54.269527+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:07:54.269527+0000","last_undegraded":"2023-10-16T20:07:54.269527+0000","last_fullsized":"2023-10-16T20:07:54.269527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:58:11.808940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.051159+0000","last_change":"2023-10-16T20:07:52.035525+0000","last_active":"2023-10-16T20:07:53.051159+0000","last_peered":"2023-10-16T20:07:53.051159+0000","last_clean":"2023-10-16T20:07:53.051159+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:07:53.051159+0000","last_undegraded":"2023-10-16T20:07:53.051159+0000","last_fullsized":"2023-10-16T20:07:53.051159+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:40:21.527524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269159+0000","last_change":"2023-10-16T20:07:53.048171+0000","last_active":"2023-10-16T20:07:54.269159+0000","last_peered":"2023-10-16T20:07:54.269159+0000","last_clean":"2023-10-16T20:07:54.269159+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:07:54.269159+0000","last_undegraded":"2023-10-16T20:07:54.269159+0000","last_fullsized":"2023-10-16T20:07:54.269159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:48:04.966853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027784+0000","last_change":"2023-10-16T20:07:52.033998+0000","last_active":"2023-10-16T20:07:53.027784+0000","last_peered":"2023-10-16T20:07:53.027784+0000","last_clean":"2023-10-16T20:07:53.027784+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:07:53.027784+0000","last_undegraded":"2023-10-16T20:07:53.027784+0000","last_fullsized":"2023-10-16T20:07:53.027784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:03:53.685902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103386+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:07:54.103386+0000","last_peered":"2023-10-16T20:07:54.103386+0000","last_clean":"2023-10-16T20:07:54.103386+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:07:54.103386+0000","last_undegraded":"2023-10-16T20:07:54.103386+0000","last_fullsized":"2023-10-16T20:07:54.103386+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964052+0000","last_change":"2023-10-16T20:07:52.039719+0000","last_active":"2023-10-16T20:07:53.964052+0000","last_peered":"2023-10-16T20:07:53.964052+0000","last_clean":"2023-10-16T20:07:53.964052+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:07:53.964052+0000","last_undegraded":"2023-10-16T20:07:53.964052+0000","last_fullsized":"2023-10-16T20:07:53.964052+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:54:31.228176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023079+0000","last_change":"2023-10-16T20:07:53.051277+0000","last_active":"2023-10-16T20:07:54.023079+0000","last_peered":"2023-10-16T20:07:54.023079+0000","last_clean":"2023-10-16T20:07:54.023079+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:07:54.023079+0000","last_undegraded":"2023-10-16T20:07:54.023079+0000","last_fullsized":"2023-10-16T20:07:54.023079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:09.587579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.028961+0000","last_change":"2023-10-16T20:07:52.037260+0000","last_active":"2023-10-16T20:07:53.028961+0000","last_peered":"2023-10-16T20:07:53.028961+0000","last_clean":"2023-10-16T20:07:53.028961+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:07:53.028961+0000","last_undegraded":"2023-10-16T20:07:53.028961+0000","last_fullsized":"2023-10-16T20:07:53.028961+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:42.884671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269491+0000","last_change":"2023-10-16T20:07:53.042042+0000","last_active":"2023-10-16T20:07:54.269491+0000","last_peered":"2023-10-16T20:07:54.269491+0000","last_clean":"2023-10-16T20:07:54.269491+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:07:54.269491+0000","last_undegraded":"2023-10-16T20:07:54.269491+0000","last_fullsized":"2023-10-16T20:07:54.269491+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:23:20.489474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962687+0000","last_change":"2023-10-16T20:07:52.043538+0000","last_active":"2023-10-16T20:07:53.962687+0000","last_peered":"2023-10-16T20:07:53.962687+0000","last_clean":"2023-10-16T20:07:53.962687+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:07:53.962687+0000","last_undegraded":"2023-10-16T20:07:53.962687+0000","last_fullsized":"2023-10-16T20:07:53.962687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:11.372196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269825+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:07:54.269825+0000","last_peered":"2023-10-16T20:07:54.269825+0000","last_clean":"2023-10-16T20:07:54.269825+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:07:54.269825+0000","last_undegraded":"2023-10-16T20:07:54.269825+0000","last_fullsized":"2023-10-16T20:07:54.269825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:52:42.735596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.101285+0000","last_change":"2023-10-16T20:07:52.038519+0000","last_active":"2023-10-16T20:07:54.101285+0000","last_peered":"2023-10-16T20:07:54.101285+0000","last_clean":"2023-10-16T20:07:54.101285+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:07:54.101285+0000","last_undegraded":"2023-10-16T20:07:54.101285+0000","last_fullsized":"2023-10-16T20:07:54.101285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:20:19.786064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.023295+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:07:54.023295+0000","last_peered":"2023-10-16T20:07:54.023295+0000","last_clean":"2023-10-16T20:07:54.023295+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:07:54.023295+0000","last_undegraded":"2023-10-16T20:07:54.023295+0000","last_fullsized":"2023-10-16T20:07:54.023295+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027338+0000","last_change":"2023-10-16T20:07:52.040215+0000","last_active":"2023-10-16T20:07:53.027338+0000","last_peered":"2023-10-16T20:07:53.027338+0000","last_clean":"2023-10-16T20:07:53.027338+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:07:53.027338+0000","last_undegraded":"2023-10-16T20:07:53.027338+0000","last_fullsized":"2023-10-16T20:07:53.027338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:12:04.319305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269278+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:07:54.269278+0000","last_peered":"2023-10-16T20:07:54.269278+0000","last_clean":"2023-10-16T20:07:54.269278+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:07:54.269278+0000","last_undegraded":"2023-10-16T20:07:54.269278+0000","last_fullsized":"2023-10-16T20:07:54.269278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.027463+0000","last_change":"2023-10-16T20:07:52.035824+0000","last_active":"2023-10-16T20:07:53.027463+0000","last_peered":"2023-10-16T20:07:53.027463+0000","last_clean":"2023-10-16T20:07:53.027463+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:07:53.027463+0000","last_undegraded":"2023-10-16T20:07:53.027463+0000","last_fullsized":"2023-10-16T20:07:53.027463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.268970+0000","last_change":"2023-10-16T20:07:53.036387+0000","last_active":"2023-10-16T20:07:54.268970+0000","last_peered":"2023-10-16T20:07:54.268970+0000","last_clean":"2023-10-16T20:07:54.268970+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:07:54.268970+0000","last_undegraded":"2023-10-16T20:07:54.268970+0000","last_fullsized":"2023-10-16T20:07:54.268970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:27.480789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.963596+0000","last_change":"2023-10-16T20:07:52.035291+0000","last_active":"2023-10-16T20:07:53.963596+0000","last_peered":"2023-10-16T20:07:53.963596+0000","last_clean":"2023-10-16T20:07:53.963596+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:07:53.963596+0000","last_undegraded":"2023-10-16T20:07:53.963596+0000","last_fullsized":"2023-10-16T20:07:53.963596+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:30.158741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.025267+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:07:54.025267+0000","last_peered":"2023-10-16T20:07:54.025267+0000","last_clean":"2023-10-16T20:07:54.025267+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:07:54.025267+0000","last_undegraded":"2023-10-16T20:07:54.025267+0000","last_fullsized":"2023-10-16T20:07:54.025267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:46.480742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.962334+0000","last_change":"2023-10-16T20:07:52.040575+0000","last_active":"2023-10-16T20:07:53.962334+0000","last_peered":"2023-10-16T20:07:53.962334+0000","last_clean":"2023-10-16T20:07:53.962334+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:07:53.962334+0000","last_undegraded":"2023-10-16T20:07:53.962334+0000","last_fullsized":"2023-10-16T20:07:53.962334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:50:18.664514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.269794+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:07:54.269794+0000","last_peered":"2023-10-16T20:07:54.269794+0000","last_clean":"2023-10-16T20:07:54.269794+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:07:54.269794+0000","last_undegraded":"2023-10-16T20:07:54.269794+0000","last_fullsized":"2023-10-16T20:07:54.269794+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:55:06.433065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.022176+0000","last_change":"2023-10-16T20:07:52.043262+0000","last_active":"2023-10-16T20:07:53.022176+0000","last_peered":"2023-10-16T20:07:53.022176+0000","last_clean":"2023-10-16T20:07:53.022176+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:07:53.022176+0000","last_undegraded":"2023-10-16T20:07:53.022176+0000","last_fullsized":"2023-10-16T20:07:53.022176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:04:17.115269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-16T20:07:54.103809+0000","last_change":"2023-10-16T20:07:53.041360+0000","last_active":"2023-10-16T20:07:54.103809+0000","last_peered":"2023-10-16T20:07:54.103809+0000","last_clean":"2023-10-16T20:07:54.103809+0000","last_became_active":"2023-10-16T20:07:53.040906+0000","last_became_peered":"2023-10-16T20:07:53.040906+0000","last_unstale":"2023-10-16T20:07:54.103809+0000","last_undegraded":"2023-10-16T20:07:54.103809+0000","last_fullsized":"2023-10-16T20:07:54.103809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:22.531060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.964119+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:07:53.964119+0000","last_peered":"2023-10-16T20:07:53.964119+0000","last_clean":"2023-10-16T20:07:53.964119+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:07:53.964119+0000","last_undegraded":"2023-10-16T20:07:53.964119+0000","last_fullsized":"2023-10-16T20:07:53.964119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:45.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T20:07:53.039606+0000","last_change":"2023-10-16T20:06:20.819671+0000","last_active":"2023-10-16T20:07:53.039606+0000","last_peered":"2023-10-16T20:07:53.039606+0000","last_clean":"2023-10-16T20:07:53.039606+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:07:53.039606+0000","last_undegraded":"2023-10-16T20:07:53.039606+0000","last_fullsized":"2023-10-16T20:07:53.039606+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:06:19.239414+0000","last_clean_scrub_stamp":"2023-10-16T20:06:19.239414+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:49:07.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":793337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.68799999999999994}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.441},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.625}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":201869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.438}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.499},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.57499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.34999999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.31},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.29499999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.28299999999999997}]},{"osd":4,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.52800000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.309}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.8769999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.372},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":0.35699999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.51700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.46800000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.495}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58499999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61099999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":202933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.312},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.40300000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42499999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.502}]},{"osd":5,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":3.0819999999999999,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.44}]},{"osd":7,"last update":"Mon Oct 16 20:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.46000000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.498}]},{"osd":5,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41599999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59399999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.624}]},{"osd":2,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:07:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:12.375 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.375 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.376 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.376 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.377 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.377 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.377 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.378 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.378 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.379 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.379 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.379 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.380 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.380 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.380 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.381 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.381 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.381 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.382 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.382 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.383 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.383 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.383 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.384 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.384 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.384 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.385 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.385 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.386 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.386 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.386 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.387 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.387 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.387 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.388 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.388 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.388 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.389 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.389 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.390 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.390 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.390 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.391 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.391 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.392 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.392 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.392 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.393 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.393 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.393 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.394 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.394 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.394 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.395 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.395 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.396 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.396 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.396 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.397 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.397 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.397 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.398 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.398 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.399 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.399 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.399 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.400 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.400 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.401 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.401 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.401 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.402 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.402 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.402 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.403 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.403 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.404 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.404 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.404 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.405 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.405 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.405 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.406 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.406 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.407 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.407 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.407 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.408 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.408 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.408 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.409 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.409 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.410 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.410 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.410 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.411 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.411 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-16T20:06:19.239414+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=6, tm_sec=19, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:12.411 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:08:30.993 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:30.996 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:08:32.412 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.543+0000 7ffa0479f700 1 Processor -- start 2023-10-16T20:08:32.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.543+0000 7ffa0479f700 1 -- start start 2023-10-16T20:08:32.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa0479f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff9fc144ea0 0x7ff9fc15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:32.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa0479f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff9fc0cbc10 0x7ff9fc0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:32.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa0479f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc0cd4b0 con 0x7ff9fc0712e0 2023-10-16T20:08:32.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa0479f700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc15b8f0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa0479f700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc0cc0c0 con 0x7ff9fc0cbc10 2023-10-16T20:08:32.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff9fc144ea0 0x7ff9fc15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:32.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff9fc144ea0 0x7ff9fc15f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33176/0 (socket says 172.21.15.152:33176) 2023-10-16T20:08:32.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 -- 172.21.15.152:0/644323074 learned_addr learned my addr 172.21.15.152:0/644323074 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:32.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa02d3c700 1 --2- 172.21.15.152:0/644323074 >> v2:172.21.15.163:3300/0 conn(0x7ff9fc0cbc10 0x7ff9fc0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:32.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 -- 172.21.15.152:0/644323074 >> v2:172.21.15.163:3300/0 conn(0x7ff9fc0cbc10 msgr2=0x7ff9fc0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:32.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 --2- 172.21.15.152:0/644323074 >> v2:172.21.15.163:3300/0 conn(0x7ff9fc0cbc10 0x7ff9fc0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 -- 172.21.15.152:0/644323074 >> v1:172.21.15.163:6789/0 conn(0x7ff9fc0712e0 legacy=0x7ff9fc0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:32.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 -- 172.21.15.152:0/644323074 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc15fdb0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01d3a700 1 --2- 172.21.15.152:0/644323074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc15f790 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0aeb80 tx=0x7ff9ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c3c452ee0fff9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:32.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.544+0000 7ffa01539700 1 -- 172.21.15.152:0/644323074 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec004230 con 0x7ff9fc144ea0 2023-10-16T20:08:32.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa01539700 1 -- 172.21.15.152:0/644323074 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec004390 con 0x7ff9fc144ea0 2023-10-16T20:08:32.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa01539700 1 -- 172.21.15.152:0/644323074 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0036a0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 -- 172.21.15.152:0/644323074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 msgr2=0x7ff9fc15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:32.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 --2- 172.21.15.152:0/644323074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc15f790 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0aeb80 tx=0x7ff9ec009bd0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 -- 172.21.15.152:0/644323074 shutdown_connections 2023-10-16T20:08:32.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 --2- 172.21.15.152:0/644323074 >> v2:172.21.15.163:3300/0 conn(0x7ff9fc0cbc10 0x7ff9fc0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 --2- 172.21.15.152:0/644323074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc15f790 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 -- 172.21.15.152:0/644323074 >> 172.21.15.152:0/644323074 conn(0x7ff9fc0cfcd0 msgr2=0x7ff9fc0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:32.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 -- 172.21.15.152:0/644323074 shutdown_connections 2023-10-16T20:08:32.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.545+0000 7ffa0479f700 1 -- 172.21.15.152:0/644323074 wait complete. 2023-10-16T20:08:32.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.546+0000 7ffa0479f700 1 Processor -- start 2023-10-16T20:08:32.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.546+0000 7ffa0479f700 1 -- start start 2023-10-16T20:08:32.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0479f700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9fc0712e0 0x7ff9fc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:32.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0479f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9fc0cbc10 0x7ff9fc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:32.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0479f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:32.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0479f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0b29f0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0479f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0b50f0 con 0x7ff9fc0cbc10 2023-10-16T20:08:32.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0479f700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0b53d0 con 0x7ff9fc0712e0 2023-10-16T20:08:32.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa02d3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:32.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa02d3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc1597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33184/0 (socket says 172.21.15.152:33184) 2023-10-16T20:08:32.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa02d3c700 1 -- 172.21.15.152:0/2468398515 learned_addr learned my addr 172.21.15.152:0/2468398515 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:32.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa01d3a700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9fc0cbc10 0x7ff9fc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:32.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.547+0000 7ffa0253b700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9fc0712e0 0x7ff9fc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:32.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa02d3c700 1 -- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9fc0712e0 msgr2=0x7ff9fc0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:32.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa02d3c700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9fc0712e0 0x7ff9fc0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa02d3c700 1 -- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9fc0cbc10 msgr2=0x7ff9fc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:32.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa02d3c700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9fc0cbc10 0x7ff9fc15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa02d3c700 1 -- 172.21.15.152:0/2468398515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009550 con 0x7ff9fc144ea0 2023-10-16T20:08:32.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa01d3a700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9fc0cbc10 0x7ff9fc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:32.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa0253b700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9fc0712e0 0x7ff9fc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:08:32.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa02d3c700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc1597a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4007cf0 tx=0x7ff9f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:32.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400ede0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4014420 con 0x7ff9fc144ea0 2023-10-16T20:08:32.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc0c44c0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f40147d0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.548+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc0c4a80 con 0x7ff9fc144ea0 2023-10-16T20:08:32.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.549+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc04ebb0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.549+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff9f4014930 con 0x7ff9fc144ea0 2023-10-16T20:08:32.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.550+0000 7ff9f2ffd700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff9e006af00 0x7ff9e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:32.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.550+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7ff9f4089dd0 con 0x7ff9fc144ea0 2023-10-16T20:08:32.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.550+0000 7ffa0253b700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff9e006af00 0x7ff9e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:32.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.550+0000 7ffa0253b700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff9e006af00 0x7ff9e006d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009930 tx=0x7ff9f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:32.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.554+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9f4054d10 con 0x7ff9fc144ea0 2023-10-16T20:08:32.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.738+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9fc0ca2b0 con 0x7ff9e006af00 2023-10-16T20:08:32.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.746+0000 7ff9f2ffd700 1 -- 172.21.15.152:0/2468398515 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287912 (secure 0 0 0) 0x7ff9f8009e00 con 0x7ff9e006af00 2023-10-16T20:08:32.753 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:32.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff9e006af00 msgr2=0x7ff9e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:32.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff9e006af00 0x7ff9e006d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009930 tx=0x7ff9f8008040 comp rx=0 tx=0).stop 2023-10-16T20:08:32.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 msgr2=0x7ff9fc1597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:32.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc1597a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4007cf0 tx=0x7ff9f400e3c0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 shutdown_connections 2023-10-16T20:08:32.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff9e006af00 0x7ff9e006d3c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff9fc0712e0 0x7ff9fc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9fc144ea0 0x7ff9fc1597a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 --2- 172.21.15.152:0/2468398515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff9fc0cbc10 0x7ff9fc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:32.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 >> 172.21.15.152:0/2468398515 conn(0x7ff9fc0cfcd0 msgr2=0x7ff9fc0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:32.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 shutdown_connections 2023-10-16T20:08:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:32.749+0000 7ffa0479f700 1 -- 172.21.15.152:0/2468398515 wait complete. 2023-10-16T20:08:32.759 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:32.764 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-16T20:08:30.793401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003623"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681867+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681867+0000","last_peered":"2023-10-16T20:08:25.681867+0000","last_clean":"2023-10-16T20:08:25.681867+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681867+0000","last_undegraded":"2023-10-16T20:08:25.681867+0000","last_fullsized":"2023-10-16T20:08:25.681867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095947+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:08:13.095947+0000","last_peered":"2023-10-16T20:08:13.095947+0000","last_clean":"2023-10-16T20:08:13.095947+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:13.095947+0000","last_undegraded":"2023-10-16T20:08:13.095947+0000","last_fullsized":"2023-10-16T20:08:13.095947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568727+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568727+0000","last_peered":"2023-10-16T20:08:27.568727+0000","last_clean":"2023-10-16T20:08:27.568727+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568727+0000","last_undegraded":"2023-10-16T20:08:27.568727+0000","last_fullsized":"2023-10-16T20:08:27.568727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499254+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499254+0000","last_peered":"2023-10-16T20:08:20.499254+0000","last_clean":"2023-10-16T20:08:20.499254+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499254+0000","last_undegraded":"2023-10-16T20:08:20.499254+0000","last_fullsized":"2023-10-16T20:08:20.499254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509595+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509595+0000","last_peered":"2023-10-16T20:08:15.509595+0000","last_clean":"2023-10-16T20:08:15.509595+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509595+0000","last_undegraded":"2023-10-16T20:08:15.509595+0000","last_fullsized":"2023-10-16T20:08:15.509595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157235+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157235+0000","last_peered":"2023-10-16T20:08:25.157235+0000","last_clean":"2023-10-16T20:08:25.157235+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157235+0000","last_undegraded":"2023-10-16T20:08:25.157235+0000","last_fullsized":"2023-10-16T20:08:25.157235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099899+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:08:13.099899+0000","last_peered":"2023-10-16T20:08:13.099899+0000","last_clean":"2023-10-16T20:08:13.099899+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:13.099899+0000","last_undegraded":"2023-10-16T20:08:13.099899+0000","last_fullsized":"2023-10-16T20:08:13.099899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095604+0000","last_change":"2023-10-16T20:07:53.031550+0000","last_active":"2023-10-16T20:08:13.095604+0000","last_peered":"2023-10-16T20:08:13.095604+0000","last_clean":"2023-10-16T20:08:13.095604+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:13.095604+0000","last_undegraded":"2023-10-16T20:08:13.095604+0000","last_fullsized":"2023-10-16T20:08:13.095604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098806+0000","last_change":"2023-10-16T20:07:53.053620+0000","last_active":"2023-10-16T20:08:13.098806+0000","last_peered":"2023-10-16T20:08:13.098806+0000","last_clean":"2023-10-16T20:08:13.098806+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:13.098806+0000","last_undegraded":"2023-10-16T20:08:13.098806+0000","last_fullsized":"2023-10-16T20:08:13.098806+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.100196+0000","last_change":"2023-10-16T20:07:53.048218+0000","last_active":"2023-10-16T20:08:13.100196+0000","last_peered":"2023-10-16T20:08:13.100196+0000","last_clean":"2023-10-16T20:08:13.100196+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:13.100196+0000","last_undegraded":"2023-10-16T20:08:13.100196+0000","last_fullsized":"2023-10-16T20:08:13.100196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.100172+0000","last_change":"2023-10-16T20:07:53.040637+0000","last_active":"2023-10-16T20:08:13.100172+0000","last_peered":"2023-10-16T20:08:13.100172+0000","last_clean":"2023-10-16T20:08:13.100172+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:13.100172+0000","last_undegraded":"2023-10-16T20:08:13.100172+0000","last_fullsized":"2023-10-16T20:08:13.100172+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500913+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500913+0000","last_peered":"2023-10-16T20:08:24.500913+0000","last_clean":"2023-10-16T20:08:24.500913+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500913+0000","last_undegraded":"2023-10-16T20:08:24.500913+0000","last_fullsized":"2023-10-16T20:08:24.500913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099902+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:08:13.099902+0000","last_peered":"2023-10-16T20:08:13.099902+0000","last_clean":"2023-10-16T20:08:13.099902+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:13.099902+0000","last_undegraded":"2023-10-16T20:08:13.099902+0000","last_fullsized":"2023-10-16T20:08:13.099902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096927+0000","last_change":"2023-10-16T20:07:53.041065+0000","last_active":"2023-10-16T20:08:13.096927+0000","last_peered":"2023-10-16T20:08:13.096927+0000","last_clean":"2023-10-16T20:08:13.096927+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:13.096927+0000","last_undegraded":"2023-10-16T20:08:13.096927+0000","last_fullsized":"2023-10-16T20:08:13.096927+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099707+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:08:13.099707+0000","last_peered":"2023-10-16T20:08:13.099707+0000","last_clean":"2023-10-16T20:08:13.099707+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:08:13.099707+0000","last_undegraded":"2023-10-16T20:08:13.099707+0000","last_fullsized":"2023-10-16T20:08:13.099707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096264+0000","last_change":"2023-10-16T20:07:53.058215+0000","last_active":"2023-10-16T20:08:13.096264+0000","last_peered":"2023-10-16T20:08:13.096264+0000","last_clean":"2023-10-16T20:08:13.096264+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:13.096264+0000","last_undegraded":"2023-10-16T20:08:13.096264+0000","last_fullsized":"2023-10-16T20:08:13.096264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097390+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:08:13.097390+0000","last_peered":"2023-10-16T20:08:13.097390+0000","last_clean":"2023-10-16T20:08:13.097390+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:08:13.097390+0000","last_undegraded":"2023-10-16T20:08:13.097390+0000","last_fullsized":"2023-10-16T20:08:13.097390+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.409168+0000","last_change":"2023-10-16T20:07:53.038771+0000","last_active":"2023-10-16T20:08:13.409168+0000","last_peered":"2023-10-16T20:08:13.409168+0000","last_clean":"2023-10-16T20:08:13.409168+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:13.409168+0000","last_undegraded":"2023-10-16T20:08:13.409168+0000","last_fullsized":"2023-10-16T20:08:13.409168+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504133+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504133+0000","last_peered":"2023-10-16T20:08:21.504133+0000","last_clean":"2023-10-16T20:08:21.504133+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504133+0000","last_undegraded":"2023-10-16T20:08:21.504133+0000","last_fullsized":"2023-10-16T20:08:21.504133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.409011+0000","last_change":"2023-10-16T20:07:53.037853+0000","last_active":"2023-10-16T20:08:13.409011+0000","last_peered":"2023-10-16T20:08:13.409011+0000","last_clean":"2023-10-16T20:08:13.409011+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:13.409011+0000","last_undegraded":"2023-10-16T20:08:13.409011+0000","last_fullsized":"2023-10-16T20:08:13.409011+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099937+0000","last_change":"2023-10-16T20:07:53.035261+0000","last_active":"2023-10-16T20:08:13.099937+0000","last_peered":"2023-10-16T20:08:13.099937+0000","last_clean":"2023-10-16T20:08:13.099937+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:13.099937+0000","last_undegraded":"2023-10-16T20:08:13.099937+0000","last_fullsized":"2023-10-16T20:08:13.099937+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096603+0000","last_change":"2023-10-16T20:07:53.036887+0000","last_active":"2023-10-16T20:08:13.096603+0000","last_peered":"2023-10-16T20:08:13.096603+0000","last_clean":"2023-10-16T20:08:13.096603+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:13.096603+0000","last_undegraded":"2023-10-16T20:08:13.096603+0000","last_fullsized":"2023-10-16T20:08:13.096603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096523+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:08:13.096523+0000","last_peered":"2023-10-16T20:08:13.096523+0000","last_clean":"2023-10-16T20:08:13.096523+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:13.096523+0000","last_undegraded":"2023-10-16T20:08:13.096523+0000","last_fullsized":"2023-10-16T20:08:13.096523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544178+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544178+0000","last_peered":"2023-10-16T20:08:14.544178+0000","last_clean":"2023-10-16T20:08:14.544178+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544178+0000","last_undegraded":"2023-10-16T20:08:14.544178+0000","last_fullsized":"2023-10-16T20:08:14.544178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.409182+0000","last_change":"2023-10-16T20:07:53.044780+0000","last_active":"2023-10-16T20:08:13.409182+0000","last_peered":"2023-10-16T20:08:13.409182+0000","last_clean":"2023-10-16T20:08:13.409182+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:13.409182+0000","last_undegraded":"2023-10-16T20:08:13.409182+0000","last_fullsized":"2023-10-16T20:08:13.409182+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161600+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161600+0000","last_peered":"2023-10-16T20:08:23.161600+0000","last_clean":"2023-10-16T20:08:23.161600+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161600+0000","last_undegraded":"2023-10-16T20:08:23.161600+0000","last_fullsized":"2023-10-16T20:08:23.161600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.409110+0000","last_change":"2023-10-16T20:07:53.037959+0000","last_active":"2023-10-16T20:08:13.409110+0000","last_peered":"2023-10-16T20:08:13.409110+0000","last_clean":"2023-10-16T20:08:13.409110+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:13.409110+0000","last_undegraded":"2023-10-16T20:08:13.409110+0000","last_fullsized":"2023-10-16T20:08:13.409110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.100076+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:08:13.100076+0000","last_peered":"2023-10-16T20:08:13.100076+0000","last_clean":"2023-10-16T20:08:13.100076+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:13.100076+0000","last_undegraded":"2023-10-16T20:08:13.100076+0000","last_fullsized":"2023-10-16T20:08:13.100076+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409793+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409793+0000","last_peered":"2023-10-16T20:08:27.409793+0000","last_clean":"2023-10-16T20:08:27.409793+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409793+0000","last_undegraded":"2023-10-16T20:08:27.409793+0000","last_fullsized":"2023-10-16T20:08:27.409793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423048+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423048+0000","last_peered":"2023-10-16T20:08:24.423048+0000","last_clean":"2023-10-16T20:08:24.423048+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423048+0000","last_undegraded":"2023-10-16T20:08:24.423048+0000","last_fullsized":"2023-10-16T20:08:24.423048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096435+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:08:13.096435+0000","last_peered":"2023-10-16T20:08:13.096435+0000","last_clean":"2023-10-16T20:08:13.096435+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:08:13.096435+0000","last_undegraded":"2023-10-16T20:08:13.096435+0000","last_fullsized":"2023-10-16T20:08:13.096435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408812+0000","last_change":"2023-10-16T20:07:53.033516+0000","last_active":"2023-10-16T20:08:13.408812+0000","last_peered":"2023-10-16T20:08:13.408812+0000","last_clean":"2023-10-16T20:08:13.408812+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:13.408812+0000","last_undegraded":"2023-10-16T20:08:13.408812+0000","last_fullsized":"2023-10-16T20:08:13.408812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097278+0000","last_change":"2023-10-16T20:07:53.054810+0000","last_active":"2023-10-16T20:08:13.097278+0000","last_peered":"2023-10-16T20:08:13.097278+0000","last_clean":"2023-10-16T20:08:13.097278+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:13.097278+0000","last_undegraded":"2023-10-16T20:08:13.097278+0000","last_fullsized":"2023-10-16T20:08:13.097278+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439516+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439516+0000","last_peered":"2023-10-16T20:08:23.439516+0000","last_clean":"2023-10-16T20:08:23.439516+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439516+0000","last_undegraded":"2023-10-16T20:08:23.439516+0000","last_fullsized":"2023-10-16T20:08:23.439516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.409309+0000","last_change":"2023-10-16T20:07:53.041621+0000","last_active":"2023-10-16T20:08:13.409309+0000","last_peered":"2023-10-16T20:08:13.409309+0000","last_clean":"2023-10-16T20:08:13.409309+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:13.409309+0000","last_undegraded":"2023-10-16T20:08:13.409309+0000","last_fullsized":"2023-10-16T20:08:13.409309+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098759+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:13.098759+0000","last_peered":"2023-10-16T20:08:13.098759+0000","last_clean":"2023-10-16T20:08:13.098759+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:13.098759+0000","last_undegraded":"2023-10-16T20:08:13.098759+0000","last_fullsized":"2023-10-16T20:08:13.098759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097447+0000","last_change":"2023-10-16T20:07:53.036892+0000","last_active":"2023-10-16T20:08:13.097447+0000","last_peered":"2023-10-16T20:08:13.097447+0000","last_clean":"2023-10-16T20:08:13.097447+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:13.097447+0000","last_undegraded":"2023-10-16T20:08:13.097447+0000","last_fullsized":"2023-10-16T20:08:13.097447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255050+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255050+0000","last_peered":"2023-10-16T20:08:15.255050+0000","last_clean":"2023-10-16T20:08:15.255050+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255050+0000","last_undegraded":"2023-10-16T20:08:15.255050+0000","last_fullsized":"2023-10-16T20:08:15.255050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096155+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:08:13.096155+0000","last_peered":"2023-10-16T20:08:13.096155+0000","last_clean":"2023-10-16T20:08:13.096155+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:08:13.096155+0000","last_undegraded":"2023-10-16T20:08:13.096155+0000","last_fullsized":"2023-10-16T20:08:13.096155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428235+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428235+0000","last_peered":"2023-10-16T20:08:22.428235+0000","last_clean":"2023-10-16T20:08:22.428235+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428235+0000","last_undegraded":"2023-10-16T20:08:22.428235+0000","last_fullsized":"2023-10-16T20:08:22.428235+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097909+0000","last_change":"2023-10-16T20:07:53.031450+0000","last_active":"2023-10-16T20:08:13.097909+0000","last_peered":"2023-10-16T20:08:13.097909+0000","last_clean":"2023-10-16T20:08:13.097909+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:13.097909+0000","last_undegraded":"2023-10-16T20:08:13.097909+0000","last_fullsized":"2023-10-16T20:08:13.097909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920349+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920349+0000","last_peered":"2023-10-16T20:08:15.920349+0000","last_clean":"2023-10-16T20:08:15.920349+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920349+0000","last_undegraded":"2023-10-16T20:08:15.920349+0000","last_fullsized":"2023-10-16T20:08:15.920349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099734+0000","last_change":"2023-10-16T20:07:53.052475+0000","last_active":"2023-10-16T20:08:13.099734+0000","last_peered":"2023-10-16T20:08:13.099734+0000","last_clean":"2023-10-16T20:08:13.099734+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:13.099734+0000","last_undegraded":"2023-10-16T20:08:13.099734+0000","last_fullsized":"2023-10-16T20:08:13.099734+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469599+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469599+0000","last_peered":"2023-10-16T20:08:27.469599+0000","last_clean":"2023-10-16T20:08:27.469599+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469599+0000","last_undegraded":"2023-10-16T20:08:27.469599+0000","last_fullsized":"2023-10-16T20:08:27.469599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096696+0000","last_change":"2023-10-16T20:07:53.035659+0000","last_active":"2023-10-16T20:08:13.096696+0000","last_peered":"2023-10-16T20:08:13.096696+0000","last_clean":"2023-10-16T20:08:13.096696+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:13.096696+0000","last_undegraded":"2023-10-16T20:08:13.096696+0000","last_fullsized":"2023-10-16T20:08:13.096696+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248069+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248069+0000","last_peered":"2023-10-16T20:08:14.248069+0000","last_clean":"2023-10-16T20:08:14.248069+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248069+0000","last_undegraded":"2023-10-16T20:08:14.248069+0000","last_fullsized":"2023-10-16T20:08:14.248069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095870+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:08:13.095870+0000","last_peered":"2023-10-16T20:08:13.095870+0000","last_clean":"2023-10-16T20:08:13.095870+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:13.095870+0000","last_undegraded":"2023-10-16T20:08:13.095870+0000","last_fullsized":"2023-10-16T20:08:13.095870+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362399+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362399+0000","last_peered":"2023-10-16T20:08:15.362399+0000","last_clean":"2023-10-16T20:08:15.362399+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362399+0000","last_undegraded":"2023-10-16T20:08:15.362399+0000","last_fullsized":"2023-10-16T20:08:15.362399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466503+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466503+0000","last_peered":"2023-10-16T20:08:23.466503+0000","last_clean":"2023-10-16T20:08:23.466503+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466503+0000","last_undegraded":"2023-10-16T20:08:23.466503+0000","last_fullsized":"2023-10-16T20:08:23.466503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096251+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:13.096251+0000","last_peered":"2023-10-16T20:08:13.096251+0000","last_clean":"2023-10-16T20:08:13.096251+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:13.096251+0000","last_undegraded":"2023-10-16T20:08:13.096251+0000","last_fullsized":"2023-10-16T20:08:13.096251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096755+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:08:13.096755+0000","last_peered":"2023-10-16T20:08:13.096755+0000","last_clean":"2023-10-16T20:08:13.096755+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:13.096755+0000","last_undegraded":"2023-10-16T20:08:13.096755+0000","last_fullsized":"2023-10-16T20:08:13.096755+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950617+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950617+0000","last_peered":"2023-10-16T20:08:17.950617+0000","last_clean":"2023-10-16T20:08:17.950617+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950617+0000","last_undegraded":"2023-10-16T20:08:17.950617+0000","last_fullsized":"2023-10-16T20:08:17.950617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548212+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548212+0000","last_peered":"2023-10-16T20:08:26.548212+0000","last_clean":"2023-10-16T20:08:26.548212+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548212+0000","last_undegraded":"2023-10-16T20:08:26.548212+0000","last_fullsized":"2023-10-16T20:08:26.548212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926512+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926512+0000","last_peered":"2023-10-16T20:08:16.926512+0000","last_clean":"2023-10-16T20:08:16.926512+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926512+0000","last_undegraded":"2023-10-16T20:08:16.926512+0000","last_fullsized":"2023-10-16T20:08:16.926512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097710+0000","last_change":"2023-10-16T20:07:53.034454+0000","last_active":"2023-10-16T20:08:13.097710+0000","last_peered":"2023-10-16T20:08:13.097710+0000","last_clean":"2023-10-16T20:08:13.097710+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:13.097710+0000","last_undegraded":"2023-10-16T20:08:13.097710+0000","last_fullsized":"2023-10-16T20:08:13.097710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713006+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713006+0000","last_peered":"2023-10-16T20:08:14.713006+0000","last_clean":"2023-10-16T20:08:14.713006+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713006+0000","last_undegraded":"2023-10-16T20:08:14.713006+0000","last_fullsized":"2023-10-16T20:08:14.713006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097804+0000","last_change":"2023-10-16T20:07:53.048961+0000","last_active":"2023-10-16T20:08:13.097804+0000","last_peered":"2023-10-16T20:08:13.097804+0000","last_clean":"2023-10-16T20:08:13.097804+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:13.097804+0000","last_undegraded":"2023-10-16T20:08:13.097804+0000","last_fullsized":"2023-10-16T20:08:13.097804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.742868+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:13.742868+0000","last_peered":"2023-10-16T20:08:13.742868+0000","last_clean":"2023-10-16T20:08:13.742868+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:13.742868+0000","last_undegraded":"2023-10-16T20:08:13.742868+0000","last_fullsized":"2023-10-16T20:08:13.742868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675138+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675138+0000","last_peered":"2023-10-16T20:08:16.675138+0000","last_clean":"2023-10-16T20:08:16.675138+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675138+0000","last_undegraded":"2023-10-16T20:08:16.675138+0000","last_fullsized":"2023-10-16T20:08:16.675138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235501+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235501+0000","last_peered":"2023-10-16T20:08:19.235501+0000","last_clean":"2023-10-16T20:08:19.235501+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235501+0000","last_undegraded":"2023-10-16T20:08:19.235501+0000","last_fullsized":"2023-10-16T20:08:19.235501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096735+0000","last_change":"2023-10-16T20:07:53.056558+0000","last_active":"2023-10-16T20:08:13.096735+0000","last_peered":"2023-10-16T20:08:13.096735+0000","last_clean":"2023-10-16T20:08:13.096735+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:13.096735+0000","last_undegraded":"2023-10-16T20:08:13.096735+0000","last_fullsized":"2023-10-16T20:08:13.096735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486417+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486417+0000","last_peered":"2023-10-16T20:08:21.486417+0000","last_clean":"2023-10-16T20:08:21.486417+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486417+0000","last_undegraded":"2023-10-16T20:08:21.486417+0000","last_fullsized":"2023-10-16T20:08:21.486417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663909+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663909+0000","last_peered":"2023-10-16T20:08:20.663909+0000","last_clean":"2023-10-16T20:08:20.663909+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663909+0000","last_undegraded":"2023-10-16T20:08:20.663909+0000","last_fullsized":"2023-10-16T20:08:20.663909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713806+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713806+0000","last_peered":"2023-10-16T20:08:17.713806+0000","last_clean":"2023-10-16T20:08:17.713806+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713806+0000","last_undegraded":"2023-10-16T20:08:17.713806+0000","last_fullsized":"2023-10-16T20:08:17.713806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777216+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777216+0000","last_peered":"2023-10-16T20:08:27.777216+0000","last_clean":"2023-10-16T20:08:27.777216+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777216+0000","last_undegraded":"2023-10-16T20:08:27.777216+0000","last_fullsized":"2023-10-16T20:08:27.777216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.100462+0000","last_change":"2023-10-16T20:07:52.038281+0000","last_active":"2023-10-16T20:08:13.100462+0000","last_peered":"2023-10-16T20:08:13.100462+0000","last_clean":"2023-10-16T20:08:13.100462+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:13.100462+0000","last_undegraded":"2023-10-16T20:08:13.100462+0000","last_fullsized":"2023-10-16T20:08:13.100462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.100220+0000","last_change":"2023-10-16T20:07:53.040895+0000","last_active":"2023-10-16T20:08:13.100220+0000","last_peered":"2023-10-16T20:08:13.100220+0000","last_clean":"2023-10-16T20:08:13.100220+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:13.100220+0000","last_undegraded":"2023-10-16T20:08:13.100220+0000","last_fullsized":"2023-10-16T20:08:13.100220+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504674+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504674+0000","last_peered":"2023-10-16T20:08:24.504674+0000","last_clean":"2023-10-16T20:08:24.504674+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504674+0000","last_undegraded":"2023-10-16T20:08:24.504674+0000","last_fullsized":"2023-10-16T20:08:24.504674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456845+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456845+0000","last_peered":"2023-10-16T20:08:27.456845+0000","last_clean":"2023-10-16T20:08:27.456845+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456845+0000","last_undegraded":"2023-10-16T20:08:27.456845+0000","last_fullsized":"2023-10-16T20:08:27.456845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245520+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:13.245520+0000","last_peered":"2023-10-16T20:08:13.245520+0000","last_clean":"2023-10-16T20:08:13.245520+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:13.245520+0000","last_undegraded":"2023-10-16T20:08:13.245520+0000","last_fullsized":"2023-10-16T20:08:13.245520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482362+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482362+0000","last_peered":"2023-10-16T20:08:16.482362+0000","last_clean":"2023-10-16T20:08:16.482362+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482362+0000","last_undegraded":"2023-10-16T20:08:16.482362+0000","last_fullsized":"2023-10-16T20:08:16.482362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190507+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190507+0000","last_peered":"2023-10-16T20:08:20.190507+0000","last_clean":"2023-10-16T20:08:20.190507+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190507+0000","last_undegraded":"2023-10-16T20:08:20.190507+0000","last_fullsized":"2023-10-16T20:08:20.190507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096365+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:08:13.096365+0000","last_peered":"2023-10-16T20:08:13.096365+0000","last_clean":"2023-10-16T20:08:13.096365+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:13.096365+0000","last_undegraded":"2023-10-16T20:08:13.096365+0000","last_fullsized":"2023-10-16T20:08:13.096365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245230+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:13.245230+0000","last_peered":"2023-10-16T20:08:13.245230+0000","last_clean":"2023-10-16T20:08:13.245230+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:13.245230+0000","last_undegraded":"2023-10-16T20:08:13.245230+0000","last_fullsized":"2023-10-16T20:08:13.245230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465756+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465756+0000","last_peered":"2023-10-16T20:08:23.465756+0000","last_clean":"2023-10-16T20:08:23.465756+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465756+0000","last_undegraded":"2023-10-16T20:08:23.465756+0000","last_fullsized":"2023-10-16T20:08:23.465756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245232+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:13.245232+0000","last_peered":"2023-10-16T20:08:13.245232+0000","last_clean":"2023-10-16T20:08:13.245232+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:13.245232+0000","last_undegraded":"2023-10-16T20:08:13.245232+0000","last_fullsized":"2023-10-16T20:08:13.245232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099859+0000","last_change":"2023-10-16T20:07:53.036504+0000","last_active":"2023-10-16T20:08:13.099859+0000","last_peered":"2023-10-16T20:08:13.099859+0000","last_clean":"2023-10-16T20:08:13.099859+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:13.099859+0000","last_undegraded":"2023-10-16T20:08:13.099859+0000","last_fullsized":"2023-10-16T20:08:13.099859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581835+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581835+0000","last_peered":"2023-10-16T20:08:24.581835+0000","last_clean":"2023-10-16T20:08:24.581835+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581835+0000","last_undegraded":"2023-10-16T20:08:24.581835+0000","last_fullsized":"2023-10-16T20:08:24.581835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095827+0000","last_change":"2023-10-16T20:07:53.051277+0000","last_active":"2023-10-16T20:08:13.095827+0000","last_peered":"2023-10-16T20:08:13.095827+0000","last_clean":"2023-10-16T20:08:13.095827+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:13.095827+0000","last_undegraded":"2023-10-16T20:08:13.095827+0000","last_fullsized":"2023-10-16T20:08:13.095827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.573398+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:13.573398+0000","last_peered":"2023-10-16T20:08:13.573398+0000","last_clean":"2023-10-16T20:08:13.573398+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:13.573398+0000","last_undegraded":"2023-10-16T20:08:13.573398+0000","last_fullsized":"2023-10-16T20:08:13.573398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408975+0000","last_change":"2023-10-16T20:07:53.042042+0000","last_active":"2023-10-16T20:08:13.408975+0000","last_peered":"2023-10-16T20:08:13.408975+0000","last_clean":"2023-10-16T20:08:13.408975+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:13.408975+0000","last_undegraded":"2023-10-16T20:08:13.408975+0000","last_fullsized":"2023-10-16T20:08:13.408975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974925+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974925+0000","last_peered":"2023-10-16T20:08:20.974925+0000","last_clean":"2023-10-16T20:08:20.974925+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974925+0000","last_undegraded":"2023-10-16T20:08:20.974925+0000","last_fullsized":"2023-10-16T20:08:20.974925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096836+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:08:13.096836+0000","last_peered":"2023-10-16T20:08:13.096836+0000","last_clean":"2023-10-16T20:08:13.096836+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:13.096836+0000","last_undegraded":"2023-10-16T20:08:13.096836+0000","last_fullsized":"2023-10-16T20:08:13.096836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245481+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:13.245481+0000","last_peered":"2023-10-16T20:08:13.245481+0000","last_clean":"2023-10-16T20:08:13.245481+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:13.245481+0000","last_undegraded":"2023-10-16T20:08:13.245481+0000","last_fullsized":"2023-10-16T20:08:13.245481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096051+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:08:13.096051+0000","last_peered":"2023-10-16T20:08:13.096051+0000","last_clean":"2023-10-16T20:08:13.096051+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:08:13.096051+0000","last_undegraded":"2023-10-16T20:08:13.096051+0000","last_fullsized":"2023-10-16T20:08:13.096051+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449268+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449268+0000","last_peered":"2023-10-16T20:08:20.449268+0000","last_clean":"2023-10-16T20:08:20.449268+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449268+0000","last_undegraded":"2023-10-16T20:08:20.449268+0000","last_fullsized":"2023-10-16T20:08:20.449268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097847+0000","last_change":"2023-10-16T20:07:53.034042+0000","last_active":"2023-10-16T20:08:13.097847+0000","last_peered":"2023-10-16T20:08:13.097847+0000","last_clean":"2023-10-16T20:08:13.097847+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:13.097847+0000","last_undegraded":"2023-10-16T20:08:13.097847+0000","last_fullsized":"2023-10-16T20:08:13.097847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098579+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:13.098579+0000","last_peered":"2023-10-16T20:08:13.098579+0000","last_clean":"2023-10-16T20:08:13.098579+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:13.098579+0000","last_undegraded":"2023-10-16T20:08:13.098579+0000","last_fullsized":"2023-10-16T20:08:13.098579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408823+0000","last_change":"2023-10-16T20:07:53.036387+0000","last_active":"2023-10-16T20:08:13.408823+0000","last_peered":"2023-10-16T20:08:13.408823+0000","last_clean":"2023-10-16T20:08:13.408823+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:13.408823+0000","last_undegraded":"2023-10-16T20:08:13.408823+0000","last_fullsized":"2023-10-16T20:08:13.408823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408942+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:13.408942+0000","last_peered":"2023-10-16T20:08:13.408942+0000","last_clean":"2023-10-16T20:08:13.408942+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:13.408942+0000","last_undegraded":"2023-10-16T20:08:13.408942+0000","last_fullsized":"2023-10-16T20:08:13.408942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096778+0000","last_change":"2023-10-16T20:07:53.044998+0000","last_active":"2023-10-16T20:08:13.096778+0000","last_peered":"2023-10-16T20:08:13.096778+0000","last_clean":"2023-10-16T20:08:13.096778+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:13.096778+0000","last_undegraded":"2023-10-16T20:08:13.096778+0000","last_fullsized":"2023-10-16T20:08:13.096778+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469198+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469198+0000","last_peered":"2023-10-16T20:08:23.469198+0000","last_clean":"2023-10-16T20:08:23.469198+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469198+0000","last_undegraded":"2023-10-16T20:08:23.469198+0000","last_fullsized":"2023-10-16T20:08:23.469198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097148+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:08:13.097148+0000","last_peered":"2023-10-16T20:08:13.097148+0000","last_clean":"2023-10-16T20:08:13.097148+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:08:13.097148+0000","last_undegraded":"2023-10-16T20:08:13.097148+0000","last_fullsized":"2023-10-16T20:08:13.097148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095679+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:13.095679+0000","last_peered":"2023-10-16T20:08:13.095679+0000","last_clean":"2023-10-16T20:08:13.095679+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:13.095679+0000","last_undegraded":"2023-10-16T20:08:13.095679+0000","last_fullsized":"2023-10-16T20:08:13.095679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.499966+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:14.499966+0000","last_peered":"2023-10-16T20:08:14.499966+0000","last_clean":"2023-10-16T20:08:14.499966+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:14.499966+0000","last_undegraded":"2023-10-16T20:08:14.499966+0000","last_fullsized":"2023-10-16T20:08:14.499966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097315+0000","last_change":"2023-10-16T20:07:52.039892+0000","last_active":"2023-10-16T20:08:13.097315+0000","last_peered":"2023-10-16T20:08:13.097315+0000","last_clean":"2023-10-16T20:08:13.097315+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:13.097315+0000","last_undegraded":"2023-10-16T20:08:13.097315+0000","last_fullsized":"2023-10-16T20:08:13.097315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:51.008808+0000","last_clean_scrub_stamp":"2023-10-16T20:07:51.008808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.800563+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:14.800563+0000","last_peered":"2023-10-16T20:08:14.800563+0000","last_clean":"2023-10-16T20:08:14.800563+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:14.800563+0000","last_undegraded":"2023-10-16T20:08:14.800563+0000","last_fullsized":"2023-10-16T20:08:14.800563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.496,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73699999999999999,"5min":0.755,"15min":0.755},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73399999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72899999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71699999999999997,"5min":1.218,"15min":1.218},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.69099999999999995,"15min":0.71599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":1.391,"15min":1.391},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60299999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75900000000000001,"5min":1.516,"15min":1.516},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.68000000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.749,"15min":0.78000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71199999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.849,"15min":1.849},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.79600000000000004,"15min":0.82599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":2.585,"15min":2.585},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.77800000000000002,"5min":1.115,"15min":1.115},"last":0.55300000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.498,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.621,"15min":0.621},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54700000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.626,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38400000000000001,"15min":0.38500000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.435}]},{"osd":4,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96599999999999997,"5min":1.153,"15min":1.153},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82599999999999996,"5min":1.214,"15min":1.214},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.84099999999999997,"5min":1.135,"15min":1.135},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85899999999999999,"5min":1.05,"15min":1.05},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.62,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":2.798,"15min":2.798},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.41599999999999998,"15min":0.42299999999999999},"min":{"1min":0.26300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.57899999999999996,"5min":1.087,"15min":1.087},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.46800000000000003,"15min":0.48299999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56499999999999995,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55400000000000005,"5min":1.218,"15min":1.218},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60299999999999998,"5min":2.754,"15min":2.754},"last":0.34499999999999997}]},{"osd":4,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76700000000000002,"5min":1.125,"15min":1.125},"last":0.626},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.71999999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.879,"5min":1.246,"15min":1.246},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66000000000000003,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94799999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80500000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.622},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":1.153,"15min":1.153},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.188,"15min":0.188},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.37,"15min":0.37},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.42099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.373},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.35499999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.495,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54900000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72899999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59699999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.505}]}]},{"osd":3,"up_from":14,"seq":60129542175,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.22,"15min":0.22},"max":{"1min":0.376,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.32400000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52600000000000002,"5min":0.63,"15min":0.63},"last":0.377},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78200000000000003,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44500000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98699999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.496},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":0.876,"15min":0.876},"last":0.748}]}]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77100000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.65700000000000003,"15min":0.68100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":2.899,"15min":2.899},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80000000000000004,"5min":1.24,"15min":1.24},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.753,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77600000000000002,"5min":0.872,"15min":0.872},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52600000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.623},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84499999999999997,"5min":1.046,"15min":1.046},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70199999999999996}]},{"osd":1,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81200000000000006,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68100000000000005}]},{"osd":2,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.87,"15min":0.87},"last":0.64800000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":1.103,"15min":1.103},"last":0.755},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79700000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66800000000000004,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.546,"15min":1.546},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.70899999999999996,"15min":0.73299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.57899999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84599999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:32.771 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.771 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.771 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.772 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.772 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.773 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.773 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.773 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.774 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.774 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.774 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.775 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.775 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.776 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.776 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.776 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.777 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.777 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.778 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.778 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.778 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.779 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.779 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.780 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.780 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.780 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.781 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.781 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.782 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.782 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.783 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.783 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.783 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.784 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.784 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.785 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.785 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.785 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.786 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.786 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.787 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.787 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.788 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.788 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.788 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.789 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.789 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-16T20:07:51.008808+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=51, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:32.790 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:08:52.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:08:52.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.924+0000 7f8c835e3700 1 Processor -- start 2023-10-16T20:08:52.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.924+0000 7f8c835e3700 1 -- start start 2023-10-16T20:08:52.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c835e3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8c7c0712e0 0x7f8c7c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c835e3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 0x7f8c7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c835e3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c071c00 con 0x7f8c7c06cf10 2023-10-16T20:08:52.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c835e3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c06d9d0 con 0x7f8c7c0712e0 2023-10-16T20:08:52.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c835e3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c06dcb0 con 0x7f8c7c0cbf10 2023-10-16T20:08:52.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c80b7e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8c7c06cf10 0x7f8c7c06a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41618/0 (socket says 172.21.15.152:41618) 2023-10-16T20:08:52.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.925+0000 7f8c80b7e700 1 -- 172.21.15.152:0/148247126 learned_addr learned my addr 172.21.15.152:0/148247126 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:08:52.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333384181 0 0) 0x7f8c7c071c00 con 0x7f8c7c06cf10 2023-10-16T20:08:52.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c81b80700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 0x7f8c7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c8137f700 1 --2- 172.21.15.152:0/148247126 >> v2:172.21.15.163:3300/0 conn(0x7f8c7c0712e0 0x7f8c7c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c680046c0 con 0x7f8c7c06cf10 2023-10-16T20:08:52.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768372581 0 0) 0x7f8c680046c0 con 0x7f8c7c06cf10 2023-10-16T20:08:52.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 msgr2=0x7f8c7c06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:52.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 0x7f8c7c06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:52.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 >> v2:172.21.15.163:3300/0 conn(0x7f8c7c0712e0 msgr2=0x7f8c7c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:52.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 --2- 172.21.15.152:0/148247126 >> v2:172.21.15.163:3300/0 conn(0x7f8c7c0712e0 0x7f8c7c0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:52.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0ca420 con 0x7f8c7c06cf10 2023-10-16T20:08:52.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f8c78001670 con 0x7f8c7c06cf10 2023-10-16T20:08:52.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 >> v1:172.21.15.152:6789/0 conn(0x7f8c7c06cf10 legacy=0x7f8c7c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:52.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 0x7f8c68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c68005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c68005ea0 0x7f8c68006320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c06d9d0 con 0x7f8c680050e0 2023-10-16T20:08:52.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c06dcb0 con 0x7f8c68005ea0 2023-10-16T20:08:52.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68003560 con 0x7f8c7c0cbf10 2023-10-16T20:08:52.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c68005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c8137f700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 0x7f8c68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c81b80700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c68005ea0 0x7f8c68006320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 -- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 msgr2=0x7f8c68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:52.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0cbf10 0x7f8c68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:52.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 -- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c68005ea0 msgr2=0x7f8c68006320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:08:52.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c68005ea0 0x7f8c68006320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:52.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 -- 172.21.15.152:0/148247126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680046c0 con 0x7f8c680050e0 2023-10-16T20:08:52.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.926+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c68005960 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c68006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5132b89f6d24567e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:52.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800cd40 con 0x7f8c680050e0 2023-10-16T20:08:52.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78005960 con 0x7f8c680050e0 2023-10-16T20:08:52.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c73fff700 1 -- 172.21.15.152:0/148247126 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800cea0 con 0x7f8c680050e0 2023-10-16T20:08:52.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c835e3700 1 -- 172.21.15.152:0/148247126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 msgr2=0x7f8c68005960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:52.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c835e3700 1 --2- 172.21.15.152:0/148247126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c68005960 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c68006990 comp rx=0 tx=0).stop 2023-10-16T20:08:52.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c81b80700 1 -- 172.21.15.152:0/148247126 reap_dead start 2023-10-16T20:08:52.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c835e3700 1 -- 172.21.15.152:0/148247126 shutdown_connections 2023-10-16T20:08:52.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c835e3700 1 -- 172.21.15.152:0/148247126 >> 172.21.15.152:0/148247126 conn(0x7f8c7c0cfcd0 msgr2=0x7f8c7c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:52.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c835e3700 1 -- 172.21.15.152:0/148247126 shutdown_connections 2023-10-16T20:08:52.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.927+0000 7f8c835e3700 1 -- 172.21.15.152:0/148247126 wait complete. 2023-10-16T20:08:52.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 Processor -- start 2023-10-16T20:08:52.944 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 -- start start 2023-10-16T20:08:52.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c7c0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0c3700 0x7f8c7c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c7c0c6c20 0x7f8c7c0c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c1e2920 con 0x7f8c680050e0 2023-10-16T20:08:52.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c1f7430 con 0x7f8c7c0c6c20 2023-10-16T20:08:52.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c835e3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c1e2260 con 0x7f8c7c0c3700 2023-10-16T20:08:52.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c8137f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c7c0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c8137f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c7c0c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33200/0 (socket says 172.21.15.152:33200) 2023-10-16T20:08:52.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.929+0000 7f8c8137f700 1 -- 172.21.15.152:0/3923974851 learned_addr learned my addr 172.21.15.152:0/3923974851 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:08:52.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c81b80700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c7c0c6c20 0x7f8c7c0c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0c3700 0x7f8c7c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c8137f700 1 -- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0c3700 msgr2=0x7f8c7c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:52.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c8137f700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0c3700 0x7f8c7c1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:52.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c8137f700 1 -- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c7c0c6c20 msgr2=0x7f8c7c0c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:52.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c8137f700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c7c0c6c20 0x7f8c7c0c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:52.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c8137f700 1 -- 172.21.15.152:0/3923974851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c1e2540 con 0x7f8c680050e0 2023-10-16T20:08:52.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0c3700 0x7f8c7c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:52.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c81b80700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c7c0c6c20 0x7f8c7c0c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:08:52.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c8137f700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c7c0c3db0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c008700 tx=0x7f8c6c008ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:52.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c01c070 con 0x7f8c680050e0 2023-10-16T20:08:52.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c011040 con 0x7f8c680050e0 2023-10-16T20:08:52.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c1f70e0 con 0x7f8c680050e0 2023-10-16T20:08:52.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c010050 con 0x7f8c680050e0 2023-10-16T20:08:52.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.930+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c0c7280 con 0x7f8c680050e0 2023-10-16T20:08:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.931+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c1e2b90 con 0x7f8c680050e0 2023-10-16T20:08:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.932+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c6c009cf0 con 0x7f8c680050e0 2023-10-16T20:08:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.932+0000 7f8c71ffb700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8c6006af00 0x7f8c6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:08:52.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.932+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f8c6c089f10 con 0x7f8c680050e0 2023-10-16T20:08:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.932+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8c6006af00 0x7f8c6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:08:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.932+0000 7f8c80b7e700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8c6006af00 0x7f8c6006d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c7800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:08:52.955 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:52.936+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c6c054ee0 con 0x7f8c680050e0 2023-10-16T20:08:53.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.124+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c7c1e20e0 con 0x7f8c6006af00 2023-10-16T20:08:53.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.131+0000 7f8c71ffb700 1 -- 172.21.15.152:0/3923974851 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289475 (secure 0 0 0) 0x7f8c78001670 con 0x7f8c6006af00 2023-10-16T20:08:53.138 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:08:53.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8c6006af00 msgr2=0x7f8c6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:53.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8c6006af00 0x7f8c6006d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c7800a000 comp rx=0 tx=0).stop 2023-10-16T20:08:53.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 msgr2=0x7f8c7c0c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:08:53.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c7c0c3db0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c008700 tx=0x7f8c6c008ac0 comp rx=0 tx=0).stop 2023-10-16T20:08:53.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 shutdown_connections 2023-10-16T20:08:53.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f8c6006af00 0x7f8c6006d3c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:53.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c7c0c6c20 0x7f8c7c0c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:53.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c680050e0 0x7f8c7c0c3db0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:53.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 --2- 172.21.15.152:0/3923974851 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f8c7c0c3700 0x7f8c7c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:08:53.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 >> 172.21.15.152:0/3923974851 conn(0x7f8c7c0cfcd0 msgr2=0x7f8c7c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:08:53.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 shutdown_connections 2023-10-16T20:08:53.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:08:53.135+0000 7f8c835e3700 1 -- 172.21.15.152:0/3923974851 wait complete. 2023-10-16T20:08:53.144 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:08:53.150 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-10-16T20:08:52.799535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003303"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681867+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681867+0000","last_peered":"2023-10-16T20:08:25.681867+0000","last_clean":"2023-10-16T20:08:25.681867+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681867+0000","last_undegraded":"2023-10-16T20:08:25.681867+0000","last_fullsized":"2023-10-16T20:08:25.681867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095947+0000","last_change":"2023-10-16T20:07:53.033287+0000","last_active":"2023-10-16T20:08:13.095947+0000","last_peered":"2023-10-16T20:08:13.095947+0000","last_clean":"2023-10-16T20:08:13.095947+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:13.095947+0000","last_undegraded":"2023-10-16T20:08:13.095947+0000","last_fullsized":"2023-10-16T20:08:13.095947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568727+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568727+0000","last_peered":"2023-10-16T20:08:27.568727+0000","last_clean":"2023-10-16T20:08:27.568727+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568727+0000","last_undegraded":"2023-10-16T20:08:27.568727+0000","last_fullsized":"2023-10-16T20:08:27.568727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499254+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499254+0000","last_peered":"2023-10-16T20:08:20.499254+0000","last_clean":"2023-10-16T20:08:20.499254+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499254+0000","last_undegraded":"2023-10-16T20:08:20.499254+0000","last_fullsized":"2023-10-16T20:08:20.499254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509595+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509595+0000","last_peered":"2023-10-16T20:08:15.509595+0000","last_clean":"2023-10-16T20:08:15.509595+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509595+0000","last_undegraded":"2023-10-16T20:08:15.509595+0000","last_fullsized":"2023-10-16T20:08:15.509595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157235+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157235+0000","last_peered":"2023-10-16T20:08:25.157235+0000","last_clean":"2023-10-16T20:08:25.157235+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157235+0000","last_undegraded":"2023-10-16T20:08:25.157235+0000","last_fullsized":"2023-10-16T20:08:25.157235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099899+0000","last_change":"2023-10-16T20:07:53.048860+0000","last_active":"2023-10-16T20:08:13.099899+0000","last_peered":"2023-10-16T20:08:13.099899+0000","last_clean":"2023-10-16T20:08:13.099899+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:13.099899+0000","last_undegraded":"2023-10-16T20:08:13.099899+0000","last_fullsized":"2023-10-16T20:08:13.099899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596658+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596658+0000","last_peered":"2023-10-16T20:08:42.596658+0000","last_clean":"2023-10-16T20:08:42.596658+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596658+0000","last_undegraded":"2023-10-16T20:08:42.596658+0000","last_fullsized":"2023-10-16T20:08:42.596658+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606037+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606037+0000","last_peered":"2023-10-16T20:08:35.606037+0000","last_clean":"2023-10-16T20:08:35.606037+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606037+0000","last_undegraded":"2023-10-16T20:08:35.606037+0000","last_fullsized":"2023-10-16T20:08:35.606037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885823+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885823+0000","last_peered":"2023-10-16T20:08:48.885823+0000","last_clean":"2023-10-16T20:08:48.885823+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885823+0000","last_undegraded":"2023-10-16T20:08:48.885823+0000","last_fullsized":"2023-10-16T20:08:48.885823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958911+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958911+0000","last_peered":"2023-10-16T20:08:34.958911+0000","last_clean":"2023-10-16T20:08:34.958911+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958911+0000","last_undegraded":"2023-10-16T20:08:34.958911+0000","last_fullsized":"2023-10-16T20:08:34.958911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500913+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500913+0000","last_peered":"2023-10-16T20:08:24.500913+0000","last_clean":"2023-10-16T20:08:24.500913+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500913+0000","last_undegraded":"2023-10-16T20:08:24.500913+0000","last_fullsized":"2023-10-16T20:08:24.500913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099902+0000","last_change":"2023-10-16T20:07:53.053726+0000","last_active":"2023-10-16T20:08:13.099902+0000","last_peered":"2023-10-16T20:08:13.099902+0000","last_clean":"2023-10-16T20:08:13.099902+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:13.099902+0000","last_undegraded":"2023-10-16T20:08:13.099902+0000","last_fullsized":"2023-10-16T20:08:13.099902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399610+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399610+0000","last_peered":"2023-10-16T20:08:34.399610+0000","last_clean":"2023-10-16T20:08:34.399610+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399610+0000","last_undegraded":"2023-10-16T20:08:34.399610+0000","last_fullsized":"2023-10-16T20:08:34.399610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.099707+0000","last_change":"2023-10-16T20:07:53.052785+0000","last_active":"2023-10-16T20:08:13.099707+0000","last_peered":"2023-10-16T20:08:13.099707+0000","last_clean":"2023-10-16T20:08:13.099707+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:08:13.099707+0000","last_undegraded":"2023-10-16T20:08:13.099707+0000","last_fullsized":"2023-10-16T20:08:13.099707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412489+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412489+0000","last_peered":"2023-10-16T20:08:48.412489+0000","last_clean":"2023-10-16T20:08:48.412489+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412489+0000","last_undegraded":"2023-10-16T20:08:48.412489+0000","last_fullsized":"2023-10-16T20:08:48.412489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097390+0000","last_change":"2023-10-16T20:07:53.054658+0000","last_active":"2023-10-16T20:08:13.097390+0000","last_peered":"2023-10-16T20:08:13.097390+0000","last_clean":"2023-10-16T20:08:13.097390+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:08:13.097390+0000","last_undegraded":"2023-10-16T20:08:13.097390+0000","last_fullsized":"2023-10-16T20:08:13.097390+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475166+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475166+0000","last_peered":"2023-10-16T20:08:29.475166+0000","last_clean":"2023-10-16T20:08:29.475166+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475166+0000","last_undegraded":"2023-10-16T20:08:29.475166+0000","last_fullsized":"2023-10-16T20:08:29.475166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504133+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504133+0000","last_peered":"2023-10-16T20:08:21.504133+0000","last_clean":"2023-10-16T20:08:21.504133+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504133+0000","last_undegraded":"2023-10-16T20:08:21.504133+0000","last_fullsized":"2023-10-16T20:08:21.504133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354233+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354233+0000","last_peered":"2023-10-16T20:08:37.354233+0000","last_clean":"2023-10-16T20:08:37.354233+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354233+0000","last_undegraded":"2023-10-16T20:08:37.354233+0000","last_fullsized":"2023-10-16T20:08:37.354233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895381+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895381+0000","last_peered":"2023-10-16T20:08:38.895381+0000","last_clean":"2023-10-16T20:08:38.895381+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895381+0000","last_undegraded":"2023-10-16T20:08:38.895381+0000","last_fullsized":"2023-10-16T20:08:38.895381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399673+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399673+0000","last_peered":"2023-10-16T20:08:42.399673+0000","last_clean":"2023-10-16T20:08:42.399673+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399673+0000","last_undegraded":"2023-10-16T20:08:42.399673+0000","last_fullsized":"2023-10-16T20:08:42.399673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096523+0000","last_change":"2023-10-16T20:07:53.056496+0000","last_active":"2023-10-16T20:08:13.096523+0000","last_peered":"2023-10-16T20:08:13.096523+0000","last_clean":"2023-10-16T20:08:13.096523+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:13.096523+0000","last_undegraded":"2023-10-16T20:08:13.096523+0000","last_fullsized":"2023-10-16T20:08:13.096523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544178+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544178+0000","last_peered":"2023-10-16T20:08:14.544178+0000","last_clean":"2023-10-16T20:08:14.544178+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544178+0000","last_undegraded":"2023-10-16T20:08:14.544178+0000","last_fullsized":"2023-10-16T20:08:14.544178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494631+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494631+0000","last_peered":"2023-10-16T20:08:30.494631+0000","last_clean":"2023-10-16T20:08:30.494631+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494631+0000","last_undegraded":"2023-10-16T20:08:30.494631+0000","last_fullsized":"2023-10-16T20:08:30.494631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161600+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161600+0000","last_peered":"2023-10-16T20:08:23.161600+0000","last_clean":"2023-10-16T20:08:23.161600+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161600+0000","last_undegraded":"2023-10-16T20:08:23.161600+0000","last_fullsized":"2023-10-16T20:08:23.161600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392429+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392429+0000","last_peered":"2023-10-16T20:08:36.392429+0000","last_clean":"2023-10-16T20:08:36.392429+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392429+0000","last_undegraded":"2023-10-16T20:08:36.392429+0000","last_fullsized":"2023-10-16T20:08:36.392429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.100076+0000","last_change":"2023-10-16T20:07:53.041450+0000","last_active":"2023-10-16T20:08:13.100076+0000","last_peered":"2023-10-16T20:08:13.100076+0000","last_clean":"2023-10-16T20:08:13.100076+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:13.100076+0000","last_undegraded":"2023-10-16T20:08:13.100076+0000","last_fullsized":"2023-10-16T20:08:13.100076+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409793+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409793+0000","last_peered":"2023-10-16T20:08:27.409793+0000","last_clean":"2023-10-16T20:08:27.409793+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409793+0000","last_undegraded":"2023-10-16T20:08:27.409793+0000","last_fullsized":"2023-10-16T20:08:27.409793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423048+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423048+0000","last_peered":"2023-10-16T20:08:24.423048+0000","last_clean":"2023-10-16T20:08:24.423048+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423048+0000","last_undegraded":"2023-10-16T20:08:24.423048+0000","last_fullsized":"2023-10-16T20:08:24.423048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096435+0000","last_change":"2023-10-16T20:07:53.054523+0000","last_active":"2023-10-16T20:08:13.096435+0000","last_peered":"2023-10-16T20:08:13.096435+0000","last_clean":"2023-10-16T20:08:13.096435+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:08:13.096435+0000","last_undegraded":"2023-10-16T20:08:13.096435+0000","last_fullsized":"2023-10-16T20:08:13.096435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158022+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158022+0000","last_peered":"2023-10-16T20:08:29.158022+0000","last_clean":"2023-10-16T20:08:29.158022+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158022+0000","last_undegraded":"2023-10-16T20:08:29.158022+0000","last_fullsized":"2023-10-16T20:08:29.158022+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306578+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306578+0000","last_peered":"2023-10-16T20:08:35.306578+0000","last_clean":"2023-10-16T20:08:35.306578+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306578+0000","last_undegraded":"2023-10-16T20:08:35.306578+0000","last_fullsized":"2023-10-16T20:08:35.306578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439516+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439516+0000","last_peered":"2023-10-16T20:08:23.439516+0000","last_clean":"2023-10-16T20:08:23.439516+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439516+0000","last_undegraded":"2023-10-16T20:08:23.439516+0000","last_fullsized":"2023-10-16T20:08:23.439516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102269+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102269+0000","last_peered":"2023-10-16T20:08:31.102269+0000","last_clean":"2023-10-16T20:08:31.102269+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102269+0000","last_undegraded":"2023-10-16T20:08:31.102269+0000","last_fullsized":"2023-10-16T20:08:31.102269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098759+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:13.098759+0000","last_peered":"2023-10-16T20:08:13.098759+0000","last_clean":"2023-10-16T20:08:13.098759+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:13.098759+0000","last_undegraded":"2023-10-16T20:08:13.098759+0000","last_fullsized":"2023-10-16T20:08:13.098759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386361+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386361+0000","last_peered":"2023-10-16T20:08:38.386361+0000","last_clean":"2023-10-16T20:08:38.386361+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386361+0000","last_undegraded":"2023-10-16T20:08:38.386361+0000","last_fullsized":"2023-10-16T20:08:38.386361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255050+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255050+0000","last_peered":"2023-10-16T20:08:15.255050+0000","last_clean":"2023-10-16T20:08:15.255050+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255050+0000","last_undegraded":"2023-10-16T20:08:15.255050+0000","last_fullsized":"2023-10-16T20:08:15.255050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096155+0000","last_change":"2023-10-16T20:07:53.037732+0000","last_active":"2023-10-16T20:08:13.096155+0000","last_peered":"2023-10-16T20:08:13.096155+0000","last_clean":"2023-10-16T20:08:13.096155+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:08:13.096155+0000","last_undegraded":"2023-10-16T20:08:13.096155+0000","last_fullsized":"2023-10-16T20:08:13.096155+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428235+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428235+0000","last_peered":"2023-10-16T20:08:22.428235+0000","last_clean":"2023-10-16T20:08:22.428235+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428235+0000","last_undegraded":"2023-10-16T20:08:22.428235+0000","last_fullsized":"2023-10-16T20:08:22.428235+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528304+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528304+0000","last_peered":"2023-10-16T20:08:29.528304+0000","last_clean":"2023-10-16T20:08:29.528304+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528304+0000","last_undegraded":"2023-10-16T20:08:29.528304+0000","last_fullsized":"2023-10-16T20:08:29.528304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920349+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920349+0000","last_peered":"2023-10-16T20:08:15.920349+0000","last_clean":"2023-10-16T20:08:15.920349+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920349+0000","last_undegraded":"2023-10-16T20:08:15.920349+0000","last_fullsized":"2023-10-16T20:08:15.920349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902452+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902452+0000","last_peered":"2023-10-16T20:08:47.902452+0000","last_clean":"2023-10-16T20:08:47.902452+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902452+0000","last_undegraded":"2023-10-16T20:08:47.902452+0000","last_fullsized":"2023-10-16T20:08:47.902452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469599+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469599+0000","last_peered":"2023-10-16T20:08:27.469599+0000","last_clean":"2023-10-16T20:08:27.469599+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469599+0000","last_undegraded":"2023-10-16T20:08:27.469599+0000","last_fullsized":"2023-10-16T20:08:27.469599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441151+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441151+0000","last_peered":"2023-10-16T20:08:40.441151+0000","last_clean":"2023-10-16T20:08:40.441151+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441151+0000","last_undegraded":"2023-10-16T20:08:40.441151+0000","last_fullsized":"2023-10-16T20:08:40.441151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248069+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248069+0000","last_peered":"2023-10-16T20:08:14.248069+0000","last_clean":"2023-10-16T20:08:14.248069+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248069+0000","last_undegraded":"2023-10-16T20:08:14.248069+0000","last_fullsized":"2023-10-16T20:08:14.248069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095870+0000","last_change":"2023-10-16T20:07:53.051417+0000","last_active":"2023-10-16T20:08:13.095870+0000","last_peered":"2023-10-16T20:08:13.095870+0000","last_clean":"2023-10-16T20:08:13.095870+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:13.095870+0000","last_undegraded":"2023-10-16T20:08:13.095870+0000","last_fullsized":"2023-10-16T20:08:13.095870+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362399+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362399+0000","last_peered":"2023-10-16T20:08:15.362399+0000","last_clean":"2023-10-16T20:08:15.362399+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362399+0000","last_undegraded":"2023-10-16T20:08:15.362399+0000","last_fullsized":"2023-10-16T20:08:15.362399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466503+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466503+0000","last_peered":"2023-10-16T20:08:23.466503+0000","last_clean":"2023-10-16T20:08:23.466503+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466503+0000","last_undegraded":"2023-10-16T20:08:23.466503+0000","last_fullsized":"2023-10-16T20:08:23.466503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096251+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:13.096251+0000","last_peered":"2023-10-16T20:08:13.096251+0000","last_clean":"2023-10-16T20:08:13.096251+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:13.096251+0000","last_undegraded":"2023-10-16T20:08:13.096251+0000","last_fullsized":"2023-10-16T20:08:13.096251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096755+0000","last_change":"2023-10-16T20:07:53.047507+0000","last_active":"2023-10-16T20:08:13.096755+0000","last_peered":"2023-10-16T20:08:13.096755+0000","last_clean":"2023-10-16T20:08:13.096755+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:13.096755+0000","last_undegraded":"2023-10-16T20:08:13.096755+0000","last_fullsized":"2023-10-16T20:08:13.096755+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950617+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950617+0000","last_peered":"2023-10-16T20:08:17.950617+0000","last_clean":"2023-10-16T20:08:17.950617+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950617+0000","last_undegraded":"2023-10-16T20:08:17.950617+0000","last_fullsized":"2023-10-16T20:08:17.950617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548212+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548212+0000","last_peered":"2023-10-16T20:08:26.548212+0000","last_clean":"2023-10-16T20:08:26.548212+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548212+0000","last_undegraded":"2023-10-16T20:08:26.548212+0000","last_fullsized":"2023-10-16T20:08:26.548212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926512+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926512+0000","last_peered":"2023-10-16T20:08:16.926512+0000","last_clean":"2023-10-16T20:08:16.926512+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926512+0000","last_undegraded":"2023-10-16T20:08:16.926512+0000","last_fullsized":"2023-10-16T20:08:16.926512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406316+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406316+0000","last_peered":"2023-10-16T20:08:32.406316+0000","last_clean":"2023-10-16T20:08:32.406316+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406316+0000","last_undegraded":"2023-10-16T20:08:32.406316+0000","last_fullsized":"2023-10-16T20:08:32.406316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713006+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713006+0000","last_peered":"2023-10-16T20:08:14.713006+0000","last_clean":"2023-10-16T20:08:14.713006+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713006+0000","last_undegraded":"2023-10-16T20:08:14.713006+0000","last_fullsized":"2023-10-16T20:08:14.713006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563193+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563193+0000","last_peered":"2023-10-16T20:08:34.563193+0000","last_clean":"2023-10-16T20:08:34.563193+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563193+0000","last_undegraded":"2023-10-16T20:08:34.563193+0000","last_fullsized":"2023-10-16T20:08:34.563193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.742868+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:13.742868+0000","last_peered":"2023-10-16T20:08:13.742868+0000","last_clean":"2023-10-16T20:08:13.742868+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:13.742868+0000","last_undegraded":"2023-10-16T20:08:13.742868+0000","last_fullsized":"2023-10-16T20:08:13.742868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675138+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675138+0000","last_peered":"2023-10-16T20:08:16.675138+0000","last_clean":"2023-10-16T20:08:16.675138+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675138+0000","last_undegraded":"2023-10-16T20:08:16.675138+0000","last_fullsized":"2023-10-16T20:08:16.675138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235501+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235501+0000","last_peered":"2023-10-16T20:08:19.235501+0000","last_clean":"2023-10-16T20:08:19.235501+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235501+0000","last_undegraded":"2023-10-16T20:08:19.235501+0000","last_fullsized":"2023-10-16T20:08:19.235501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333766+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333766+0000","last_peered":"2023-10-16T20:08:32.333766+0000","last_clean":"2023-10-16T20:08:32.333766+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333766+0000","last_undegraded":"2023-10-16T20:08:32.333766+0000","last_fullsized":"2023-10-16T20:08:32.333766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486417+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486417+0000","last_peered":"2023-10-16T20:08:21.486417+0000","last_clean":"2023-10-16T20:08:21.486417+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486417+0000","last_undegraded":"2023-10-16T20:08:21.486417+0000","last_fullsized":"2023-10-16T20:08:21.486417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663909+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663909+0000","last_peered":"2023-10-16T20:08:20.663909+0000","last_clean":"2023-10-16T20:08:20.663909+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663909+0000","last_undegraded":"2023-10-16T20:08:20.663909+0000","last_fullsized":"2023-10-16T20:08:20.663909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713806+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713806+0000","last_peered":"2023-10-16T20:08:17.713806+0000","last_clean":"2023-10-16T20:08:17.713806+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713806+0000","last_undegraded":"2023-10-16T20:08:17.713806+0000","last_fullsized":"2023-10-16T20:08:17.713806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777216+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777216+0000","last_peered":"2023-10-16T20:08:27.777216+0000","last_clean":"2023-10-16T20:08:27.777216+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777216+0000","last_undegraded":"2023-10-16T20:08:27.777216+0000","last_fullsized":"2023-10-16T20:08:27.777216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018817+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018817+0000","last_peered":"2023-10-16T20:08:30.018817+0000","last_clean":"2023-10-16T20:08:30.018817+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018817+0000","last_undegraded":"2023-10-16T20:08:30.018817+0000","last_fullsized":"2023-10-16T20:08:30.018817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948055+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948055+0000","last_peered":"2023-10-16T20:08:31.948055+0000","last_clean":"2023-10-16T20:08:31.948055+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948055+0000","last_undegraded":"2023-10-16T20:08:31.948055+0000","last_fullsized":"2023-10-16T20:08:31.948055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504674+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504674+0000","last_peered":"2023-10-16T20:08:24.504674+0000","last_clean":"2023-10-16T20:08:24.504674+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504674+0000","last_undegraded":"2023-10-16T20:08:24.504674+0000","last_fullsized":"2023-10-16T20:08:24.504674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456845+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456845+0000","last_peered":"2023-10-16T20:08:27.456845+0000","last_clean":"2023-10-16T20:08:27.456845+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456845+0000","last_undegraded":"2023-10-16T20:08:27.456845+0000","last_fullsized":"2023-10-16T20:08:27.456845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245520+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:13.245520+0000","last_peered":"2023-10-16T20:08:13.245520+0000","last_clean":"2023-10-16T20:08:13.245520+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:13.245520+0000","last_undegraded":"2023-10-16T20:08:13.245520+0000","last_fullsized":"2023-10-16T20:08:13.245520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482362+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482362+0000","last_peered":"2023-10-16T20:08:16.482362+0000","last_clean":"2023-10-16T20:08:16.482362+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482362+0000","last_undegraded":"2023-10-16T20:08:16.482362+0000","last_fullsized":"2023-10-16T20:08:16.482362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190507+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190507+0000","last_peered":"2023-10-16T20:08:20.190507+0000","last_clean":"2023-10-16T20:08:20.190507+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190507+0000","last_undegraded":"2023-10-16T20:08:20.190507+0000","last_fullsized":"2023-10-16T20:08:20.190507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096365+0000","last_change":"2023-10-16T20:07:53.057996+0000","last_active":"2023-10-16T20:08:13.096365+0000","last_peered":"2023-10-16T20:08:13.096365+0000","last_clean":"2023-10-16T20:08:13.096365+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:13.096365+0000","last_undegraded":"2023-10-16T20:08:13.096365+0000","last_fullsized":"2023-10-16T20:08:13.096365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245230+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:13.245230+0000","last_peered":"2023-10-16T20:08:13.245230+0000","last_clean":"2023-10-16T20:08:13.245230+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:13.245230+0000","last_undegraded":"2023-10-16T20:08:13.245230+0000","last_fullsized":"2023-10-16T20:08:13.245230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465756+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465756+0000","last_peered":"2023-10-16T20:08:23.465756+0000","last_clean":"2023-10-16T20:08:23.465756+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465756+0000","last_undegraded":"2023-10-16T20:08:23.465756+0000","last_fullsized":"2023-10-16T20:08:23.465756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245232+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:13.245232+0000","last_peered":"2023-10-16T20:08:13.245232+0000","last_clean":"2023-10-16T20:08:13.245232+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:13.245232+0000","last_undegraded":"2023-10-16T20:08:13.245232+0000","last_fullsized":"2023-10-16T20:08:13.245232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918527+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918527+0000","last_peered":"2023-10-16T20:08:32.918527+0000","last_clean":"2023-10-16T20:08:32.918527+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918527+0000","last_undegraded":"2023-10-16T20:08:32.918527+0000","last_fullsized":"2023-10-16T20:08:32.918527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581835+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581835+0000","last_peered":"2023-10-16T20:08:24.581835+0000","last_clean":"2023-10-16T20:08:24.581835+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581835+0000","last_undegraded":"2023-10-16T20:08:24.581835+0000","last_fullsized":"2023-10-16T20:08:24.581835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690419+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690419+0000","last_peered":"2023-10-16T20:08:46.690419+0000","last_clean":"2023-10-16T20:08:46.690419+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690419+0000","last_undegraded":"2023-10-16T20:08:46.690419+0000","last_fullsized":"2023-10-16T20:08:46.690419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.573398+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:13.573398+0000","last_peered":"2023-10-16T20:08:13.573398+0000","last_clean":"2023-10-16T20:08:13.573398+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:13.573398+0000","last_undegraded":"2023-10-16T20:08:13.573398+0000","last_fullsized":"2023-10-16T20:08:13.573398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148034+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148034+0000","last_peered":"2023-10-16T20:08:33.148034+0000","last_clean":"2023-10-16T20:08:33.148034+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148034+0000","last_undegraded":"2023-10-16T20:08:33.148034+0000","last_fullsized":"2023-10-16T20:08:33.148034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974925+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974925+0000","last_peered":"2023-10-16T20:08:20.974925+0000","last_clean":"2023-10-16T20:08:20.974925+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974925+0000","last_undegraded":"2023-10-16T20:08:20.974925+0000","last_fullsized":"2023-10-16T20:08:20.974925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096836+0000","last_change":"2023-10-16T20:07:53.047540+0000","last_active":"2023-10-16T20:08:13.096836+0000","last_peered":"2023-10-16T20:08:13.096836+0000","last_clean":"2023-10-16T20:08:13.096836+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:13.096836+0000","last_undegraded":"2023-10-16T20:08:13.096836+0000","last_fullsized":"2023-10-16T20:08:13.096836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245481+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:13.245481+0000","last_peered":"2023-10-16T20:08:13.245481+0000","last_clean":"2023-10-16T20:08:13.245481+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:13.245481+0000","last_undegraded":"2023-10-16T20:08:13.245481+0000","last_fullsized":"2023-10-16T20:08:13.245481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096051+0000","last_change":"2023-10-16T20:07:53.037428+0000","last_active":"2023-10-16T20:08:13.096051+0000","last_peered":"2023-10-16T20:08:13.096051+0000","last_clean":"2023-10-16T20:08:13.096051+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:08:13.096051+0000","last_undegraded":"2023-10-16T20:08:13.096051+0000","last_fullsized":"2023-10-16T20:08:13.096051+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449268+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449268+0000","last_peered":"2023-10-16T20:08:20.449268+0000","last_clean":"2023-10-16T20:08:20.449268+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449268+0000","last_undegraded":"2023-10-16T20:08:20.449268+0000","last_fullsized":"2023-10-16T20:08:20.449268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526487+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526487+0000","last_peered":"2023-10-16T20:08:31.526487+0000","last_clean":"2023-10-16T20:08:31.526487+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526487+0000","last_undegraded":"2023-10-16T20:08:31.526487+0000","last_fullsized":"2023-10-16T20:08:31.526487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098579+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:13.098579+0000","last_peered":"2023-10-16T20:08:13.098579+0000","last_clean":"2023-10-16T20:08:13.098579+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:13.098579+0000","last_undegraded":"2023-10-16T20:08:13.098579+0000","last_fullsized":"2023-10-16T20:08:13.098579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101595+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101595+0000","last_peered":"2023-10-16T20:08:32.101595+0000","last_clean":"2023-10-16T20:08:32.101595+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101595+0000","last_undegraded":"2023-10-16T20:08:32.101595+0000","last_fullsized":"2023-10-16T20:08:32.101595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408942+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:13.408942+0000","last_peered":"2023-10-16T20:08:13.408942+0000","last_clean":"2023-10-16T20:08:13.408942+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:13.408942+0000","last_undegraded":"2023-10-16T20:08:13.408942+0000","last_fullsized":"2023-10-16T20:08:13.408942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407598+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407598+0000","last_peered":"2023-10-16T20:08:37.407598+0000","last_clean":"2023-10-16T20:08:37.407598+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407598+0000","last_undegraded":"2023-10-16T20:08:37.407598+0000","last_fullsized":"2023-10-16T20:08:37.407598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469198+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469198+0000","last_peered":"2023-10-16T20:08:23.469198+0000","last_clean":"2023-10-16T20:08:23.469198+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469198+0000","last_undegraded":"2023-10-16T20:08:23.469198+0000","last_fullsized":"2023-10-16T20:08:23.469198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.097148+0000","last_change":"2023-10-16T20:07:53.051202+0000","last_active":"2023-10-16T20:08:13.097148+0000","last_peered":"2023-10-16T20:08:13.097148+0000","last_clean":"2023-10-16T20:08:13.097148+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:08:13.097148+0000","last_undegraded":"2023-10-16T20:08:13.097148+0000","last_fullsized":"2023-10-16T20:08:13.097148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095679+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:13.095679+0000","last_peered":"2023-10-16T20:08:13.095679+0000","last_clean":"2023-10-16T20:08:13.095679+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:13.095679+0000","last_undegraded":"2023-10-16T20:08:13.095679+0000","last_fullsized":"2023-10-16T20:08:13.095679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.499966+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:14.499966+0000","last_peered":"2023-10-16T20:08:14.499966+0000","last_clean":"2023-10-16T20:08:14.499966+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:14.499966+0000","last_undegraded":"2023-10-16T20:08:14.499966+0000","last_fullsized":"2023-10-16T20:08:14.499966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437890+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437890+0000","last_peered":"2023-10-16T20:08:29.437890+0000","last_clean":"2023-10-16T20:08:29.437890+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437890+0000","last_undegraded":"2023-10-16T20:08:29.437890+0000","last_fullsized":"2023-10-16T20:08:29.437890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.800563+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:14.800563+0000","last_peered":"2023-10-16T20:08:14.800563+0000","last_clean":"2023-10-16T20:08:14.800563+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:14.800563+0000","last_undegraded":"2023-10-16T20:08:14.800563+0000","last_fullsized":"2023-10-16T20:08:14.800563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.496,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.52700000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73699999999999999,"5min":0.755,"15min":0.755},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54600000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.36699999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.58699999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72899999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71699999999999997,"5min":1.218,"15min":1.218},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.69099999999999995,"15min":0.71599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":1.391,"15min":1.391},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75900000000000001,"5min":1.516,"15min":1.516},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.68000000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.749,"15min":0.78000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71199999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.849,"15min":1.849},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.79600000000000004,"15min":0.82599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":2.585,"15min":2.585},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.77800000000000002,"5min":1.115,"15min":1.115},"last":0.56899999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.498,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.318},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.621,"15min":0.621},"last":0.371}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54700000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.626,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38400000000000001,"15min":0.38500000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96599999999999997,"5min":1.153,"15min":1.153},"last":0.504},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82599999999999996,"5min":1.214,"15min":1.214},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.84099999999999997,"5min":1.135,"15min":1.135},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85899999999999999,"5min":1.05,"15min":1.05},"last":0.625},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.62,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65800000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":2.798,"15min":2.798},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.41599999999999998,"15min":0.42299999999999999},"min":{"1min":0.26300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.57899999999999996,"5min":1.087,"15min":1.087},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.46800000000000003,"15min":0.48299999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56499999999999995,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55400000000000005,"5min":1.218,"15min":1.218},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60299999999999998,"5min":2.754,"15min":2.754},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76700000000000002,"5min":1.125,"15min":1.125},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.879,"5min":1.246,"15min":1.246},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66000000000000003,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94799999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.622},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":1.153,"15min":1.153},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.78200000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.188,"15min":0.188},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.315},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.37,"15min":0.37},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.42099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.434}]},{"osd":3,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.495,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.378}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72899999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72699999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.75600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.22,"15min":0.22},"max":{"1min":0.376,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52600000000000002,"5min":0.63,"15min":0.63},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.504}]},{"osd":2,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.78100000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78200000000000003,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98699999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.753},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":0.876,"15min":0.876},"last":0.876}]}]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77100000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66900000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.65700000000000003,"15min":0.68100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":2.899,"15min":2.899},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80000000000000004,"5min":1.24,"15min":1.24},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.753,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77600000000000002,"5min":0.872,"15min":0.872},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84499999999999997,"5min":1.046,"15min":1.046},"last":0.745},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81200000000000006,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82499999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.87,"15min":0.87},"last":0.77300000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":1.103,"15min":1.103},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79700000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.86599999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66800000000000004,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.546,"15min":1.546},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.70899999999999996,"15min":0.73299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84599999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:08:53.157 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.157 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.158 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.158 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.159 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.159 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.159 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.160 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.160 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.161 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.161 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.162 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.163 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.163 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.164 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.164 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:08:53.164 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:09:01.297 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:01.300 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:13.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:09:13.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.298+0000 7fd4a51ba700 1 Processor -- start 2023-10-16T20:09:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.298+0000 7fd4a51ba700 1 -- start start 2023-10-16T20:09:13.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd4a51ba700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd4a00712e0 0x7fd4a015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:13.303 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd4a51ba700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4a0144ea0 0x7fd4a00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:13.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd4a51ba700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00cd4b0 con 0x7fd4a00716c0 2023-10-16T20:09:13.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd4a51ba700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00cc150 con 0x7fd4a0144ea0 2023-10-16T20:09:13.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd4a51ba700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a015b8f0 con 0x7fd4a00712e0 2023-10-16T20:09:13.304 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd49e59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4a0144ea0 0x7fd4a00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:13.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd49f59e700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd4a00716c0 0x7fd4a006a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41642/0 (socket says 172.21.15.152:41642) 2023-10-16T20:09:13.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.299+0000 7fd49f59e700 1 -- 172.21.15.152:0/389580783 learned_addr learned my addr 172.21.15.152:0/389580783 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:09:13.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49ed9d700 1 --2- 172.21.15.152:0/389580783 >> v2:172.21.15.163:3300/0 conn(0x7fd4a00712e0 0x7fd4a015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49e59c700 1 -- 172.21.15.152:0/389580783 >> v2:172.21.15.163:3300/0 conn(0x7fd4a00712e0 msgr2=0x7fd4a015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:09:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49e59c700 1 --2- 172.21.15.152:0/389580783 >> v2:172.21.15.163:3300/0 conn(0x7fd4a00712e0 0x7fd4a015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49e59c700 1 -- 172.21.15.152:0/389580783 >> v1:172.21.15.152:6789/0 conn(0x7fd4a00716c0 legacy=0x7fd4a006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:13.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49e59c700 1 -- 172.21.15.152:0/389580783 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a015fdb0 con 0x7fd4a0144ea0 2023-10-16T20:09:13.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49dd9b700 1 -- 172.21.15.152:0/389580783 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925675997 0 0) 0x7fd4a00cd4b0 con 0x7fd4a00716c0 2023-10-16T20:09:13.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49e59c700 1 --2- 172.21.15.152:0/389580783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a0144ea0 0x7fd4a00cbc10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006ba40 tx=0x7fd490009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60674982b87ab25a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:13.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49dd9b700 1 -- 172.21.15.152:0/389580783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490011830 con 0x7fd4a0144ea0 2023-10-16T20:09:13.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49dd9b700 1 -- 172.21.15.152:0/389580783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490011990 con 0x7fd4a0144ea0 2023-10-16T20:09:13.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.300+0000 7fd49dd9b700 1 -- 172.21.15.152:0/389580783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490011d20 con 0x7fd4a0144ea0 2023-10-16T20:09:13.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 -- 172.21.15.152:0/389580783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a0144ea0 msgr2=0x7fd4a00cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:13.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/389580783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a0144ea0 0x7fd4a00cbc10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006ba40 tx=0x7fd490009b20 comp rx=0 tx=0).stop 2023-10-16T20:09:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 -- 172.21.15.152:0/389580783 shutdown_connections 2023-10-16T20:09:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/389580783 >> v2:172.21.15.163:3300/0 conn(0x7fd4a00712e0 0x7fd4a015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/389580783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a0144ea0 0x7fd4a00cbc10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 -- 172.21.15.152:0/389580783 >> 172.21.15.152:0/389580783 conn(0x7fd4a00cfcd0 msgr2=0x7fd4a00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:09:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 -- 172.21.15.152:0/389580783 shutdown_connections 2023-10-16T20:09:13.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.301+0000 7fd4a51ba700 1 -- 172.21.15.152:0/389580783 wait complete. 2023-10-16T20:09:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.302+0000 7fd4a51ba700 1 Processor -- start 2023-10-16T20:09:13.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.302+0000 7fd4a51ba700 1 -- start start 2023-10-16T20:09:13.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd4a51ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 0x7fd4a0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:13.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd4a51ba700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4a00716c0 0x7fd4a015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:13.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd4a51ba700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4a0144ea0 0x7fd4a00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:13.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd4a51ba700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c6170 con 0x7fd4a00712e0 2023-10-16T20:09:13.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd4a51ba700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01f19e0 con 0x7fd4a00716c0 2023-10-16T20:09:13.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd4a51ba700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c3410 con 0x7fd4a0144ea0 2023-10-16T20:09:13.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 0x7fd4a0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 0x7fd4a0159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33214/0 (socket says 172.21.15.152:33214) 2023-10-16T20:09:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 -- 172.21.15.152:0/3277224103 learned_addr learned my addr 172.21.15.152:0/3277224103 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:09:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49e59c700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4a00716c0 0x7fd4a015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:13.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49f59e700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4a0144ea0 0x7fd4a00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 -- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4a0144ea0 msgr2=0x7fd4a00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4a0144ea0 0x7fd4a00c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 -- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4a00716c0 msgr2=0x7fd4a015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:13.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4a00716c0 0x7fd4a015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.303+0000 7fd49ed9d700 1 -- 172.21.15.152:0/3277224103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900094a0 con 0x7fd4a00712e0 2023-10-16T20:09:13.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.304+0000 7fd49ed9d700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 0x7fd4a0159e10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd49400d800 tx=0x7fd49400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:13.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.304+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940125f0 con 0x7fd4a00712e0 2023-10-16T20:09:13.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.304+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494012750 con 0x7fd4a00712e0 2023-10-16T20:09:13.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.304+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a00c36f0 con 0x7fd4a00712e0 2023-10-16T20:09:13.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.304+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494012b00 con 0x7fd4a00712e0 2023-10-16T20:09:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.304+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a00c3cb0 con 0x7fd4a00712e0 2023-10-16T20:09:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.305+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a00c3e40 con 0x7fd4a00712e0 2023-10-16T20:09:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.305+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd494012c60 con 0x7fd4a00712e0 2023-10-16T20:09:13.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.305+0000 7fd4877fe700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd48c06af00 0x7fd48c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.306+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7fd494089b90 con 0x7fd4a00712e0 2023-10-16T20:09:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.306+0000 7fd49e59c700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd48c06af00 0x7fd48c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:13.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.306+0000 7fd49e59c700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd48c06af00 0x7fd48c06d3c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd490009790 tx=0x7fd490008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:13.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.310+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd494054a30 con 0x7fd4a00712e0 2023-10-16T20:09:13.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.495+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4a00ca2b0 con 0x7fd48c06af00 2023-10-16T20:09:13.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.503+0000 7fd4877fe700 1 -- 172.21.15.152:0/3277224103 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290255 (secure 0 0 0) 0x7fd490011b00 con 0x7fd48c06af00 2023-10-16T20:09:13.509 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:09:13.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd48c06af00 msgr2=0x7fd48c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:13.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd48c06af00 0x7fd48c06d3c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd490009790 tx=0x7fd490008030 comp rx=0 tx=0).stop 2023-10-16T20:09:13.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 msgr2=0x7fd4a0159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:13.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 0x7fd4a0159e10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd49400d800 tx=0x7fd49400dbc0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 shutdown_connections 2023-10-16T20:09:13.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fd48c06af00 0x7fd48c06d3c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fd4a0144ea0 0x7fd4a00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4a00712e0 0x7fd4a0159e10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 --2- 172.21.15.152:0/3277224103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4a00716c0 0x7fd4a015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:13.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 >> 172.21.15.152:0/3277224103 conn(0x7fd4a00cfcd0 msgr2=0x7fd4a00ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:09:13.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 shutdown_connections 2023-10-16T20:09:13.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:13.507+0000 7fd4a51ba700 1 -- 172.21.15.152:0/3277224103 wait complete. 2023-10-16T20:09:13.515 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:09:13.521 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2023-10-16T20:09:12.805177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003553"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681867+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681867+0000","last_peered":"2023-10-16T20:08:25.681867+0000","last_clean":"2023-10-16T20:08:25.681867+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681867+0000","last_undegraded":"2023-10-16T20:08:25.681867+0000","last_fullsized":"2023-10-16T20:08:25.681867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716320+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716320+0000","last_peered":"2023-10-16T20:08:48.716320+0000","last_clean":"2023-10-16T20:08:48.716320+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716320+0000","last_undegraded":"2023-10-16T20:08:48.716320+0000","last_fullsized":"2023-10-16T20:08:48.716320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568727+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568727+0000","last_peered":"2023-10-16T20:08:27.568727+0000","last_clean":"2023-10-16T20:08:27.568727+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568727+0000","last_undegraded":"2023-10-16T20:08:27.568727+0000","last_fullsized":"2023-10-16T20:08:27.568727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499254+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499254+0000","last_peered":"2023-10-16T20:08:20.499254+0000","last_clean":"2023-10-16T20:08:20.499254+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499254+0000","last_undegraded":"2023-10-16T20:08:20.499254+0000","last_fullsized":"2023-10-16T20:08:20.499254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509595+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509595+0000","last_peered":"2023-10-16T20:08:15.509595+0000","last_clean":"2023-10-16T20:08:15.509595+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509595+0000","last_undegraded":"2023-10-16T20:08:15.509595+0000","last_fullsized":"2023-10-16T20:08:15.509595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157235+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157235+0000","last_peered":"2023-10-16T20:08:25.157235+0000","last_clean":"2023-10-16T20:08:25.157235+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157235+0000","last_undegraded":"2023-10-16T20:08:25.157235+0000","last_fullsized":"2023-10-16T20:08:25.157235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.866996+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.866996+0000","last_peered":"2023-10-16T20:08:59.866996+0000","last_clean":"2023-10-16T20:08:59.866996+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.866996+0000","last_undegraded":"2023-10-16T20:08:59.866996+0000","last_fullsized":"2023-10-16T20:08:59.866996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596658+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596658+0000","last_peered":"2023-10-16T20:08:42.596658+0000","last_clean":"2023-10-16T20:08:42.596658+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596658+0000","last_undegraded":"2023-10-16T20:08:42.596658+0000","last_fullsized":"2023-10-16T20:08:42.596658+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606037+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606037+0000","last_peered":"2023-10-16T20:08:35.606037+0000","last_clean":"2023-10-16T20:08:35.606037+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606037+0000","last_undegraded":"2023-10-16T20:08:35.606037+0000","last_fullsized":"2023-10-16T20:08:35.606037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885823+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885823+0000","last_peered":"2023-10-16T20:08:48.885823+0000","last_clean":"2023-10-16T20:08:48.885823+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885823+0000","last_undegraded":"2023-10-16T20:08:48.885823+0000","last_fullsized":"2023-10-16T20:08:48.885823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958911+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958911+0000","last_peered":"2023-10-16T20:08:34.958911+0000","last_clean":"2023-10-16T20:08:34.958911+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958911+0000","last_undegraded":"2023-10-16T20:08:34.958911+0000","last_fullsized":"2023-10-16T20:08:34.958911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500913+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500913+0000","last_peered":"2023-10-16T20:08:24.500913+0000","last_clean":"2023-10-16T20:08:24.500913+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500913+0000","last_undegraded":"2023-10-16T20:08:24.500913+0000","last_fullsized":"2023-10-16T20:08:24.500913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938126+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938126+0000","last_peered":"2023-10-16T20:08:50.938126+0000","last_clean":"2023-10-16T20:08:50.938126+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938126+0000","last_undegraded":"2023-10-16T20:08:50.938126+0000","last_fullsized":"2023-10-16T20:08:50.938126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399610+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399610+0000","last_peered":"2023-10-16T20:08:34.399610+0000","last_clean":"2023-10-16T20:08:34.399610+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399610+0000","last_undegraded":"2023-10-16T20:08:34.399610+0000","last_fullsized":"2023-10-16T20:08:34.399610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866861+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866861+0000","last_peered":"2023-10-16T20:09:00.866861+0000","last_clean":"2023-10-16T20:09:00.866861+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866861+0000","last_undegraded":"2023-10-16T20:09:00.866861+0000","last_fullsized":"2023-10-16T20:09:00.866861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412489+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412489+0000","last_peered":"2023-10-16T20:08:48.412489+0000","last_clean":"2023-10-16T20:08:48.412489+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412489+0000","last_undegraded":"2023-10-16T20:08:48.412489+0000","last_fullsized":"2023-10-16T20:08:48.412489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228267+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228267+0000","last_peered":"2023-10-16T20:09:01.228267+0000","last_clean":"2023-10-16T20:09:01.228267+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228267+0000","last_undegraded":"2023-10-16T20:09:01.228267+0000","last_fullsized":"2023-10-16T20:09:01.228267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475166+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475166+0000","last_peered":"2023-10-16T20:08:29.475166+0000","last_clean":"2023-10-16T20:08:29.475166+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475166+0000","last_undegraded":"2023-10-16T20:08:29.475166+0000","last_fullsized":"2023-10-16T20:08:29.475166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504133+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504133+0000","last_peered":"2023-10-16T20:08:21.504133+0000","last_clean":"2023-10-16T20:08:21.504133+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504133+0000","last_undegraded":"2023-10-16T20:08:21.504133+0000","last_fullsized":"2023-10-16T20:08:21.504133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354233+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354233+0000","last_peered":"2023-10-16T20:08:37.354233+0000","last_clean":"2023-10-16T20:08:37.354233+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354233+0000","last_undegraded":"2023-10-16T20:08:37.354233+0000","last_fullsized":"2023-10-16T20:08:37.354233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895381+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895381+0000","last_peered":"2023-10-16T20:08:38.895381+0000","last_clean":"2023-10-16T20:08:38.895381+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895381+0000","last_undegraded":"2023-10-16T20:08:38.895381+0000","last_fullsized":"2023-10-16T20:08:38.895381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399673+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399673+0000","last_peered":"2023-10-16T20:08:42.399673+0000","last_clean":"2023-10-16T20:08:42.399673+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399673+0000","last_undegraded":"2023-10-16T20:08:42.399673+0000","last_fullsized":"2023-10-16T20:08:42.399673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184739+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184739+0000","last_peered":"2023-10-16T20:08:59.184739+0000","last_clean":"2023-10-16T20:08:59.184739+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184739+0000","last_undegraded":"2023-10-16T20:08:59.184739+0000","last_fullsized":"2023-10-16T20:08:59.184739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544178+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544178+0000","last_peered":"2023-10-16T20:08:14.544178+0000","last_clean":"2023-10-16T20:08:14.544178+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544178+0000","last_undegraded":"2023-10-16T20:08:14.544178+0000","last_fullsized":"2023-10-16T20:08:14.544178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494631+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494631+0000","last_peered":"2023-10-16T20:08:30.494631+0000","last_clean":"2023-10-16T20:08:30.494631+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494631+0000","last_undegraded":"2023-10-16T20:08:30.494631+0000","last_fullsized":"2023-10-16T20:08:30.494631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161600+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161600+0000","last_peered":"2023-10-16T20:08:23.161600+0000","last_clean":"2023-10-16T20:08:23.161600+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161600+0000","last_undegraded":"2023-10-16T20:08:23.161600+0000","last_fullsized":"2023-10-16T20:08:23.161600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392429+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392429+0000","last_peered":"2023-10-16T20:08:36.392429+0000","last_clean":"2023-10-16T20:08:36.392429+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392429+0000","last_undegraded":"2023-10-16T20:08:36.392429+0000","last_fullsized":"2023-10-16T20:08:36.392429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889872+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889872+0000","last_peered":"2023-10-16T20:08:49.889872+0000","last_clean":"2023-10-16T20:08:49.889872+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889872+0000","last_undegraded":"2023-10-16T20:08:49.889872+0000","last_fullsized":"2023-10-16T20:08:49.889872+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409793+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409793+0000","last_peered":"2023-10-16T20:08:27.409793+0000","last_clean":"2023-10-16T20:08:27.409793+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409793+0000","last_undegraded":"2023-10-16T20:08:27.409793+0000","last_fullsized":"2023-10-16T20:08:27.409793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423048+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423048+0000","last_peered":"2023-10-16T20:08:24.423048+0000","last_clean":"2023-10-16T20:08:24.423048+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423048+0000","last_undegraded":"2023-10-16T20:08:24.423048+0000","last_fullsized":"2023-10-16T20:08:24.423048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188891+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188891+0000","last_peered":"2023-10-16T20:09:04.188891+0000","last_clean":"2023-10-16T20:09:04.188891+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188891+0000","last_undegraded":"2023-10-16T20:09:04.188891+0000","last_fullsized":"2023-10-16T20:09:04.188891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158022+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158022+0000","last_peered":"2023-10-16T20:08:29.158022+0000","last_clean":"2023-10-16T20:08:29.158022+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158022+0000","last_undegraded":"2023-10-16T20:08:29.158022+0000","last_fullsized":"2023-10-16T20:08:29.158022+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306578+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306578+0000","last_peered":"2023-10-16T20:08:35.306578+0000","last_clean":"2023-10-16T20:08:35.306578+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306578+0000","last_undegraded":"2023-10-16T20:08:35.306578+0000","last_fullsized":"2023-10-16T20:08:35.306578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439516+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439516+0000","last_peered":"2023-10-16T20:08:23.439516+0000","last_clean":"2023-10-16T20:08:23.439516+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439516+0000","last_undegraded":"2023-10-16T20:08:23.439516+0000","last_fullsized":"2023-10-16T20:08:23.439516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102269+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102269+0000","last_peered":"2023-10-16T20:08:31.102269+0000","last_clean":"2023-10-16T20:08:31.102269+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102269+0000","last_undegraded":"2023-10-16T20:08:31.102269+0000","last_fullsized":"2023-10-16T20:08:31.102269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098759+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:13.098759+0000","last_peered":"2023-10-16T20:08:13.098759+0000","last_clean":"2023-10-16T20:08:13.098759+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:13.098759+0000","last_undegraded":"2023-10-16T20:08:13.098759+0000","last_fullsized":"2023-10-16T20:08:13.098759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386361+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386361+0000","last_peered":"2023-10-16T20:08:38.386361+0000","last_clean":"2023-10-16T20:08:38.386361+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386361+0000","last_undegraded":"2023-10-16T20:08:38.386361+0000","last_fullsized":"2023-10-16T20:08:38.386361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255050+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255050+0000","last_peered":"2023-10-16T20:08:15.255050+0000","last_clean":"2023-10-16T20:08:15.255050+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255050+0000","last_undegraded":"2023-10-16T20:08:15.255050+0000","last_fullsized":"2023-10-16T20:08:15.255050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798138+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798138+0000","last_peered":"2023-10-16T20:09:02.798138+0000","last_clean":"2023-10-16T20:09:02.798138+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798138+0000","last_undegraded":"2023-10-16T20:09:02.798138+0000","last_fullsized":"2023-10-16T20:09:02.798138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428235+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428235+0000","last_peered":"2023-10-16T20:08:22.428235+0000","last_clean":"2023-10-16T20:08:22.428235+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428235+0000","last_undegraded":"2023-10-16T20:08:22.428235+0000","last_fullsized":"2023-10-16T20:08:22.428235+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528304+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528304+0000","last_peered":"2023-10-16T20:08:29.528304+0000","last_clean":"2023-10-16T20:08:29.528304+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528304+0000","last_undegraded":"2023-10-16T20:08:29.528304+0000","last_fullsized":"2023-10-16T20:08:29.528304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920349+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920349+0000","last_peered":"2023-10-16T20:08:15.920349+0000","last_clean":"2023-10-16T20:08:15.920349+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920349+0000","last_undegraded":"2023-10-16T20:08:15.920349+0000","last_fullsized":"2023-10-16T20:08:15.920349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902452+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902452+0000","last_peered":"2023-10-16T20:08:47.902452+0000","last_clean":"2023-10-16T20:08:47.902452+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902452+0000","last_undegraded":"2023-10-16T20:08:47.902452+0000","last_fullsized":"2023-10-16T20:08:47.902452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469599+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469599+0000","last_peered":"2023-10-16T20:08:27.469599+0000","last_clean":"2023-10-16T20:08:27.469599+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469599+0000","last_undegraded":"2023-10-16T20:08:27.469599+0000","last_fullsized":"2023-10-16T20:08:27.469599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441151+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441151+0000","last_peered":"2023-10-16T20:08:40.441151+0000","last_clean":"2023-10-16T20:08:40.441151+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441151+0000","last_undegraded":"2023-10-16T20:08:40.441151+0000","last_fullsized":"2023-10-16T20:08:40.441151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248069+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248069+0000","last_peered":"2023-10-16T20:08:14.248069+0000","last_clean":"2023-10-16T20:08:14.248069+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248069+0000","last_undegraded":"2023-10-16T20:08:14.248069+0000","last_fullsized":"2023-10-16T20:08:14.248069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745452+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745452+0000","last_peered":"2023-10-16T20:08:56.745452+0000","last_clean":"2023-10-16T20:08:56.745452+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745452+0000","last_undegraded":"2023-10-16T20:08:56.745452+0000","last_fullsized":"2023-10-16T20:08:56.745452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362399+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362399+0000","last_peered":"2023-10-16T20:08:15.362399+0000","last_clean":"2023-10-16T20:08:15.362399+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362399+0000","last_undegraded":"2023-10-16T20:08:15.362399+0000","last_fullsized":"2023-10-16T20:08:15.362399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466503+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466503+0000","last_peered":"2023-10-16T20:08:23.466503+0000","last_clean":"2023-10-16T20:08:23.466503+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466503+0000","last_undegraded":"2023-10-16T20:08:23.466503+0000","last_fullsized":"2023-10-16T20:08:23.466503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096251+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:13.096251+0000","last_peered":"2023-10-16T20:08:13.096251+0000","last_clean":"2023-10-16T20:08:13.096251+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:13.096251+0000","last_undegraded":"2023-10-16T20:08:13.096251+0000","last_fullsized":"2023-10-16T20:08:13.096251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217661+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217661+0000","last_peered":"2023-10-16T20:08:57.217661+0000","last_clean":"2023-10-16T20:08:57.217661+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217661+0000","last_undegraded":"2023-10-16T20:08:57.217661+0000","last_fullsized":"2023-10-16T20:08:57.217661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950617+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950617+0000","last_peered":"2023-10-16T20:08:17.950617+0000","last_clean":"2023-10-16T20:08:17.950617+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950617+0000","last_undegraded":"2023-10-16T20:08:17.950617+0000","last_fullsized":"2023-10-16T20:08:17.950617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548212+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548212+0000","last_peered":"2023-10-16T20:08:26.548212+0000","last_clean":"2023-10-16T20:08:26.548212+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548212+0000","last_undegraded":"2023-10-16T20:08:26.548212+0000","last_fullsized":"2023-10-16T20:08:26.548212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926512+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926512+0000","last_peered":"2023-10-16T20:08:16.926512+0000","last_clean":"2023-10-16T20:08:16.926512+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926512+0000","last_undegraded":"2023-10-16T20:08:16.926512+0000","last_fullsized":"2023-10-16T20:08:16.926512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406316+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406316+0000","last_peered":"2023-10-16T20:08:32.406316+0000","last_clean":"2023-10-16T20:08:32.406316+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406316+0000","last_undegraded":"2023-10-16T20:08:32.406316+0000","last_fullsized":"2023-10-16T20:08:32.406316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713006+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713006+0000","last_peered":"2023-10-16T20:08:14.713006+0000","last_clean":"2023-10-16T20:08:14.713006+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713006+0000","last_undegraded":"2023-10-16T20:08:14.713006+0000","last_fullsized":"2023-10-16T20:08:14.713006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563193+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563193+0000","last_peered":"2023-10-16T20:08:34.563193+0000","last_clean":"2023-10-16T20:08:34.563193+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563193+0000","last_undegraded":"2023-10-16T20:08:34.563193+0000","last_fullsized":"2023-10-16T20:08:34.563193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.742868+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:13.742868+0000","last_peered":"2023-10-16T20:08:13.742868+0000","last_clean":"2023-10-16T20:08:13.742868+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:13.742868+0000","last_undegraded":"2023-10-16T20:08:13.742868+0000","last_fullsized":"2023-10-16T20:08:13.742868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675138+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675138+0000","last_peered":"2023-10-16T20:08:16.675138+0000","last_clean":"2023-10-16T20:08:16.675138+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675138+0000","last_undegraded":"2023-10-16T20:08:16.675138+0000","last_fullsized":"2023-10-16T20:08:16.675138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235501+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235501+0000","last_peered":"2023-10-16T20:08:19.235501+0000","last_clean":"2023-10-16T20:08:19.235501+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235501+0000","last_undegraded":"2023-10-16T20:08:19.235501+0000","last_fullsized":"2023-10-16T20:08:19.235501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333766+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333766+0000","last_peered":"2023-10-16T20:08:32.333766+0000","last_clean":"2023-10-16T20:08:32.333766+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333766+0000","last_undegraded":"2023-10-16T20:08:32.333766+0000","last_fullsized":"2023-10-16T20:08:32.333766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486417+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486417+0000","last_peered":"2023-10-16T20:08:21.486417+0000","last_clean":"2023-10-16T20:08:21.486417+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486417+0000","last_undegraded":"2023-10-16T20:08:21.486417+0000","last_fullsized":"2023-10-16T20:08:21.486417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663909+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663909+0000","last_peered":"2023-10-16T20:08:20.663909+0000","last_clean":"2023-10-16T20:08:20.663909+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663909+0000","last_undegraded":"2023-10-16T20:08:20.663909+0000","last_fullsized":"2023-10-16T20:08:20.663909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713806+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713806+0000","last_peered":"2023-10-16T20:08:17.713806+0000","last_clean":"2023-10-16T20:08:17.713806+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713806+0000","last_undegraded":"2023-10-16T20:08:17.713806+0000","last_fullsized":"2023-10-16T20:08:17.713806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777216+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777216+0000","last_peered":"2023-10-16T20:08:27.777216+0000","last_clean":"2023-10-16T20:08:27.777216+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777216+0000","last_undegraded":"2023-10-16T20:08:27.777216+0000","last_fullsized":"2023-10-16T20:08:27.777216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018817+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018817+0000","last_peered":"2023-10-16T20:08:30.018817+0000","last_clean":"2023-10-16T20:08:30.018817+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018817+0000","last_undegraded":"2023-10-16T20:08:30.018817+0000","last_fullsized":"2023-10-16T20:08:30.018817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948055+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948055+0000","last_peered":"2023-10-16T20:08:31.948055+0000","last_clean":"2023-10-16T20:08:31.948055+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948055+0000","last_undegraded":"2023-10-16T20:08:31.948055+0000","last_fullsized":"2023-10-16T20:08:31.948055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504674+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504674+0000","last_peered":"2023-10-16T20:08:24.504674+0000","last_clean":"2023-10-16T20:08:24.504674+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504674+0000","last_undegraded":"2023-10-16T20:08:24.504674+0000","last_fullsized":"2023-10-16T20:08:24.504674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456845+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456845+0000","last_peered":"2023-10-16T20:08:27.456845+0000","last_clean":"2023-10-16T20:08:27.456845+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456845+0000","last_undegraded":"2023-10-16T20:08:27.456845+0000","last_fullsized":"2023-10-16T20:08:27.456845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245520+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:13.245520+0000","last_peered":"2023-10-16T20:08:13.245520+0000","last_clean":"2023-10-16T20:08:13.245520+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:13.245520+0000","last_undegraded":"2023-10-16T20:08:13.245520+0000","last_fullsized":"2023-10-16T20:08:13.245520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482362+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482362+0000","last_peered":"2023-10-16T20:08:16.482362+0000","last_clean":"2023-10-16T20:08:16.482362+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482362+0000","last_undegraded":"2023-10-16T20:08:16.482362+0000","last_fullsized":"2023-10-16T20:08:16.482362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190507+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190507+0000","last_peered":"2023-10-16T20:08:20.190507+0000","last_clean":"2023-10-16T20:08:20.190507+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190507+0000","last_undegraded":"2023-10-16T20:08:20.190507+0000","last_fullsized":"2023-10-16T20:08:20.190507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208148+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208148+0000","last_peered":"2023-10-16T20:08:58.208148+0000","last_clean":"2023-10-16T20:08:58.208148+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208148+0000","last_undegraded":"2023-10-16T20:08:58.208148+0000","last_fullsized":"2023-10-16T20:08:58.208148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245230+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:13.245230+0000","last_peered":"2023-10-16T20:08:13.245230+0000","last_clean":"2023-10-16T20:08:13.245230+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:13.245230+0000","last_undegraded":"2023-10-16T20:08:13.245230+0000","last_fullsized":"2023-10-16T20:08:13.245230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465756+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465756+0000","last_peered":"2023-10-16T20:08:23.465756+0000","last_clean":"2023-10-16T20:08:23.465756+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465756+0000","last_undegraded":"2023-10-16T20:08:23.465756+0000","last_fullsized":"2023-10-16T20:08:23.465756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245232+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:13.245232+0000","last_peered":"2023-10-16T20:08:13.245232+0000","last_clean":"2023-10-16T20:08:13.245232+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:13.245232+0000","last_undegraded":"2023-10-16T20:08:13.245232+0000","last_fullsized":"2023-10-16T20:08:13.245232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918527+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918527+0000","last_peered":"2023-10-16T20:08:32.918527+0000","last_clean":"2023-10-16T20:08:32.918527+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918527+0000","last_undegraded":"2023-10-16T20:08:32.918527+0000","last_fullsized":"2023-10-16T20:08:32.918527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581835+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581835+0000","last_peered":"2023-10-16T20:08:24.581835+0000","last_clean":"2023-10-16T20:08:24.581835+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581835+0000","last_undegraded":"2023-10-16T20:08:24.581835+0000","last_fullsized":"2023-10-16T20:08:24.581835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690419+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690419+0000","last_peered":"2023-10-16T20:08:46.690419+0000","last_clean":"2023-10-16T20:08:46.690419+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690419+0000","last_undegraded":"2023-10-16T20:08:46.690419+0000","last_fullsized":"2023-10-16T20:08:46.690419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.573398+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:13.573398+0000","last_peered":"2023-10-16T20:08:13.573398+0000","last_clean":"2023-10-16T20:08:13.573398+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:13.573398+0000","last_undegraded":"2023-10-16T20:08:13.573398+0000","last_fullsized":"2023-10-16T20:08:13.573398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148034+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148034+0000","last_peered":"2023-10-16T20:08:33.148034+0000","last_clean":"2023-10-16T20:08:33.148034+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148034+0000","last_undegraded":"2023-10-16T20:08:33.148034+0000","last_fullsized":"2023-10-16T20:08:33.148034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974925+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974925+0000","last_peered":"2023-10-16T20:08:20.974925+0000","last_clean":"2023-10-16T20:08:20.974925+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974925+0000","last_undegraded":"2023-10-16T20:08:20.974925+0000","last_fullsized":"2023-10-16T20:08:20.974925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311234+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311234+0000","last_peered":"2023-10-16T20:08:53.311234+0000","last_clean":"2023-10-16T20:08:53.311234+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311234+0000","last_undegraded":"2023-10-16T20:08:53.311234+0000","last_fullsized":"2023-10-16T20:08:53.311234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245481+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:13.245481+0000","last_peered":"2023-10-16T20:08:13.245481+0000","last_clean":"2023-10-16T20:08:13.245481+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:13.245481+0000","last_undegraded":"2023-10-16T20:08:13.245481+0000","last_fullsized":"2023-10-16T20:08:13.245481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762741+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762741+0000","last_peered":"2023-10-16T20:09:01.762741+0000","last_clean":"2023-10-16T20:09:01.762741+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762741+0000","last_undegraded":"2023-10-16T20:09:01.762741+0000","last_fullsized":"2023-10-16T20:09:01.762741+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449268+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449268+0000","last_peered":"2023-10-16T20:08:20.449268+0000","last_clean":"2023-10-16T20:08:20.449268+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449268+0000","last_undegraded":"2023-10-16T20:08:20.449268+0000","last_fullsized":"2023-10-16T20:08:20.449268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526487+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526487+0000","last_peered":"2023-10-16T20:08:31.526487+0000","last_clean":"2023-10-16T20:08:31.526487+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526487+0000","last_undegraded":"2023-10-16T20:08:31.526487+0000","last_fullsized":"2023-10-16T20:08:31.526487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098579+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:13.098579+0000","last_peered":"2023-10-16T20:08:13.098579+0000","last_clean":"2023-10-16T20:08:13.098579+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:13.098579+0000","last_undegraded":"2023-10-16T20:08:13.098579+0000","last_fullsized":"2023-10-16T20:08:13.098579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101595+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101595+0000","last_peered":"2023-10-16T20:08:32.101595+0000","last_clean":"2023-10-16T20:08:32.101595+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101595+0000","last_undegraded":"2023-10-16T20:08:32.101595+0000","last_fullsized":"2023-10-16T20:08:32.101595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408942+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:13.408942+0000","last_peered":"2023-10-16T20:08:13.408942+0000","last_clean":"2023-10-16T20:08:13.408942+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:13.408942+0000","last_undegraded":"2023-10-16T20:08:13.408942+0000","last_fullsized":"2023-10-16T20:08:13.408942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407598+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407598+0000","last_peered":"2023-10-16T20:08:37.407598+0000","last_clean":"2023-10-16T20:08:37.407598+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407598+0000","last_undegraded":"2023-10-16T20:08:37.407598+0000","last_fullsized":"2023-10-16T20:08:37.407598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469198+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469198+0000","last_peered":"2023-10-16T20:08:23.469198+0000","last_clean":"2023-10-16T20:08:23.469198+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469198+0000","last_undegraded":"2023-10-16T20:08:23.469198+0000","last_fullsized":"2023-10-16T20:08:23.469198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129316+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129316+0000","last_peered":"2023-10-16T20:09:06.129316+0000","last_clean":"2023-10-16T20:09:06.129316+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129316+0000","last_undegraded":"2023-10-16T20:09:06.129316+0000","last_fullsized":"2023-10-16T20:09:06.129316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095679+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:13.095679+0000","last_peered":"2023-10-16T20:08:13.095679+0000","last_clean":"2023-10-16T20:08:13.095679+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:13.095679+0000","last_undegraded":"2023-10-16T20:08:13.095679+0000","last_fullsized":"2023-10-16T20:08:13.095679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.499966+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:14.499966+0000","last_peered":"2023-10-16T20:08:14.499966+0000","last_clean":"2023-10-16T20:08:14.499966+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:14.499966+0000","last_undegraded":"2023-10-16T20:08:14.499966+0000","last_fullsized":"2023-10-16T20:08:14.499966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437890+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437890+0000","last_peered":"2023-10-16T20:08:29.437890+0000","last_clean":"2023-10-16T20:08:29.437890+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437890+0000","last_undegraded":"2023-10-16T20:08:29.437890+0000","last_fullsized":"2023-10-16T20:08:29.437890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.800563+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:14.800563+0000","last_peered":"2023-10-16T20:08:14.800563+0000","last_clean":"2023-10-16T20:08:14.800563+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:14.800563+0000","last_undegraded":"2023-10-16T20:08:14.800563+0000","last_fullsized":"2023-10-16T20:08:14.800563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.502,"5min":0.496,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73699999999999999,"5min":0.755,"15min":0.755},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.43099999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41699999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72899999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71699999999999997,"5min":1.218,"15min":1.218},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.69099999999999995,"15min":0.71599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":1.391,"15min":1.391},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621}]},{"osd":3,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75900000000000001,"5min":1.516,"15min":1.516},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.66500000000000004,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.68000000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.749,"15min":0.78000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71199999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.849,"15min":1.849},"last":0.505}]},{"osd":7,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.79600000000000004,"15min":0.82599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78400000000000003,"5min":2.585,"15min":2.585},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.77800000000000002,"5min":1.115,"15min":1.115},"last":0.71999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34699999999999998,"15min":0.34899999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.498,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.621,"15min":0.621},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33600000000000002,"15min":0.33700000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54700000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.626,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38400000000000001,"15min":0.38500000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57999999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59599999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.36199999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96599999999999997,"5min":1.153,"15min":1.153},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82599999999999996,"5min":1.214,"15min":1.214},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.84099999999999997,"5min":1.135,"15min":1.135},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85899999999999999,"5min":1.05,"15min":1.05},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.62,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91000000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.629,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.64800000000000002,"5min":2.798,"15min":2.798},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.41599999999999998,"15min":0.42299999999999999},"min":{"1min":0.26300000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.57899999999999996,"5min":1.087,"15min":1.087},"last":0.371}]},{"osd":2,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.46800000000000003,"15min":0.48299999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56499999999999995,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.434},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55400000000000005,"5min":1.218,"15min":1.218},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:08:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.59099999999999997,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.28000000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60299999999999998,"5min":2.754,"15min":2.754},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.40799999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76700000000000002,"5min":1.125,"15min":1.125},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.879,"5min":1.246,"15min":1.246},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66000000000000003,"15min":0.66700000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94799999999999995,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.622},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":1.153,"15min":1.153},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92300000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.188,"15min":0.188},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.28399999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.37,"15min":0.37},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.42099999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.46800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.376}]},{"osd":3,"last update":"Mon Oct 16 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.48799999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.495,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.497}]},{"osd":5,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.623}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72899999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.46800000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.87,"15min":0.87},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.85299999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70099999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.36499999999999999,"15min":0.375},"min":{"1min":0.251,"5min":0.22,"15min":0.22},"max":{"1min":0.376,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.312}]},{"osd":1,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52600000000000002,"5min":0.63,"15min":0.63},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.379},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51000000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.625,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41499999999999998,"15min":0.41799999999999998},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.754,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.78200000000000003,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85799999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98699999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.752},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":0.876,"15min":0.876},"last":0.627}]}]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77100000000000002,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.755}]},{"osd":1,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.80800000000000005}]},{"osd":2,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.65700000000000003,"15min":0.68100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":2.899,"15min":2.899},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.78100000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80000000000000004,"5min":1.24,"15min":1.24},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.753,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.84799999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77600000000000002,"5min":0.872,"15min":0.872},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.57399999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.82499999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.84499999999999997,"5min":1.046,"15min":1.046},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.79900000000000004,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81200000000000006,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.85499999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41899999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":1.103,"15min":1.103},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.501,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79700000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.872}]},{"osd":4,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66800000000000004,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58499999999999996,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72999999999999998,"5min":1.546,"15min":1.546},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.70899999999999996,"15min":0.73299999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.629}]},{"osd":7,"last update":"Mon Oct 16 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84599999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:09:13.560 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:09:13.561 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:09:31.361 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:31.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:09:33.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:09:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.693+0000 7f62004d9700 1 Processor -- start 2023-10-16T20:09:33.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.693+0000 7f62004d9700 1 -- start start 2023-10-16T20:09:33.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f62004d9700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f61f8152470 0x7f61f80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:33.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f62004d9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f80cb8d0 0x7f61f80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:33.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f62004d9700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f8070d70 con 0x7f61f80b3240 2023-10-16T20:09:33.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f62004d9700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80b36d0 con 0x7f61f8152470 2023-10-16T20:09:33.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f62004d9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8071200 con 0x7f61f80cb8d0 2023-10-16T20:09:33.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f61f8152470 0x7f61f80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:33.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f61f8152470 0x7f61f80cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33222/0 (socket says 172.21.15.152:33222) 2023-10-16T20:09:33.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 -- 172.21.15.152:0/2531302712 learned_addr learned my addr 172.21.15.152:0/2531302712 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:09:33.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fda74700 1 --2- 172.21.15.152:0/2531302712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f80cb8d0 0x7f61f80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:33.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 -- 172.21.15.152:0/2531302712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f80cb8d0 msgr2=0x7f61f80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:09:33.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 --2- 172.21.15.152:0/2531302712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f80cb8d0 0x7f61f80b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 -- 172.21.15.152:0/2531302712 >> v1:172.21.15.163:6789/0 conn(0x7f61f80b3240 legacy=0x7f61f80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:33.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 -- 172.21.15.152:0/2531302712 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8070440 con 0x7f61f8152470 2023-10-16T20:09:33.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.694+0000 7f61fe275700 1 --2- 172.21.15.152:0/2531302712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f8152470 0x7f61f80cd570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f61f40098f0 tx=0x7f61f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65f4914b9f44b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:33.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f61fd273700 1 -- 172.21.15.152:0/2531302712 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400b8a0 con 0x7f61f8152470 2023-10-16T20:09:33.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f61fd273700 1 -- 172.21.15.152:0/2531302712 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400ba00 con 0x7f61f8152470 2023-10-16T20:09:33.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f61fd273700 1 -- 172.21.15.152:0/2531302712 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400bd90 con 0x7f61f8152470 2023-10-16T20:09:33.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 -- 172.21.15.152:0/2531302712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f8152470 msgr2=0x7f61f80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:33.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 --2- 172.21.15.152:0/2531302712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f8152470 0x7f61f80cd570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f61f40098f0 tx=0x7f61f4009c00 comp rx=0 tx=0).stop 2023-10-16T20:09:33.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 -- 172.21.15.152:0/2531302712 shutdown_connections 2023-10-16T20:09:33.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 --2- 172.21.15.152:0/2531302712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f8152470 0x7f61f80cd570 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 --2- 172.21.15.152:0/2531302712 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f80cb8d0 0x7f61f80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 -- 172.21.15.152:0/2531302712 >> 172.21.15.152:0/2531302712 conn(0x7f61f80cdd00 msgr2=0x7f61f80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:09:33.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 -- 172.21.15.152:0/2531302712 shutdown_connections 2023-10-16T20:09:33.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.695+0000 7f62004d9700 1 -- 172.21.15.152:0/2531302712 wait complete. 2023-10-16T20:09:33.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.696+0000 7f62004d9700 1 Processor -- start 2023-10-16T20:09:33.707 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.696+0000 7f62004d9700 1 -- start start 2023-10-16T20:09:33.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f62004d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 0x7f61f81f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:33.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f62004d9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61f80cb8d0 0x7f61f81f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:33.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f62004d9700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f8152470 0x7f61f81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:33.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f62004d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80c4ee0 con 0x7f61f80b3240 2023-10-16T20:09:33.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f62004d9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81f15a0 con 0x7f61f80cb8d0 2023-10-16T20:09:33.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f62004d9700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81f1880 con 0x7f61f8152470 2023-10-16T20:09:33.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f61fe275700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 0x7f61f81f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:33.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f61fe275700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 0x7f61f81f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33228/0 (socket says 172.21.15.152:33228) 2023-10-16T20:09:33.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.697+0000 7f61fe275700 1 -- 172.21.15.152:0/4262076762 learned_addr learned my addr 172.21.15.152:0/4262076762 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:09:33.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fda74700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61f80cb8d0 0x7f61f81f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:33.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fea76700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f8152470 0x7f61f81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:33.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fe275700 1 -- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f8152470 msgr2=0x7f61f81544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:33.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fe275700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f8152470 0x7f61f81544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fe275700 1 -- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61f80cb8d0 msgr2=0x7f61f81f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:33.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fe275700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61f80cb8d0 0x7f61f81f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fe275700 1 -- 172.21.15.152:0/4262076762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4009550 con 0x7f61f80b3240 2023-10-16T20:09:33.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fea76700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f8152470 0x7f61f81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:09:33.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61fe275700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 0x7f61f81f0ee0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f61f4014040 tx=0x7f61f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:33.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f40036a0 con 0x7f61f80b3240 2023-10-16T20:09:33.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f401e070 con 0x7f61f80b3240 2023-10-16T20:09:33.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f81f1b60 con 0x7f61f80b3240 2023-10-16T20:09:33.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4003a40 con 0x7f61f80b3240 2023-10-16T20:09:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.698+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f81f20a0 con 0x7f61f80b3240 2023-10-16T20:09:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.699+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f804ebb0 con 0x7f61f80b3240 2023-10-16T20:09:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.699+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f61f4003ba0 con 0x7f61f80b3240 2023-10-16T20:09:33.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.700+0000 7f61eeffd700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f61dc06af00 0x7f61dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.700+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f61f4020070 con 0x7f61f80b3240 2023-10-16T20:09:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.700+0000 7f61fda74700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f61dc06af00 0x7f61dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:33.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.700+0000 7f61fda74700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f61dc06af00 0x7f61dc06d3c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f61f815e7a0 tx=0x7f61e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:33.716 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.704+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f61f4055b80 con 0x7f61f80b3240 2023-10-16T20:09:33.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.889+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61f8070a00 con 0x7f61dc06af00 2023-10-16T20:09:33.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.897+0000 7f61eeffd700 1 -- 172.21.15.152:0/4262076762 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290429 (secure 0 0 0) 0x7f61e8009dd0 con 0x7f61dc06af00 2023-10-16T20:09:33.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:09:33.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f61dc06af00 msgr2=0x7f61dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:33.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f61dc06af00 0x7f61dc06d3c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f61f815e7a0 tx=0x7f61e8008040 comp rx=0 tx=0).stop 2023-10-16T20:09:33.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 msgr2=0x7f61f81f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:33.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 0x7f61f81f0ee0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f61f4014040 tx=0x7f61f4004750 comp rx=0 tx=0).stop 2023-10-16T20:09:33.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 shutdown_connections 2023-10-16T20:09:33.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f61dc06af00 0x7f61dc06d3c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f61f8152470 0x7f61f81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61f80b3240 0x7f61f81f0ee0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 --2- 172.21.15.152:0/4262076762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61f80cb8d0 0x7f61f81f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 >> 172.21.15.152:0/4262076762 conn(0x7f61f80cdd00 msgr2=0x7f61f80b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:09:33.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 shutdown_connections 2023-10-16T20:09:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:33.900+0000 7f62004d9700 1 -- 172.21.15.152:0/4262076762 wait complete. 2023-10-16T20:09:33.909 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:09:33.914 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-10-16T20:09:32.811027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003399"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681867+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681867+0000","last_peered":"2023-10-16T20:08:25.681867+0000","last_clean":"2023-10-16T20:08:25.681867+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681867+0000","last_undegraded":"2023-10-16T20:08:25.681867+0000","last_fullsized":"2023-10-16T20:08:25.681867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716320+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716320+0000","last_peered":"2023-10-16T20:08:48.716320+0000","last_clean":"2023-10-16T20:08:48.716320+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716320+0000","last_undegraded":"2023-10-16T20:08:48.716320+0000","last_fullsized":"2023-10-16T20:08:48.716320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568727+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568727+0000","last_peered":"2023-10-16T20:08:27.568727+0000","last_clean":"2023-10-16T20:08:27.568727+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568727+0000","last_undegraded":"2023-10-16T20:08:27.568727+0000","last_fullsized":"2023-10-16T20:08:27.568727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499254+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499254+0000","last_peered":"2023-10-16T20:08:20.499254+0000","last_clean":"2023-10-16T20:08:20.499254+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499254+0000","last_undegraded":"2023-10-16T20:08:20.499254+0000","last_fullsized":"2023-10-16T20:08:20.499254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509595+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509595+0000","last_peered":"2023-10-16T20:08:15.509595+0000","last_clean":"2023-10-16T20:08:15.509595+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509595+0000","last_undegraded":"2023-10-16T20:08:15.509595+0000","last_fullsized":"2023-10-16T20:08:15.509595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157235+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157235+0000","last_peered":"2023-10-16T20:08:25.157235+0000","last_clean":"2023-10-16T20:08:25.157235+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157235+0000","last_undegraded":"2023-10-16T20:08:25.157235+0000","last_fullsized":"2023-10-16T20:08:25.157235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.866996+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.866996+0000","last_peered":"2023-10-16T20:08:59.866996+0000","last_clean":"2023-10-16T20:08:59.866996+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.866996+0000","last_undegraded":"2023-10-16T20:08:59.866996+0000","last_fullsized":"2023-10-16T20:08:59.866996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596658+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596658+0000","last_peered":"2023-10-16T20:08:42.596658+0000","last_clean":"2023-10-16T20:08:42.596658+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596658+0000","last_undegraded":"2023-10-16T20:08:42.596658+0000","last_fullsized":"2023-10-16T20:08:42.596658+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606037+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606037+0000","last_peered":"2023-10-16T20:08:35.606037+0000","last_clean":"2023-10-16T20:08:35.606037+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606037+0000","last_undegraded":"2023-10-16T20:08:35.606037+0000","last_fullsized":"2023-10-16T20:08:35.606037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885823+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885823+0000","last_peered":"2023-10-16T20:08:48.885823+0000","last_clean":"2023-10-16T20:08:48.885823+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885823+0000","last_undegraded":"2023-10-16T20:08:48.885823+0000","last_fullsized":"2023-10-16T20:08:48.885823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958911+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958911+0000","last_peered":"2023-10-16T20:08:34.958911+0000","last_clean":"2023-10-16T20:08:34.958911+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958911+0000","last_undegraded":"2023-10-16T20:08:34.958911+0000","last_fullsized":"2023-10-16T20:08:34.958911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500913+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500913+0000","last_peered":"2023-10-16T20:08:24.500913+0000","last_clean":"2023-10-16T20:08:24.500913+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500913+0000","last_undegraded":"2023-10-16T20:08:24.500913+0000","last_fullsized":"2023-10-16T20:08:24.500913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938126+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938126+0000","last_peered":"2023-10-16T20:08:50.938126+0000","last_clean":"2023-10-16T20:08:50.938126+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938126+0000","last_undegraded":"2023-10-16T20:08:50.938126+0000","last_fullsized":"2023-10-16T20:08:50.938126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399610+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399610+0000","last_peered":"2023-10-16T20:08:34.399610+0000","last_clean":"2023-10-16T20:08:34.399610+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399610+0000","last_undegraded":"2023-10-16T20:08:34.399610+0000","last_fullsized":"2023-10-16T20:08:34.399610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866861+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866861+0000","last_peered":"2023-10-16T20:09:00.866861+0000","last_clean":"2023-10-16T20:09:00.866861+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866861+0000","last_undegraded":"2023-10-16T20:09:00.866861+0000","last_fullsized":"2023-10-16T20:09:00.866861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412489+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412489+0000","last_peered":"2023-10-16T20:08:48.412489+0000","last_clean":"2023-10-16T20:08:48.412489+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412489+0000","last_undegraded":"2023-10-16T20:08:48.412489+0000","last_fullsized":"2023-10-16T20:08:48.412489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228267+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228267+0000","last_peered":"2023-10-16T20:09:01.228267+0000","last_clean":"2023-10-16T20:09:01.228267+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228267+0000","last_undegraded":"2023-10-16T20:09:01.228267+0000","last_fullsized":"2023-10-16T20:09:01.228267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475166+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475166+0000","last_peered":"2023-10-16T20:08:29.475166+0000","last_clean":"2023-10-16T20:08:29.475166+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475166+0000","last_undegraded":"2023-10-16T20:08:29.475166+0000","last_fullsized":"2023-10-16T20:08:29.475166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504133+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504133+0000","last_peered":"2023-10-16T20:08:21.504133+0000","last_clean":"2023-10-16T20:08:21.504133+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504133+0000","last_undegraded":"2023-10-16T20:08:21.504133+0000","last_fullsized":"2023-10-16T20:08:21.504133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354233+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354233+0000","last_peered":"2023-10-16T20:08:37.354233+0000","last_clean":"2023-10-16T20:08:37.354233+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354233+0000","last_undegraded":"2023-10-16T20:08:37.354233+0000","last_fullsized":"2023-10-16T20:08:37.354233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895381+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895381+0000","last_peered":"2023-10-16T20:08:38.895381+0000","last_clean":"2023-10-16T20:08:38.895381+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895381+0000","last_undegraded":"2023-10-16T20:08:38.895381+0000","last_fullsized":"2023-10-16T20:08:38.895381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399673+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399673+0000","last_peered":"2023-10-16T20:08:42.399673+0000","last_clean":"2023-10-16T20:08:42.399673+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399673+0000","last_undegraded":"2023-10-16T20:08:42.399673+0000","last_fullsized":"2023-10-16T20:08:42.399673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184739+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184739+0000","last_peered":"2023-10-16T20:08:59.184739+0000","last_clean":"2023-10-16T20:08:59.184739+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184739+0000","last_undegraded":"2023-10-16T20:08:59.184739+0000","last_fullsized":"2023-10-16T20:08:59.184739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544178+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544178+0000","last_peered":"2023-10-16T20:08:14.544178+0000","last_clean":"2023-10-16T20:08:14.544178+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544178+0000","last_undegraded":"2023-10-16T20:08:14.544178+0000","last_fullsized":"2023-10-16T20:08:14.544178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494631+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494631+0000","last_peered":"2023-10-16T20:08:30.494631+0000","last_clean":"2023-10-16T20:08:30.494631+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494631+0000","last_undegraded":"2023-10-16T20:08:30.494631+0000","last_fullsized":"2023-10-16T20:08:30.494631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161600+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161600+0000","last_peered":"2023-10-16T20:08:23.161600+0000","last_clean":"2023-10-16T20:08:23.161600+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161600+0000","last_undegraded":"2023-10-16T20:08:23.161600+0000","last_fullsized":"2023-10-16T20:08:23.161600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392429+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392429+0000","last_peered":"2023-10-16T20:08:36.392429+0000","last_clean":"2023-10-16T20:08:36.392429+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392429+0000","last_undegraded":"2023-10-16T20:08:36.392429+0000","last_fullsized":"2023-10-16T20:08:36.392429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889872+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889872+0000","last_peered":"2023-10-16T20:08:49.889872+0000","last_clean":"2023-10-16T20:08:49.889872+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889872+0000","last_undegraded":"2023-10-16T20:08:49.889872+0000","last_fullsized":"2023-10-16T20:08:49.889872+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409793+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409793+0000","last_peered":"2023-10-16T20:08:27.409793+0000","last_clean":"2023-10-16T20:08:27.409793+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409793+0000","last_undegraded":"2023-10-16T20:08:27.409793+0000","last_fullsized":"2023-10-16T20:08:27.409793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423048+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423048+0000","last_peered":"2023-10-16T20:08:24.423048+0000","last_clean":"2023-10-16T20:08:24.423048+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423048+0000","last_undegraded":"2023-10-16T20:08:24.423048+0000","last_fullsized":"2023-10-16T20:08:24.423048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188891+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188891+0000","last_peered":"2023-10-16T20:09:04.188891+0000","last_clean":"2023-10-16T20:09:04.188891+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188891+0000","last_undegraded":"2023-10-16T20:09:04.188891+0000","last_fullsized":"2023-10-16T20:09:04.188891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158022+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158022+0000","last_peered":"2023-10-16T20:08:29.158022+0000","last_clean":"2023-10-16T20:08:29.158022+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158022+0000","last_undegraded":"2023-10-16T20:08:29.158022+0000","last_fullsized":"2023-10-16T20:08:29.158022+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306578+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306578+0000","last_peered":"2023-10-16T20:08:35.306578+0000","last_clean":"2023-10-16T20:08:35.306578+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306578+0000","last_undegraded":"2023-10-16T20:08:35.306578+0000","last_fullsized":"2023-10-16T20:08:35.306578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439516+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439516+0000","last_peered":"2023-10-16T20:08:23.439516+0000","last_clean":"2023-10-16T20:08:23.439516+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439516+0000","last_undegraded":"2023-10-16T20:08:23.439516+0000","last_fullsized":"2023-10-16T20:08:23.439516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102269+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102269+0000","last_peered":"2023-10-16T20:08:31.102269+0000","last_clean":"2023-10-16T20:08:31.102269+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102269+0000","last_undegraded":"2023-10-16T20:08:31.102269+0000","last_fullsized":"2023-10-16T20:08:31.102269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098759+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:13.098759+0000","last_peered":"2023-10-16T20:08:13.098759+0000","last_clean":"2023-10-16T20:08:13.098759+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:13.098759+0000","last_undegraded":"2023-10-16T20:08:13.098759+0000","last_fullsized":"2023-10-16T20:08:13.098759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386361+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386361+0000","last_peered":"2023-10-16T20:08:38.386361+0000","last_clean":"2023-10-16T20:08:38.386361+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386361+0000","last_undegraded":"2023-10-16T20:08:38.386361+0000","last_fullsized":"2023-10-16T20:08:38.386361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255050+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255050+0000","last_peered":"2023-10-16T20:08:15.255050+0000","last_clean":"2023-10-16T20:08:15.255050+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255050+0000","last_undegraded":"2023-10-16T20:08:15.255050+0000","last_fullsized":"2023-10-16T20:08:15.255050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798138+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798138+0000","last_peered":"2023-10-16T20:09:02.798138+0000","last_clean":"2023-10-16T20:09:02.798138+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798138+0000","last_undegraded":"2023-10-16T20:09:02.798138+0000","last_fullsized":"2023-10-16T20:09:02.798138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428235+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428235+0000","last_peered":"2023-10-16T20:08:22.428235+0000","last_clean":"2023-10-16T20:08:22.428235+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428235+0000","last_undegraded":"2023-10-16T20:08:22.428235+0000","last_fullsized":"2023-10-16T20:08:22.428235+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528304+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528304+0000","last_peered":"2023-10-16T20:08:29.528304+0000","last_clean":"2023-10-16T20:08:29.528304+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528304+0000","last_undegraded":"2023-10-16T20:08:29.528304+0000","last_fullsized":"2023-10-16T20:08:29.528304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920349+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920349+0000","last_peered":"2023-10-16T20:08:15.920349+0000","last_clean":"2023-10-16T20:08:15.920349+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920349+0000","last_undegraded":"2023-10-16T20:08:15.920349+0000","last_fullsized":"2023-10-16T20:08:15.920349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902452+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902452+0000","last_peered":"2023-10-16T20:08:47.902452+0000","last_clean":"2023-10-16T20:08:47.902452+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902452+0000","last_undegraded":"2023-10-16T20:08:47.902452+0000","last_fullsized":"2023-10-16T20:08:47.902452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469599+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469599+0000","last_peered":"2023-10-16T20:08:27.469599+0000","last_clean":"2023-10-16T20:08:27.469599+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469599+0000","last_undegraded":"2023-10-16T20:08:27.469599+0000","last_fullsized":"2023-10-16T20:08:27.469599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441151+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441151+0000","last_peered":"2023-10-16T20:08:40.441151+0000","last_clean":"2023-10-16T20:08:40.441151+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441151+0000","last_undegraded":"2023-10-16T20:08:40.441151+0000","last_fullsized":"2023-10-16T20:08:40.441151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248069+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248069+0000","last_peered":"2023-10-16T20:08:14.248069+0000","last_clean":"2023-10-16T20:08:14.248069+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248069+0000","last_undegraded":"2023-10-16T20:08:14.248069+0000","last_fullsized":"2023-10-16T20:08:14.248069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745452+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745452+0000","last_peered":"2023-10-16T20:08:56.745452+0000","last_clean":"2023-10-16T20:08:56.745452+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745452+0000","last_undegraded":"2023-10-16T20:08:56.745452+0000","last_fullsized":"2023-10-16T20:08:56.745452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362399+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362399+0000","last_peered":"2023-10-16T20:08:15.362399+0000","last_clean":"2023-10-16T20:08:15.362399+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362399+0000","last_undegraded":"2023-10-16T20:08:15.362399+0000","last_fullsized":"2023-10-16T20:08:15.362399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466503+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466503+0000","last_peered":"2023-10-16T20:08:23.466503+0000","last_clean":"2023-10-16T20:08:23.466503+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466503+0000","last_undegraded":"2023-10-16T20:08:23.466503+0000","last_fullsized":"2023-10-16T20:08:23.466503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096251+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:13.096251+0000","last_peered":"2023-10-16T20:08:13.096251+0000","last_clean":"2023-10-16T20:08:13.096251+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:13.096251+0000","last_undegraded":"2023-10-16T20:08:13.096251+0000","last_fullsized":"2023-10-16T20:08:13.096251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217661+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217661+0000","last_peered":"2023-10-16T20:08:57.217661+0000","last_clean":"2023-10-16T20:08:57.217661+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217661+0000","last_undegraded":"2023-10-16T20:08:57.217661+0000","last_fullsized":"2023-10-16T20:08:57.217661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950617+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950617+0000","last_peered":"2023-10-16T20:08:17.950617+0000","last_clean":"2023-10-16T20:08:17.950617+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950617+0000","last_undegraded":"2023-10-16T20:08:17.950617+0000","last_fullsized":"2023-10-16T20:08:17.950617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548212+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548212+0000","last_peered":"2023-10-16T20:08:26.548212+0000","last_clean":"2023-10-16T20:08:26.548212+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548212+0000","last_undegraded":"2023-10-16T20:08:26.548212+0000","last_fullsized":"2023-10-16T20:08:26.548212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926512+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926512+0000","last_peered":"2023-10-16T20:08:16.926512+0000","last_clean":"2023-10-16T20:08:16.926512+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926512+0000","last_undegraded":"2023-10-16T20:08:16.926512+0000","last_fullsized":"2023-10-16T20:08:16.926512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406316+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406316+0000","last_peered":"2023-10-16T20:08:32.406316+0000","last_clean":"2023-10-16T20:08:32.406316+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406316+0000","last_undegraded":"2023-10-16T20:08:32.406316+0000","last_fullsized":"2023-10-16T20:08:32.406316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713006+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713006+0000","last_peered":"2023-10-16T20:08:14.713006+0000","last_clean":"2023-10-16T20:08:14.713006+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713006+0000","last_undegraded":"2023-10-16T20:08:14.713006+0000","last_fullsized":"2023-10-16T20:08:14.713006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563193+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563193+0000","last_peered":"2023-10-16T20:08:34.563193+0000","last_clean":"2023-10-16T20:08:34.563193+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563193+0000","last_undegraded":"2023-10-16T20:08:34.563193+0000","last_fullsized":"2023-10-16T20:08:34.563193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.742868+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:13.742868+0000","last_peered":"2023-10-16T20:08:13.742868+0000","last_clean":"2023-10-16T20:08:13.742868+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:13.742868+0000","last_undegraded":"2023-10-16T20:08:13.742868+0000","last_fullsized":"2023-10-16T20:08:13.742868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675138+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675138+0000","last_peered":"2023-10-16T20:08:16.675138+0000","last_clean":"2023-10-16T20:08:16.675138+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675138+0000","last_undegraded":"2023-10-16T20:08:16.675138+0000","last_fullsized":"2023-10-16T20:08:16.675138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235501+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235501+0000","last_peered":"2023-10-16T20:08:19.235501+0000","last_clean":"2023-10-16T20:08:19.235501+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235501+0000","last_undegraded":"2023-10-16T20:08:19.235501+0000","last_fullsized":"2023-10-16T20:08:19.235501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333766+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333766+0000","last_peered":"2023-10-16T20:08:32.333766+0000","last_clean":"2023-10-16T20:08:32.333766+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333766+0000","last_undegraded":"2023-10-16T20:08:32.333766+0000","last_fullsized":"2023-10-16T20:08:32.333766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486417+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486417+0000","last_peered":"2023-10-16T20:08:21.486417+0000","last_clean":"2023-10-16T20:08:21.486417+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486417+0000","last_undegraded":"2023-10-16T20:08:21.486417+0000","last_fullsized":"2023-10-16T20:08:21.486417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663909+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663909+0000","last_peered":"2023-10-16T20:08:20.663909+0000","last_clean":"2023-10-16T20:08:20.663909+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663909+0000","last_undegraded":"2023-10-16T20:08:20.663909+0000","last_fullsized":"2023-10-16T20:08:20.663909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713806+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713806+0000","last_peered":"2023-10-16T20:08:17.713806+0000","last_clean":"2023-10-16T20:08:17.713806+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713806+0000","last_undegraded":"2023-10-16T20:08:17.713806+0000","last_fullsized":"2023-10-16T20:08:17.713806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777216+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777216+0000","last_peered":"2023-10-16T20:08:27.777216+0000","last_clean":"2023-10-16T20:08:27.777216+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777216+0000","last_undegraded":"2023-10-16T20:08:27.777216+0000","last_fullsized":"2023-10-16T20:08:27.777216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018817+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018817+0000","last_peered":"2023-10-16T20:08:30.018817+0000","last_clean":"2023-10-16T20:08:30.018817+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018817+0000","last_undegraded":"2023-10-16T20:08:30.018817+0000","last_fullsized":"2023-10-16T20:08:30.018817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948055+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948055+0000","last_peered":"2023-10-16T20:08:31.948055+0000","last_clean":"2023-10-16T20:08:31.948055+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948055+0000","last_undegraded":"2023-10-16T20:08:31.948055+0000","last_fullsized":"2023-10-16T20:08:31.948055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504674+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504674+0000","last_peered":"2023-10-16T20:08:24.504674+0000","last_clean":"2023-10-16T20:08:24.504674+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504674+0000","last_undegraded":"2023-10-16T20:08:24.504674+0000","last_fullsized":"2023-10-16T20:08:24.504674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456845+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456845+0000","last_peered":"2023-10-16T20:08:27.456845+0000","last_clean":"2023-10-16T20:08:27.456845+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456845+0000","last_undegraded":"2023-10-16T20:08:27.456845+0000","last_fullsized":"2023-10-16T20:08:27.456845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245520+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:13.245520+0000","last_peered":"2023-10-16T20:08:13.245520+0000","last_clean":"2023-10-16T20:08:13.245520+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:13.245520+0000","last_undegraded":"2023-10-16T20:08:13.245520+0000","last_fullsized":"2023-10-16T20:08:13.245520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482362+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482362+0000","last_peered":"2023-10-16T20:08:16.482362+0000","last_clean":"2023-10-16T20:08:16.482362+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482362+0000","last_undegraded":"2023-10-16T20:08:16.482362+0000","last_fullsized":"2023-10-16T20:08:16.482362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190507+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190507+0000","last_peered":"2023-10-16T20:08:20.190507+0000","last_clean":"2023-10-16T20:08:20.190507+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190507+0000","last_undegraded":"2023-10-16T20:08:20.190507+0000","last_fullsized":"2023-10-16T20:08:20.190507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208148+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208148+0000","last_peered":"2023-10-16T20:08:58.208148+0000","last_clean":"2023-10-16T20:08:58.208148+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208148+0000","last_undegraded":"2023-10-16T20:08:58.208148+0000","last_fullsized":"2023-10-16T20:08:58.208148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245230+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:13.245230+0000","last_peered":"2023-10-16T20:08:13.245230+0000","last_clean":"2023-10-16T20:08:13.245230+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:13.245230+0000","last_undegraded":"2023-10-16T20:08:13.245230+0000","last_fullsized":"2023-10-16T20:08:13.245230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465756+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465756+0000","last_peered":"2023-10-16T20:08:23.465756+0000","last_clean":"2023-10-16T20:08:23.465756+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465756+0000","last_undegraded":"2023-10-16T20:08:23.465756+0000","last_fullsized":"2023-10-16T20:08:23.465756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245232+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:13.245232+0000","last_peered":"2023-10-16T20:08:13.245232+0000","last_clean":"2023-10-16T20:08:13.245232+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:13.245232+0000","last_undegraded":"2023-10-16T20:08:13.245232+0000","last_fullsized":"2023-10-16T20:08:13.245232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918527+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918527+0000","last_peered":"2023-10-16T20:08:32.918527+0000","last_clean":"2023-10-16T20:08:32.918527+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918527+0000","last_undegraded":"2023-10-16T20:08:32.918527+0000","last_fullsized":"2023-10-16T20:08:32.918527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581835+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581835+0000","last_peered":"2023-10-16T20:08:24.581835+0000","last_clean":"2023-10-16T20:08:24.581835+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581835+0000","last_undegraded":"2023-10-16T20:08:24.581835+0000","last_fullsized":"2023-10-16T20:08:24.581835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690419+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690419+0000","last_peered":"2023-10-16T20:08:46.690419+0000","last_clean":"2023-10-16T20:08:46.690419+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690419+0000","last_undegraded":"2023-10-16T20:08:46.690419+0000","last_fullsized":"2023-10-16T20:08:46.690419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.573398+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:13.573398+0000","last_peered":"2023-10-16T20:08:13.573398+0000","last_clean":"2023-10-16T20:08:13.573398+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:13.573398+0000","last_undegraded":"2023-10-16T20:08:13.573398+0000","last_fullsized":"2023-10-16T20:08:13.573398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148034+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148034+0000","last_peered":"2023-10-16T20:08:33.148034+0000","last_clean":"2023-10-16T20:08:33.148034+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148034+0000","last_undegraded":"2023-10-16T20:08:33.148034+0000","last_fullsized":"2023-10-16T20:08:33.148034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974925+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974925+0000","last_peered":"2023-10-16T20:08:20.974925+0000","last_clean":"2023-10-16T20:08:20.974925+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974925+0000","last_undegraded":"2023-10-16T20:08:20.974925+0000","last_fullsized":"2023-10-16T20:08:20.974925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311234+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311234+0000","last_peered":"2023-10-16T20:08:53.311234+0000","last_clean":"2023-10-16T20:08:53.311234+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311234+0000","last_undegraded":"2023-10-16T20:08:53.311234+0000","last_fullsized":"2023-10-16T20:08:53.311234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245481+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:13.245481+0000","last_peered":"2023-10-16T20:08:13.245481+0000","last_clean":"2023-10-16T20:08:13.245481+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:13.245481+0000","last_undegraded":"2023-10-16T20:08:13.245481+0000","last_fullsized":"2023-10-16T20:08:13.245481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762741+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762741+0000","last_peered":"2023-10-16T20:09:01.762741+0000","last_clean":"2023-10-16T20:09:01.762741+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762741+0000","last_undegraded":"2023-10-16T20:09:01.762741+0000","last_fullsized":"2023-10-16T20:09:01.762741+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449268+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449268+0000","last_peered":"2023-10-16T20:08:20.449268+0000","last_clean":"2023-10-16T20:08:20.449268+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449268+0000","last_undegraded":"2023-10-16T20:08:20.449268+0000","last_fullsized":"2023-10-16T20:08:20.449268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526487+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526487+0000","last_peered":"2023-10-16T20:08:31.526487+0000","last_clean":"2023-10-16T20:08:31.526487+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526487+0000","last_undegraded":"2023-10-16T20:08:31.526487+0000","last_fullsized":"2023-10-16T20:08:31.526487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098579+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:13.098579+0000","last_peered":"2023-10-16T20:08:13.098579+0000","last_clean":"2023-10-16T20:08:13.098579+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:13.098579+0000","last_undegraded":"2023-10-16T20:08:13.098579+0000","last_fullsized":"2023-10-16T20:08:13.098579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101595+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101595+0000","last_peered":"2023-10-16T20:08:32.101595+0000","last_clean":"2023-10-16T20:08:32.101595+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101595+0000","last_undegraded":"2023-10-16T20:08:32.101595+0000","last_fullsized":"2023-10-16T20:08:32.101595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408942+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:13.408942+0000","last_peered":"2023-10-16T20:08:13.408942+0000","last_clean":"2023-10-16T20:08:13.408942+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:13.408942+0000","last_undegraded":"2023-10-16T20:08:13.408942+0000","last_fullsized":"2023-10-16T20:08:13.408942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407598+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407598+0000","last_peered":"2023-10-16T20:08:37.407598+0000","last_clean":"2023-10-16T20:08:37.407598+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407598+0000","last_undegraded":"2023-10-16T20:08:37.407598+0000","last_fullsized":"2023-10-16T20:08:37.407598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469198+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469198+0000","last_peered":"2023-10-16T20:08:23.469198+0000","last_clean":"2023-10-16T20:08:23.469198+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469198+0000","last_undegraded":"2023-10-16T20:08:23.469198+0000","last_fullsized":"2023-10-16T20:08:23.469198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129316+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129316+0000","last_peered":"2023-10-16T20:09:06.129316+0000","last_clean":"2023-10-16T20:09:06.129316+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129316+0000","last_undegraded":"2023-10-16T20:09:06.129316+0000","last_fullsized":"2023-10-16T20:09:06.129316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095679+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:13.095679+0000","last_peered":"2023-10-16T20:08:13.095679+0000","last_clean":"2023-10-16T20:08:13.095679+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:13.095679+0000","last_undegraded":"2023-10-16T20:08:13.095679+0000","last_fullsized":"2023-10-16T20:08:13.095679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.499966+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:14.499966+0000","last_peered":"2023-10-16T20:08:14.499966+0000","last_clean":"2023-10-16T20:08:14.499966+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:14.499966+0000","last_undegraded":"2023-10-16T20:08:14.499966+0000","last_fullsized":"2023-10-16T20:08:14.499966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437890+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437890+0000","last_peered":"2023-10-16T20:08:29.437890+0000","last_clean":"2023-10-16T20:08:29.437890+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437890+0000","last_undegraded":"2023-10-16T20:08:29.437890+0000","last_fullsized":"2023-10-16T20:08:29.437890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.800563+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:14.800563+0000","last_peered":"2023-10-16T20:08:14.800563+0000","last_clean":"2023-10-16T20:08:14.800563+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:14.800563+0000","last_undegraded":"2023-10-16T20:08:14.800563+0000","last_fullsized":"2023-10-16T20:08:14.800563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.39200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.45200000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69499999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64700000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.42999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66300000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.751,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.751}]},{"osd":3,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.433}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73399999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.57099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77200000000000002,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":1.218,"15min":1.218},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":0.70799999999999996},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.73999999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.755,"5min":1.391,"15min":1.391},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":1.516,"15min":1.516},"last":0.62},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.79600000000000004,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56299999999999994,"15min":0.59299999999999997},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.70299999999999996,"15min":0.76500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.501},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.66400000000000003,"15min":0.70199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71799999999999997,"5min":1.849,"15min":1.849},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.749,"15min":0.81100000000000005},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80600000000000005,"5min":2.585,"15min":2.585},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.115,"15min":1.115},"last":0.63200000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.23699999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54100000000000004,"5min":0.621,"15min":0.621},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.28999999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.38800000000000001},"min":{"1min":0.35399999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92200000000000004,"5min":1.153,"15min":1.153},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"min":{"1min":0.52000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89400000000000002,"5min":1.214,"15min":1.214},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.52300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82099999999999995,"5min":1.135,"15min":1.135},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.622},"min":{"1min":0.59299999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1.05,"15min":1.05},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.624},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83999999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.502}]},{"osd":7,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.53400000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.55700000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.42499999999999999,"15min":0.46200000000000002},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.48999999999999999,"5min":2.798,"15min":2.798},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.33100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":1.087,"15min":1.087},"last":0.35399999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46000000000000002,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.309,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59799999999999998,"5min":1.218,"15min":1.218},"last":0.37}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.439,"15min":0.44},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.46999999999999997,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":2.754,"15min":2.754},"last":0.44500000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86399999999999999,"5min":1.125,"15min":1.125},"last":0.627},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82999999999999996,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76700000000000002,"5min":1.246,"15min":1.246},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88400000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.52500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.153,"15min":1.153},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.51700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82899999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90300000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.64800000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33600000000000002,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38,"15min":0.375},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.33600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.377,"15min":0.371},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.372}]},{"osd":4,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.497,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.52800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.77600000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.749}]},{"osd":7,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63600000000000001,"15min":0.61799999999999999},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79600000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.63,"15min":0.63},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.31900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.376}]},{"osd":2,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42999999999999999},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.55600000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59399999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.437}]},{"osd":4,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.629},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.88200000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.70899999999999996},"min":{"1min":0.54200000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.55600000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.81499999999999995,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.747},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.85299999999999998,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.496,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89000000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.53200000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.84399999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.5,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72599999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":2.899,"15min":2.899},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65000000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":1.24,"15min":1.24},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":0.872},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42999999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.371,"15min":0.371},"max":{"1min":0.78600000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.47599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.745,"5min":1.046,"15min":1.046},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.47899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.81499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.46200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72499999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":0.87,"15min":0.87},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.51200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.81899999999999995,"5min":1.103,"15min":1.103},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.872,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63200000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.63,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":1.546,"15min":1.546},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.66900000000000004,"15min":0.71899999999999997},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72799999999999998,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.68100000000000005}]},{"osd":7,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:09:33.921 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:09:33.922 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:09:53.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:09:54.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.055+0000 7f4622f31700 1 Processor -- start 2023-10-16T20:09:54.059 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.055+0000 7f4622f31700 1 -- start start 2023-10-16T20:09:54.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f4622f31700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f461c0ae1c0 0x7f461c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f4622f31700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06dc70 0x7f461c0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f4622f31700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c161350 con 0x7f461c06e290 2023-10-16T20:09:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f4622f31700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c1615f0 con 0x7f461c0ae1c0 2023-10-16T20:09:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f4622f31700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1618d0 con 0x7f461c06dc70 2023-10-16T20:09:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f461bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f461c06e290 0x7f461c06a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41668/0 (socket says 172.21.15.152:41668) 2023-10-16T20:09:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f461bfff700 1 -- 172.21.15.152:0/2178100945 learned_addr learned my addr 172.21.15.152:0/2178100945 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:09:54.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.056+0000 7f4620ccd700 1 --2- 172.21.15.152:0/2178100945 >> v2:172.21.15.152:3300/0 conn(0x7f461c0ae1c0 0x7f461c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:54.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f46214ce700 1 --2- 172.21.15.152:0/2178100945 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06dc70 0x7f461c0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:54.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f4620ccd700 1 -- 172.21.15.152:0/2178100945 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06dc70 msgr2=0x7f461c0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:09:54.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f4620ccd700 1 --2- 172.21.15.152:0/2178100945 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06dc70 0x7f461c0cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f4620ccd700 1 -- 172.21.15.152:0/2178100945 >> v1:172.21.15.152:6789/0 conn(0x7f461c06e290 legacy=0x7f461c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f461b7fe700 1 -- 172.21.15.152:0/2178100945 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156033265 0 0) 0x7f461c161350 con 0x7f461c06e290 2023-10-16T20:09:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f4620ccd700 1 -- 172.21.15.152:0/2178100945 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c161bb0 con 0x7f461c0ae1c0 2023-10-16T20:09:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f4620ccd700 1 --2- 172.21.15.152:0/2178100945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c0ae1c0 0x7f461c0cd4b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4610009840 tx=0x7f4610009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5c2cfd3bac2231 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f461b7fe700 1 -- 172.21.15.152:0/2178100945 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610011830 con 0x7f461c0ae1c0 2023-10-16T20:09:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f461b7fe700 1 -- 172.21.15.152:0/2178100945 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610011990 con 0x7f461c0ae1c0 2023-10-16T20:09:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.057+0000 7f461b7fe700 1 -- 172.21.15.152:0/2178100945 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610011d20 con 0x7f461c0ae1c0 2023-10-16T20:09:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 -- 172.21.15.152:0/2178100945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c0ae1c0 msgr2=0x7f461c0cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 --2- 172.21.15.152:0/2178100945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c0ae1c0 0x7f461c0cd4b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4610009840 tx=0x7f4610009b50 comp rx=0 tx=0).stop 2023-10-16T20:09:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 -- 172.21.15.152:0/2178100945 shutdown_connections 2023-10-16T20:09:54.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 --2- 172.21.15.152:0/2178100945 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06dc70 0x7f461c0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 --2- 172.21.15.152:0/2178100945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c0ae1c0 0x7f461c0cd4b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 -- 172.21.15.152:0/2178100945 >> 172.21.15.152:0/2178100945 conn(0x7f461c0cfcd0 msgr2=0x7f461c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:09:54.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 -- 172.21.15.152:0/2178100945 shutdown_connections 2023-10-16T20:09:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.058+0000 7f4622f31700 1 -- 172.21.15.152:0/2178100945 wait complete. 2023-10-16T20:09:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.059+0000 7f4622f31700 1 Processor -- start 2023-10-16T20:09:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.059+0000 7f4622f31700 1 -- start start 2023-10-16T20:09:54.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4622f31700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 0x7f461c154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:54.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4622f31700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06e290 0x7f461c1f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:54.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4622f31700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f461c0ae1c0 0x7f461c1f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:54.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4622f31700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c9af0 con 0x7f461c06dc70 2023-10-16T20:09:54.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4622f31700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c97f0 con 0x7f461c0ae1c0 2023-10-16T20:09:54.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4622f31700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c6a50 con 0x7f461c06e290 2023-10-16T20:09:54.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 0x7f461c154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:54.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 0x7f461c154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33242/0 (socket says 172.21.15.152:33242) 2023-10-16T20:09:54.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 -- 172.21.15.152:0/1210082111 learned_addr learned my addr 172.21.15.152:0/1210082111 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:09:54.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f461bfff700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06e290 0x7f461c1f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:54.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f46214ce700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f461c0ae1c0 0x7f461c1f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:54.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 -- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06e290 msgr2=0x7f461c1f3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:54.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06e290 0x7f461c1f3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 -- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f461c0ae1c0 msgr2=0x7f461c1f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:54.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f461c0ae1c0 0x7f461c1f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 -- 172.21.15.152:0/1210082111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100094a0 con 0x7f461c06dc70 2023-10-16T20:09:54.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.060+0000 7f4620ccd700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 0x7f461c154dd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f461c066b80 tx=0x7f4610004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.061+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100036a0 con 0x7f461c06dc70 2023-10-16T20:09:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.061+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461001f070 con 0x7f461c06dc70 2023-10-16T20:09:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.061+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c0c6d30 con 0x7f461c06dc70 2023-10-16T20:09:54.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.061+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610003a20 con 0x7f461c06dc70 2023-10-16T20:09:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.061+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c1f3ba0 con 0x7f461c06dc70 2023-10-16T20:09:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.062+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c0c9650 con 0x7f461c06dc70 2023-10-16T20:09:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.062+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4610003b80 con 0x7f461c06dc70 2023-10-16T20:09:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.062+0000 7f46197fa700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f460006af00 0x7f460006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:09:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.062+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f4610021070 con 0x7f461c06dc70 2023-10-16T20:09:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.062+0000 7f461bfff700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f460006af00 0x7f460006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:09:54.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.063+0000 7f461bfff700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f460006af00 0x7f460006d3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cde80 tx=0x7f4608007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:09:54.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.067+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f461c0c9650 con 0x7f461c06dc70 2023-10-16T20:09:54.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.257+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f461c06c1e0 con 0x7f460006af00 2023-10-16T20:09:54.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.264+0000 7f46197fa700 1 -- 172.21.15.152:0/1210082111 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290471 (secure 0 0 0) 0x7f4608001370 con 0x7f460006af00 2023-10-16T20:09:54.271 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:09:54.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f460006af00 msgr2=0x7f460006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:54.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f460006af00 0x7f460006d3c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cde80 tx=0x7f4608007de0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 msgr2=0x7f461c154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:09:54.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 0x7f461c154dd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f461c066b80 tx=0x7f4610004750 comp rx=0 tx=0).stop 2023-10-16T20:09:54.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 shutdown_connections 2023-10-16T20:09:54.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f460006af00 0x7f460006d3c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f461c0ae1c0 0x7f461c1f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f461c06dc70 0x7f461c154dd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 --2- 172.21.15.152:0/1210082111 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f461c06e290 0x7f461c1f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:09:54.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 >> 172.21.15.152:0/1210082111 conn(0x7f461c0cfcd0 msgr2=0x7f461c06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:09:54.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 shutdown_connections 2023-10-16T20:09:54.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:09:54.268+0000 7f4622f31700 1 -- 172.21.15.152:0/1210082111 wait complete. 2023-10-16T20:09:54.277 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:09:54.283 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2023-10-16T20:09:52.816232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002925"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681867+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681867+0000","last_peered":"2023-10-16T20:08:25.681867+0000","last_clean":"2023-10-16T20:08:25.681867+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681867+0000","last_undegraded":"2023-10-16T20:08:25.681867+0000","last_fullsized":"2023-10-16T20:08:25.681867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716320+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716320+0000","last_peered":"2023-10-16T20:08:48.716320+0000","last_clean":"2023-10-16T20:08:48.716320+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716320+0000","last_undegraded":"2023-10-16T20:08:48.716320+0000","last_fullsized":"2023-10-16T20:08:48.716320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568727+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568727+0000","last_peered":"2023-10-16T20:08:27.568727+0000","last_clean":"2023-10-16T20:08:27.568727+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568727+0000","last_undegraded":"2023-10-16T20:08:27.568727+0000","last_fullsized":"2023-10-16T20:08:27.568727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499254+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499254+0000","last_peered":"2023-10-16T20:08:20.499254+0000","last_clean":"2023-10-16T20:08:20.499254+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499254+0000","last_undegraded":"2023-10-16T20:08:20.499254+0000","last_fullsized":"2023-10-16T20:08:20.499254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509595+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509595+0000","last_peered":"2023-10-16T20:08:15.509595+0000","last_clean":"2023-10-16T20:08:15.509595+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509595+0000","last_undegraded":"2023-10-16T20:08:15.509595+0000","last_fullsized":"2023-10-16T20:08:15.509595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157235+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157235+0000","last_peered":"2023-10-16T20:08:25.157235+0000","last_clean":"2023-10-16T20:08:25.157235+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157235+0000","last_undegraded":"2023-10-16T20:08:25.157235+0000","last_fullsized":"2023-10-16T20:08:25.157235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.866996+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.866996+0000","last_peered":"2023-10-16T20:08:59.866996+0000","last_clean":"2023-10-16T20:08:59.866996+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.866996+0000","last_undegraded":"2023-10-16T20:08:59.866996+0000","last_fullsized":"2023-10-16T20:08:59.866996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596658+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596658+0000","last_peered":"2023-10-16T20:08:42.596658+0000","last_clean":"2023-10-16T20:08:42.596658+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596658+0000","last_undegraded":"2023-10-16T20:08:42.596658+0000","last_fullsized":"2023-10-16T20:08:42.596658+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606037+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606037+0000","last_peered":"2023-10-16T20:08:35.606037+0000","last_clean":"2023-10-16T20:08:35.606037+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606037+0000","last_undegraded":"2023-10-16T20:08:35.606037+0000","last_fullsized":"2023-10-16T20:08:35.606037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885823+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885823+0000","last_peered":"2023-10-16T20:08:48.885823+0000","last_clean":"2023-10-16T20:08:48.885823+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885823+0000","last_undegraded":"2023-10-16T20:08:48.885823+0000","last_fullsized":"2023-10-16T20:08:48.885823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958911+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958911+0000","last_peered":"2023-10-16T20:08:34.958911+0000","last_clean":"2023-10-16T20:08:34.958911+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958911+0000","last_undegraded":"2023-10-16T20:08:34.958911+0000","last_fullsized":"2023-10-16T20:08:34.958911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500913+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500913+0000","last_peered":"2023-10-16T20:08:24.500913+0000","last_clean":"2023-10-16T20:08:24.500913+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500913+0000","last_undegraded":"2023-10-16T20:08:24.500913+0000","last_fullsized":"2023-10-16T20:08:24.500913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938126+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938126+0000","last_peered":"2023-10-16T20:08:50.938126+0000","last_clean":"2023-10-16T20:08:50.938126+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938126+0000","last_undegraded":"2023-10-16T20:08:50.938126+0000","last_fullsized":"2023-10-16T20:08:50.938126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399610+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399610+0000","last_peered":"2023-10-16T20:08:34.399610+0000","last_clean":"2023-10-16T20:08:34.399610+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399610+0000","last_undegraded":"2023-10-16T20:08:34.399610+0000","last_fullsized":"2023-10-16T20:08:34.399610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866861+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866861+0000","last_peered":"2023-10-16T20:09:00.866861+0000","last_clean":"2023-10-16T20:09:00.866861+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866861+0000","last_undegraded":"2023-10-16T20:09:00.866861+0000","last_fullsized":"2023-10-16T20:09:00.866861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412489+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412489+0000","last_peered":"2023-10-16T20:08:48.412489+0000","last_clean":"2023-10-16T20:08:48.412489+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412489+0000","last_undegraded":"2023-10-16T20:08:48.412489+0000","last_fullsized":"2023-10-16T20:08:48.412489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228267+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228267+0000","last_peered":"2023-10-16T20:09:01.228267+0000","last_clean":"2023-10-16T20:09:01.228267+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228267+0000","last_undegraded":"2023-10-16T20:09:01.228267+0000","last_fullsized":"2023-10-16T20:09:01.228267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475166+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475166+0000","last_peered":"2023-10-16T20:08:29.475166+0000","last_clean":"2023-10-16T20:08:29.475166+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475166+0000","last_undegraded":"2023-10-16T20:08:29.475166+0000","last_fullsized":"2023-10-16T20:08:29.475166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504133+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504133+0000","last_peered":"2023-10-16T20:08:21.504133+0000","last_clean":"2023-10-16T20:08:21.504133+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504133+0000","last_undegraded":"2023-10-16T20:08:21.504133+0000","last_fullsized":"2023-10-16T20:08:21.504133+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354233+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354233+0000","last_peered":"2023-10-16T20:08:37.354233+0000","last_clean":"2023-10-16T20:08:37.354233+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354233+0000","last_undegraded":"2023-10-16T20:08:37.354233+0000","last_fullsized":"2023-10-16T20:08:37.354233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895381+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895381+0000","last_peered":"2023-10-16T20:08:38.895381+0000","last_clean":"2023-10-16T20:08:38.895381+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895381+0000","last_undegraded":"2023-10-16T20:08:38.895381+0000","last_fullsized":"2023-10-16T20:08:38.895381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399673+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399673+0000","last_peered":"2023-10-16T20:08:42.399673+0000","last_clean":"2023-10-16T20:08:42.399673+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399673+0000","last_undegraded":"2023-10-16T20:08:42.399673+0000","last_fullsized":"2023-10-16T20:08:42.399673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184739+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184739+0000","last_peered":"2023-10-16T20:08:59.184739+0000","last_clean":"2023-10-16T20:08:59.184739+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184739+0000","last_undegraded":"2023-10-16T20:08:59.184739+0000","last_fullsized":"2023-10-16T20:08:59.184739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544178+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544178+0000","last_peered":"2023-10-16T20:08:14.544178+0000","last_clean":"2023-10-16T20:08:14.544178+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544178+0000","last_undegraded":"2023-10-16T20:08:14.544178+0000","last_fullsized":"2023-10-16T20:08:14.544178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494631+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494631+0000","last_peered":"2023-10-16T20:08:30.494631+0000","last_clean":"2023-10-16T20:08:30.494631+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494631+0000","last_undegraded":"2023-10-16T20:08:30.494631+0000","last_fullsized":"2023-10-16T20:08:30.494631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161600+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161600+0000","last_peered":"2023-10-16T20:08:23.161600+0000","last_clean":"2023-10-16T20:08:23.161600+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161600+0000","last_undegraded":"2023-10-16T20:08:23.161600+0000","last_fullsized":"2023-10-16T20:08:23.161600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392429+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392429+0000","last_peered":"2023-10-16T20:08:36.392429+0000","last_clean":"2023-10-16T20:08:36.392429+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392429+0000","last_undegraded":"2023-10-16T20:08:36.392429+0000","last_fullsized":"2023-10-16T20:08:36.392429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889872+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889872+0000","last_peered":"2023-10-16T20:08:49.889872+0000","last_clean":"2023-10-16T20:08:49.889872+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889872+0000","last_undegraded":"2023-10-16T20:08:49.889872+0000","last_fullsized":"2023-10-16T20:08:49.889872+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409793+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409793+0000","last_peered":"2023-10-16T20:08:27.409793+0000","last_clean":"2023-10-16T20:08:27.409793+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409793+0000","last_undegraded":"2023-10-16T20:08:27.409793+0000","last_fullsized":"2023-10-16T20:08:27.409793+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423048+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423048+0000","last_peered":"2023-10-16T20:08:24.423048+0000","last_clean":"2023-10-16T20:08:24.423048+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423048+0000","last_undegraded":"2023-10-16T20:08:24.423048+0000","last_fullsized":"2023-10-16T20:08:24.423048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188891+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188891+0000","last_peered":"2023-10-16T20:09:04.188891+0000","last_clean":"2023-10-16T20:09:04.188891+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188891+0000","last_undegraded":"2023-10-16T20:09:04.188891+0000","last_fullsized":"2023-10-16T20:09:04.188891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158022+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158022+0000","last_peered":"2023-10-16T20:08:29.158022+0000","last_clean":"2023-10-16T20:08:29.158022+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158022+0000","last_undegraded":"2023-10-16T20:08:29.158022+0000","last_fullsized":"2023-10-16T20:08:29.158022+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306578+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306578+0000","last_peered":"2023-10-16T20:08:35.306578+0000","last_clean":"2023-10-16T20:08:35.306578+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306578+0000","last_undegraded":"2023-10-16T20:08:35.306578+0000","last_fullsized":"2023-10-16T20:08:35.306578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439516+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439516+0000","last_peered":"2023-10-16T20:08:23.439516+0000","last_clean":"2023-10-16T20:08:23.439516+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439516+0000","last_undegraded":"2023-10-16T20:08:23.439516+0000","last_fullsized":"2023-10-16T20:08:23.439516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102269+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102269+0000","last_peered":"2023-10-16T20:08:31.102269+0000","last_clean":"2023-10-16T20:08:31.102269+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102269+0000","last_undegraded":"2023-10-16T20:08:31.102269+0000","last_fullsized":"2023-10-16T20:08:31.102269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098759+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:13.098759+0000","last_peered":"2023-10-16T20:08:13.098759+0000","last_clean":"2023-10-16T20:08:13.098759+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:13.098759+0000","last_undegraded":"2023-10-16T20:08:13.098759+0000","last_fullsized":"2023-10-16T20:08:13.098759+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386361+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386361+0000","last_peered":"2023-10-16T20:08:38.386361+0000","last_clean":"2023-10-16T20:08:38.386361+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386361+0000","last_undegraded":"2023-10-16T20:08:38.386361+0000","last_fullsized":"2023-10-16T20:08:38.386361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255050+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255050+0000","last_peered":"2023-10-16T20:08:15.255050+0000","last_clean":"2023-10-16T20:08:15.255050+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255050+0000","last_undegraded":"2023-10-16T20:08:15.255050+0000","last_fullsized":"2023-10-16T20:08:15.255050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798138+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798138+0000","last_peered":"2023-10-16T20:09:02.798138+0000","last_clean":"2023-10-16T20:09:02.798138+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798138+0000","last_undegraded":"2023-10-16T20:09:02.798138+0000","last_fullsized":"2023-10-16T20:09:02.798138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428235+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428235+0000","last_peered":"2023-10-16T20:08:22.428235+0000","last_clean":"2023-10-16T20:08:22.428235+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428235+0000","last_undegraded":"2023-10-16T20:08:22.428235+0000","last_fullsized":"2023-10-16T20:08:22.428235+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528304+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528304+0000","last_peered":"2023-10-16T20:08:29.528304+0000","last_clean":"2023-10-16T20:08:29.528304+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528304+0000","last_undegraded":"2023-10-16T20:08:29.528304+0000","last_fullsized":"2023-10-16T20:08:29.528304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920349+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920349+0000","last_peered":"2023-10-16T20:08:15.920349+0000","last_clean":"2023-10-16T20:08:15.920349+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920349+0000","last_undegraded":"2023-10-16T20:08:15.920349+0000","last_fullsized":"2023-10-16T20:08:15.920349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902452+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902452+0000","last_peered":"2023-10-16T20:08:47.902452+0000","last_clean":"2023-10-16T20:08:47.902452+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902452+0000","last_undegraded":"2023-10-16T20:08:47.902452+0000","last_fullsized":"2023-10-16T20:08:47.902452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469599+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469599+0000","last_peered":"2023-10-16T20:08:27.469599+0000","last_clean":"2023-10-16T20:08:27.469599+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469599+0000","last_undegraded":"2023-10-16T20:08:27.469599+0000","last_fullsized":"2023-10-16T20:08:27.469599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441151+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441151+0000","last_peered":"2023-10-16T20:08:40.441151+0000","last_clean":"2023-10-16T20:08:40.441151+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441151+0000","last_undegraded":"2023-10-16T20:08:40.441151+0000","last_fullsized":"2023-10-16T20:08:40.441151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248069+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248069+0000","last_peered":"2023-10-16T20:08:14.248069+0000","last_clean":"2023-10-16T20:08:14.248069+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248069+0000","last_undegraded":"2023-10-16T20:08:14.248069+0000","last_fullsized":"2023-10-16T20:08:14.248069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745452+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745452+0000","last_peered":"2023-10-16T20:08:56.745452+0000","last_clean":"2023-10-16T20:08:56.745452+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745452+0000","last_undegraded":"2023-10-16T20:08:56.745452+0000","last_fullsized":"2023-10-16T20:08:56.745452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362399+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362399+0000","last_peered":"2023-10-16T20:08:15.362399+0000","last_clean":"2023-10-16T20:08:15.362399+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362399+0000","last_undegraded":"2023-10-16T20:08:15.362399+0000","last_fullsized":"2023-10-16T20:08:15.362399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466503+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466503+0000","last_peered":"2023-10-16T20:08:23.466503+0000","last_clean":"2023-10-16T20:08:23.466503+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466503+0000","last_undegraded":"2023-10-16T20:08:23.466503+0000","last_fullsized":"2023-10-16T20:08:23.466503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096251+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:13.096251+0000","last_peered":"2023-10-16T20:08:13.096251+0000","last_clean":"2023-10-16T20:08:13.096251+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:13.096251+0000","last_undegraded":"2023-10-16T20:08:13.096251+0000","last_fullsized":"2023-10-16T20:08:13.096251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217661+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217661+0000","last_peered":"2023-10-16T20:08:57.217661+0000","last_clean":"2023-10-16T20:08:57.217661+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217661+0000","last_undegraded":"2023-10-16T20:08:57.217661+0000","last_fullsized":"2023-10-16T20:08:57.217661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950617+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950617+0000","last_peered":"2023-10-16T20:08:17.950617+0000","last_clean":"2023-10-16T20:08:17.950617+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950617+0000","last_undegraded":"2023-10-16T20:08:17.950617+0000","last_fullsized":"2023-10-16T20:08:17.950617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548212+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548212+0000","last_peered":"2023-10-16T20:08:26.548212+0000","last_clean":"2023-10-16T20:08:26.548212+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548212+0000","last_undegraded":"2023-10-16T20:08:26.548212+0000","last_fullsized":"2023-10-16T20:08:26.548212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926512+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926512+0000","last_peered":"2023-10-16T20:08:16.926512+0000","last_clean":"2023-10-16T20:08:16.926512+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926512+0000","last_undegraded":"2023-10-16T20:08:16.926512+0000","last_fullsized":"2023-10-16T20:08:16.926512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406316+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406316+0000","last_peered":"2023-10-16T20:08:32.406316+0000","last_clean":"2023-10-16T20:08:32.406316+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406316+0000","last_undegraded":"2023-10-16T20:08:32.406316+0000","last_fullsized":"2023-10-16T20:08:32.406316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713006+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713006+0000","last_peered":"2023-10-16T20:08:14.713006+0000","last_clean":"2023-10-16T20:08:14.713006+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713006+0000","last_undegraded":"2023-10-16T20:08:14.713006+0000","last_fullsized":"2023-10-16T20:08:14.713006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563193+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563193+0000","last_peered":"2023-10-16T20:08:34.563193+0000","last_clean":"2023-10-16T20:08:34.563193+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563193+0000","last_undegraded":"2023-10-16T20:08:34.563193+0000","last_fullsized":"2023-10-16T20:08:34.563193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.742868+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:13.742868+0000","last_peered":"2023-10-16T20:08:13.742868+0000","last_clean":"2023-10-16T20:08:13.742868+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:13.742868+0000","last_undegraded":"2023-10-16T20:08:13.742868+0000","last_fullsized":"2023-10-16T20:08:13.742868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675138+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675138+0000","last_peered":"2023-10-16T20:08:16.675138+0000","last_clean":"2023-10-16T20:08:16.675138+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675138+0000","last_undegraded":"2023-10-16T20:08:16.675138+0000","last_fullsized":"2023-10-16T20:08:16.675138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235501+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235501+0000","last_peered":"2023-10-16T20:08:19.235501+0000","last_clean":"2023-10-16T20:08:19.235501+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235501+0000","last_undegraded":"2023-10-16T20:08:19.235501+0000","last_fullsized":"2023-10-16T20:08:19.235501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333766+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333766+0000","last_peered":"2023-10-16T20:08:32.333766+0000","last_clean":"2023-10-16T20:08:32.333766+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333766+0000","last_undegraded":"2023-10-16T20:08:32.333766+0000","last_fullsized":"2023-10-16T20:08:32.333766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486417+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486417+0000","last_peered":"2023-10-16T20:08:21.486417+0000","last_clean":"2023-10-16T20:08:21.486417+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486417+0000","last_undegraded":"2023-10-16T20:08:21.486417+0000","last_fullsized":"2023-10-16T20:08:21.486417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663909+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663909+0000","last_peered":"2023-10-16T20:08:20.663909+0000","last_clean":"2023-10-16T20:08:20.663909+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663909+0000","last_undegraded":"2023-10-16T20:08:20.663909+0000","last_fullsized":"2023-10-16T20:08:20.663909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713806+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713806+0000","last_peered":"2023-10-16T20:08:17.713806+0000","last_clean":"2023-10-16T20:08:17.713806+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713806+0000","last_undegraded":"2023-10-16T20:08:17.713806+0000","last_fullsized":"2023-10-16T20:08:17.713806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777216+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777216+0000","last_peered":"2023-10-16T20:08:27.777216+0000","last_clean":"2023-10-16T20:08:27.777216+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777216+0000","last_undegraded":"2023-10-16T20:08:27.777216+0000","last_fullsized":"2023-10-16T20:08:27.777216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018817+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018817+0000","last_peered":"2023-10-16T20:08:30.018817+0000","last_clean":"2023-10-16T20:08:30.018817+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018817+0000","last_undegraded":"2023-10-16T20:08:30.018817+0000","last_fullsized":"2023-10-16T20:08:30.018817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948055+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948055+0000","last_peered":"2023-10-16T20:08:31.948055+0000","last_clean":"2023-10-16T20:08:31.948055+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948055+0000","last_undegraded":"2023-10-16T20:08:31.948055+0000","last_fullsized":"2023-10-16T20:08:31.948055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504674+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504674+0000","last_peered":"2023-10-16T20:08:24.504674+0000","last_clean":"2023-10-16T20:08:24.504674+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504674+0000","last_undegraded":"2023-10-16T20:08:24.504674+0000","last_fullsized":"2023-10-16T20:08:24.504674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456845+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456845+0000","last_peered":"2023-10-16T20:08:27.456845+0000","last_clean":"2023-10-16T20:08:27.456845+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456845+0000","last_undegraded":"2023-10-16T20:08:27.456845+0000","last_fullsized":"2023-10-16T20:08:27.456845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245520+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:13.245520+0000","last_peered":"2023-10-16T20:08:13.245520+0000","last_clean":"2023-10-16T20:08:13.245520+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:13.245520+0000","last_undegraded":"2023-10-16T20:08:13.245520+0000","last_fullsized":"2023-10-16T20:08:13.245520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482362+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482362+0000","last_peered":"2023-10-16T20:08:16.482362+0000","last_clean":"2023-10-16T20:08:16.482362+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482362+0000","last_undegraded":"2023-10-16T20:08:16.482362+0000","last_fullsized":"2023-10-16T20:08:16.482362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190507+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190507+0000","last_peered":"2023-10-16T20:08:20.190507+0000","last_clean":"2023-10-16T20:08:20.190507+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190507+0000","last_undegraded":"2023-10-16T20:08:20.190507+0000","last_fullsized":"2023-10-16T20:08:20.190507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208148+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208148+0000","last_peered":"2023-10-16T20:08:58.208148+0000","last_clean":"2023-10-16T20:08:58.208148+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208148+0000","last_undegraded":"2023-10-16T20:08:58.208148+0000","last_fullsized":"2023-10-16T20:08:58.208148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245230+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:13.245230+0000","last_peered":"2023-10-16T20:08:13.245230+0000","last_clean":"2023-10-16T20:08:13.245230+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:13.245230+0000","last_undegraded":"2023-10-16T20:08:13.245230+0000","last_fullsized":"2023-10-16T20:08:13.245230+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465756+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465756+0000","last_peered":"2023-10-16T20:08:23.465756+0000","last_clean":"2023-10-16T20:08:23.465756+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465756+0000","last_undegraded":"2023-10-16T20:08:23.465756+0000","last_fullsized":"2023-10-16T20:08:23.465756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245232+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:13.245232+0000","last_peered":"2023-10-16T20:08:13.245232+0000","last_clean":"2023-10-16T20:08:13.245232+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:13.245232+0000","last_undegraded":"2023-10-16T20:08:13.245232+0000","last_fullsized":"2023-10-16T20:08:13.245232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918527+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918527+0000","last_peered":"2023-10-16T20:08:32.918527+0000","last_clean":"2023-10-16T20:08:32.918527+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918527+0000","last_undegraded":"2023-10-16T20:08:32.918527+0000","last_fullsized":"2023-10-16T20:08:32.918527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581835+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581835+0000","last_peered":"2023-10-16T20:08:24.581835+0000","last_clean":"2023-10-16T20:08:24.581835+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581835+0000","last_undegraded":"2023-10-16T20:08:24.581835+0000","last_fullsized":"2023-10-16T20:08:24.581835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690419+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690419+0000","last_peered":"2023-10-16T20:08:46.690419+0000","last_clean":"2023-10-16T20:08:46.690419+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690419+0000","last_undegraded":"2023-10-16T20:08:46.690419+0000","last_fullsized":"2023-10-16T20:08:46.690419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.573398+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:13.573398+0000","last_peered":"2023-10-16T20:08:13.573398+0000","last_clean":"2023-10-16T20:08:13.573398+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:13.573398+0000","last_undegraded":"2023-10-16T20:08:13.573398+0000","last_fullsized":"2023-10-16T20:08:13.573398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148034+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148034+0000","last_peered":"2023-10-16T20:08:33.148034+0000","last_clean":"2023-10-16T20:08:33.148034+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148034+0000","last_undegraded":"2023-10-16T20:08:33.148034+0000","last_fullsized":"2023-10-16T20:08:33.148034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974925+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974925+0000","last_peered":"2023-10-16T20:08:20.974925+0000","last_clean":"2023-10-16T20:08:20.974925+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974925+0000","last_undegraded":"2023-10-16T20:08:20.974925+0000","last_fullsized":"2023-10-16T20:08:20.974925+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311234+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311234+0000","last_peered":"2023-10-16T20:08:53.311234+0000","last_clean":"2023-10-16T20:08:53.311234+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311234+0000","last_undegraded":"2023-10-16T20:08:53.311234+0000","last_fullsized":"2023-10-16T20:08:53.311234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.245481+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:13.245481+0000","last_peered":"2023-10-16T20:08:13.245481+0000","last_clean":"2023-10-16T20:08:13.245481+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:13.245481+0000","last_undegraded":"2023-10-16T20:08:13.245481+0000","last_fullsized":"2023-10-16T20:08:13.245481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762741+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762741+0000","last_peered":"2023-10-16T20:09:01.762741+0000","last_clean":"2023-10-16T20:09:01.762741+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762741+0000","last_undegraded":"2023-10-16T20:09:01.762741+0000","last_fullsized":"2023-10-16T20:09:01.762741+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449268+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449268+0000","last_peered":"2023-10-16T20:08:20.449268+0000","last_clean":"2023-10-16T20:08:20.449268+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449268+0000","last_undegraded":"2023-10-16T20:08:20.449268+0000","last_fullsized":"2023-10-16T20:08:20.449268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526487+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526487+0000","last_peered":"2023-10-16T20:08:31.526487+0000","last_clean":"2023-10-16T20:08:31.526487+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526487+0000","last_undegraded":"2023-10-16T20:08:31.526487+0000","last_fullsized":"2023-10-16T20:08:31.526487+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.098579+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:13.098579+0000","last_peered":"2023-10-16T20:08:13.098579+0000","last_clean":"2023-10-16T20:08:13.098579+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:13.098579+0000","last_undegraded":"2023-10-16T20:08:13.098579+0000","last_fullsized":"2023-10-16T20:08:13.098579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101595+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101595+0000","last_peered":"2023-10-16T20:08:32.101595+0000","last_clean":"2023-10-16T20:08:32.101595+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101595+0000","last_undegraded":"2023-10-16T20:08:32.101595+0000","last_fullsized":"2023-10-16T20:08:32.101595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.408942+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:13.408942+0000","last_peered":"2023-10-16T20:08:13.408942+0000","last_clean":"2023-10-16T20:08:13.408942+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:13.408942+0000","last_undegraded":"2023-10-16T20:08:13.408942+0000","last_fullsized":"2023-10-16T20:08:13.408942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407598+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407598+0000","last_peered":"2023-10-16T20:08:37.407598+0000","last_clean":"2023-10-16T20:08:37.407598+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407598+0000","last_undegraded":"2023-10-16T20:08:37.407598+0000","last_fullsized":"2023-10-16T20:08:37.407598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469198+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469198+0000","last_peered":"2023-10-16T20:08:23.469198+0000","last_clean":"2023-10-16T20:08:23.469198+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469198+0000","last_undegraded":"2023-10-16T20:08:23.469198+0000","last_fullsized":"2023-10-16T20:08:23.469198+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129316+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129316+0000","last_peered":"2023-10-16T20:09:06.129316+0000","last_clean":"2023-10-16T20:09:06.129316+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129316+0000","last_undegraded":"2023-10-16T20:09:06.129316+0000","last_fullsized":"2023-10-16T20:09:06.129316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.095679+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:13.095679+0000","last_peered":"2023-10-16T20:08:13.095679+0000","last_clean":"2023-10-16T20:08:13.095679+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:13.095679+0000","last_undegraded":"2023-10-16T20:08:13.095679+0000","last_fullsized":"2023-10-16T20:08:13.095679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.499966+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:14.499966+0000","last_peered":"2023-10-16T20:08:14.499966+0000","last_clean":"2023-10-16T20:08:14.499966+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:14.499966+0000","last_undegraded":"2023-10-16T20:08:14.499966+0000","last_fullsized":"2023-10-16T20:08:14.499966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437890+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437890+0000","last_peered":"2023-10-16T20:08:29.437890+0000","last_clean":"2023-10-16T20:08:29.437890+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437890+0000","last_undegraded":"2023-10-16T20:08:29.437890+0000","last_fullsized":"2023-10-16T20:08:29.437890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.800563+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:14.800563+0000","last_peered":"2023-10-16T20:08:14.800563+0000","last_clean":"2023-10-16T20:08:14.800563+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:14.800563+0000","last_undegraded":"2023-10-16T20:08:14.800563+0000","last_fullsized":"2023-10-16T20:08:14.800563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.39200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.45200000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69499999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.42999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.751,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73399999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67600000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.57099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77200000000000002,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":1.218,"15min":1.218},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":0.70799999999999996},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.73999999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.755,"5min":1.391,"15min":1.391},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64300000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":1.516,"15min":1.516},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.79600000000000004,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.67100000000000004}]},{"osd":4,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56299999999999994,"15min":0.59299999999999997},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.70299999999999996,"15min":0.76500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.52900000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.621},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.66400000000000003,"15min":0.70199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71799999999999997,"5min":1.849,"15min":1.849},"last":0.55700000000000005}]},{"osd":7,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.749,"15min":0.81100000000000005},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80600000000000005,"5min":2.585,"15min":2.585},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.115,"15min":1.115},"last":0.70499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.23699999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54100000000000004,"5min":0.621,"15min":0.621},"last":0.47699999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.28999999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.38800000000000001},"min":{"1min":0.35399999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92200000000000004,"5min":1.153,"15min":1.153},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"min":{"1min":0.52000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89400000000000002,"5min":1.214,"15min":1.214},"last":0.58699999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.52300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82099999999999995,"5min":1.135,"15min":1.135},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.622},"min":{"1min":0.59299999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1.05,"15min":1.05},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.624},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83999999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.53400000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60999999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.42499999999999999,"15min":0.46200000000000002},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.48999999999999999,"5min":2.798,"15min":2.798},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.33100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":1.087,"15min":1.087},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46000000000000002,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.309,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59799999999999998,"5min":1.218,"15min":1.218},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.439,"15min":0.44},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.46999999999999997,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":2.754,"15min":2.754},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86399999999999999,"5min":1.125,"15min":1.125},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82999999999999996,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76700000000000002,"5min":1.246,"15min":1.246},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88400000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.76400000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.52500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.153,"15min":1.153},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.51700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82899999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.746}]},{"osd":7,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90300000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.66300000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33600000000000002,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.379}]},{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38,"15min":0.375},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.33600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.377,"15min":0.371},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.35599999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.497,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.623},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.52800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63600000000000001,"15min":0.61799999999999999},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57699999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.63,"15min":0.63},"last":0.31},{"interface":"front","average":{"1min":0.433,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.31900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42999999999999999},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.55600000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59399999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51700000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.70899999999999996},"min":{"1min":0.54200000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.55600000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.81499999999999995,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.85299999999999998,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.623}]},{"osd":7,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.496,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89000000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.505},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.53200000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.64000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.5,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72599999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57299999999999995}]},{"osd":2,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":2.899,"15min":2.899},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.497}]},{"osd":3,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":1.24,"15min":1.24},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":0.872},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.371,"15min":0.371},"max":{"1min":0.78600000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.627},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.47599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.745,"5min":1.046,"15min":1.046},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.47899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.81499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.46200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":0.87,"15min":0.87},"last":0.50700000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.51200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.81899999999999995,"5min":1.103,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.872,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.63,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":1.546,"15min":1.546},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.66900000000000004,"15min":0.71899999999999997},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72799999999999998,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:09:54.291 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:09:54.291 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:10:01.507 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:01.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:14.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:14.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.424+0000 7f62373e8700 1 Processor -- start 2023-10-16T20:10:14.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.424+0000 7f62373e8700 1 -- start start 2023-10-16T20:10:14.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f62373e8700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f62300b1860 0x7f62300ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f62373e8700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f62300ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f62373e8700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62300c9d40 con 0x7f62300b0c30 2023-10-16T20:10:14.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f62373e8700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62300cd9a0 con 0x7f62300b1860 2023-10-16T20:10:14.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f62373e8700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62300cdc80 con 0x7f62300cd500 2023-10-16T20:10:14.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f6235184700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f62300b0c30 0x7f62300b1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41680/0 (socket says 172.21.15.152:41680) 2023-10-16T20:10:14.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.425+0000 7f6235184700 1 -- 172.21.15.152:0/3482236895 learned_addr learned my addr 172.21.15.152:0/3482236895 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:10:14.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535828180 0 0) 0x7f62300c9d40 con 0x7f62300b0c30 2023-10-16T20:10:14.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f621c0035b0 con 0x7f62300b0c30 2023-10-16T20:10:14.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f62300ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6234983700 1 --2- 172.21.15.152:0/3482236895 >> v2:172.21.15.163:3300/0 conn(0x7f62300b1860 0x7f62300ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244631678 0 0) 0x7f621c0035b0 con 0x7f62300b0c30 2023-10-16T20:10:14.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 msgr2=0x7f62300ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:14.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f62300ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 >> v2:172.21.15.163:3300/0 conn(0x7f62300b1860 msgr2=0x7f62300ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:14.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 --2- 172.21.15.152:0/3482236895 >> v2:172.21.15.163:3300/0 conn(0x7f62300b1860 0x7f62300ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300cdf60 con 0x7f62300b0c30 2023-10-16T20:10:14.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f6220001670 con 0x7f62300b0c30 2023-10-16T20:10:14.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 >> v1:172.21.15.152:6789/0 conn(0x7f62300b0c30 legacy=0x7f62300b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:14.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c003a00 0x7f621c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f621c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c004d90 0x7f621c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300cd9a0 con 0x7f621c004d90 2023-10-16T20:10:14.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300cdc80 con 0x7f621c003a00 2023-10-16T20:10:14.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00ba10 con 0x7f62300cd500 2023-10-16T20:10:14.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c004d90 0x7f621c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235184700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c003a00 0x7f621c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6234983700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f621c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 -- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 msgr2=0x7f621c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:14.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f621c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 -- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c003a00 msgr2=0x7f621c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:14.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c003a00 0x7f621c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235985700 1 -- 172.21.15.152:0/3482236895 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0035b0 con 0x7f621c004d90 2023-10-16T20:10:14.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6235184700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f621c003a00 0x7f621c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:10:14.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.426+0000 7f6234983700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300cd500 0x7f621c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:10:14.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f6235985700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c004d90 0x7f621c005210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f622800f240 tx=0x7f621c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09d88568a505e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:14.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800a2d0 con 0x7f621c004d90 2023-10-16T20:10:14.442 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228010040 con 0x7f621c004d90 2023-10-16T20:10:14.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f6227fff700 1 -- 172.21.15.152:0/3482236895 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622800fd20 con 0x7f621c004d90 2023-10-16T20:10:14.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f62373e8700 1 -- 172.21.15.152:0/3482236895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c004d90 msgr2=0x7f621c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:14.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f62373e8700 1 --2- 172.21.15.152:0/3482236895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f621c004d90 0x7f621c005210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f622800f240 tx=0x7f621c005880 comp rx=0 tx=0).stop 2023-10-16T20:10:14.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f6235985700 1 -- 172.21.15.152:0/3482236895 reap_dead start 2023-10-16T20:10:14.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f62373e8700 1 -- 172.21.15.152:0/3482236895 shutdown_connections 2023-10-16T20:10:14.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f62373e8700 1 -- 172.21.15.152:0/3482236895 >> 172.21.15.152:0/3482236895 conn(0x7f623006c850 msgr2=0x7f623006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:14.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f62373e8700 1 -- 172.21.15.152:0/3482236895 shutdown_connections 2023-10-16T20:10:14.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.427+0000 7f62373e8700 1 -- 172.21.15.152:0/3482236895 wait complete. 2023-10-16T20:10:14.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 Processor -- start 2023-10-16T20:10:14.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 -- start start 2023-10-16T20:10:14.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6230147ae0 0x7f62300705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300c5c60 0x7f6230070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 0x7f62301580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c4e20 con 0x7f62300c4920 2023-10-16T20:10:14.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c5100 con 0x7f6230147ae0 2023-10-16T20:10:14.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.429+0000 7f62373e8700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62300c53e0 con 0x7f62300c5c60 2023-10-16T20:10:14.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 0x7f62301580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 0x7f62301580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33264/0 (socket says 172.21.15.152:33264) 2023-10-16T20:10:14.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 -- 172.21.15.152:0/1014203189 learned_addr learned my addr 172.21.15.152:0/1014203189 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:10:14.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235184700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6230147ae0 0x7f62300705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6234983700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300c5c60 0x7f6230070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 -- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300c5c60 msgr2=0x7f6230070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:14.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300c5c60 0x7f6230070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 -- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6230147ae0 msgr2=0x7f62300705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:14.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6230147ae0 0x7f62300705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 -- 172.21.15.152:0/1014203189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300c56c0 con 0x7f62300c4920 2023-10-16T20:10:14.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235184700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6230147ae0 0x7f62300705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:10:14.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6234983700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300c5c60 0x7f6230070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:10:14.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6235985700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 0x7f62301580d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f621c0046e0 tx=0x7f622800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:14.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228007000 con 0x7f62300c4920 2023-10-16T20:10:14.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622800fed0 con 0x7f62300c4920 2023-10-16T20:10:14.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6230147ec0 con 0x7f62300c4920 2023-10-16T20:10:14.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228015d60 con 0x7f62300c4920 2023-10-16T20:10:14.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.430+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62301587f0 con 0x7f62300c4920 2023-10-16T20:10:14.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.431+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623004f400 con 0x7f62300c4920 2023-10-16T20:10:14.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.432+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6228008440 con 0x7f62300c4920 2023-10-16T20:10:14.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.432+0000 7f6225ffb700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406af00 0x7f621406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:14.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.432+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f622808a2b0 con 0x7f62300c4920 2023-10-16T20:10:14.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.432+0000 7f6235184700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406af00 0x7f621406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:14.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.433+0000 7f6235184700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406af00 0x7f621406d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6220001eb0 tx=0x7f6220001430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:14.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.437+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62280553a0 con 0x7f62300c4920 2023-10-16T20:10:14.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.623+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62300ce240 con 0x7f621406af00 2023-10-16T20:10:14.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.631+0000 7f6225ffb700 1 -- 172.21.15.152:0/1014203189 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290417 (secure 0 0 0) 0x7f6220005e60 con 0x7f621406af00 2023-10-16T20:10:14.638 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:10:14.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406af00 msgr2=0x7f621406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406af00 0x7f621406d3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6220001eb0 tx=0x7f6220001430 comp rx=0 tx=0).stop 2023-10-16T20:10:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 msgr2=0x7f62301580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:14.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 0x7f62301580d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f621c0046e0 tx=0x7f622800a860 comp rx=0 tx=0).stop 2023-10-16T20:10:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 shutdown_connections 2023-10-16T20:10:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f621406af00 0x7f621406d3c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62300c4920 0x7f62301580d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6230147ae0 0x7f62300705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 --2- 172.21.15.152:0/1014203189 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f62300c5c60 0x7f6230070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:14.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 >> 172.21.15.152:0/1014203189 conn(0x7f623006c850 msgr2=0x7f62300b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:14.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 shutdown_connections 2023-10-16T20:10:14.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:14.635+0000 7f62373e8700 1 -- 172.21.15.152:0/1014203189 wait complete. 2023-10-16T20:10:14.644 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:10:14.650 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-10-16T20:10:12.821282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003172"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681912+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681912+0000","last_peered":"2023-10-16T20:08:25.681912+0000","last_clean":"2023-10-16T20:08:25.681912+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681912+0000","last_undegraded":"2023-10-16T20:08:25.681912+0000","last_fullsized":"2023-10-16T20:08:25.681912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716377+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716377+0000","last_peered":"2023-10-16T20:08:48.716377+0000","last_clean":"2023-10-16T20:08:48.716377+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716377+0000","last_undegraded":"2023-10-16T20:08:48.716377+0000","last_fullsized":"2023-10-16T20:08:48.716377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568776+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568776+0000","last_peered":"2023-10-16T20:08:27.568776+0000","last_clean":"2023-10-16T20:08:27.568776+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568776+0000","last_undegraded":"2023-10-16T20:08:27.568776+0000","last_fullsized":"2023-10-16T20:08:27.568776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499320+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499320+0000","last_peered":"2023-10-16T20:08:20.499320+0000","last_clean":"2023-10-16T20:08:20.499320+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499320+0000","last_undegraded":"2023-10-16T20:08:20.499320+0000","last_fullsized":"2023-10-16T20:08:20.499320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509595+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509595+0000","last_peered":"2023-10-16T20:08:15.509595+0000","last_clean":"2023-10-16T20:08:15.509595+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509595+0000","last_undegraded":"2023-10-16T20:08:15.509595+0000","last_fullsized":"2023-10-16T20:08:15.509595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157235+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157235+0000","last_peered":"2023-10-16T20:08:25.157235+0000","last_clean":"2023-10-16T20:08:25.157235+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157235+0000","last_undegraded":"2023-10-16T20:08:25.157235+0000","last_fullsized":"2023-10-16T20:08:25.157235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.866996+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.866996+0000","last_peered":"2023-10-16T20:08:59.866996+0000","last_clean":"2023-10-16T20:08:59.866996+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.866996+0000","last_undegraded":"2023-10-16T20:08:59.866996+0000","last_fullsized":"2023-10-16T20:08:59.866996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596658+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596658+0000","last_peered":"2023-10-16T20:08:42.596658+0000","last_clean":"2023-10-16T20:08:42.596658+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596658+0000","last_undegraded":"2023-10-16T20:08:42.596658+0000","last_fullsized":"2023-10-16T20:08:42.596658+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606037+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606037+0000","last_peered":"2023-10-16T20:08:35.606037+0000","last_clean":"2023-10-16T20:08:35.606037+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606037+0000","last_undegraded":"2023-10-16T20:08:35.606037+0000","last_fullsized":"2023-10-16T20:08:35.606037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885823+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885823+0000","last_peered":"2023-10-16T20:08:48.885823+0000","last_clean":"2023-10-16T20:08:48.885823+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885823+0000","last_undegraded":"2023-10-16T20:08:48.885823+0000","last_fullsized":"2023-10-16T20:08:48.885823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958911+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958911+0000","last_peered":"2023-10-16T20:08:34.958911+0000","last_clean":"2023-10-16T20:08:34.958911+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958911+0000","last_undegraded":"2023-10-16T20:08:34.958911+0000","last_fullsized":"2023-10-16T20:08:34.958911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500913+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500913+0000","last_peered":"2023-10-16T20:08:24.500913+0000","last_clean":"2023-10-16T20:08:24.500913+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500913+0000","last_undegraded":"2023-10-16T20:08:24.500913+0000","last_fullsized":"2023-10-16T20:08:24.500913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938126+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938126+0000","last_peered":"2023-10-16T20:08:50.938126+0000","last_clean":"2023-10-16T20:08:50.938126+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938126+0000","last_undegraded":"2023-10-16T20:08:50.938126+0000","last_fullsized":"2023-10-16T20:08:50.938126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399610+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399610+0000","last_peered":"2023-10-16T20:08:34.399610+0000","last_clean":"2023-10-16T20:08:34.399610+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399610+0000","last_undegraded":"2023-10-16T20:08:34.399610+0000","last_fullsized":"2023-10-16T20:08:34.399610+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866861+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866861+0000","last_peered":"2023-10-16T20:09:00.866861+0000","last_clean":"2023-10-16T20:09:00.866861+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866861+0000","last_undegraded":"2023-10-16T20:09:00.866861+0000","last_fullsized":"2023-10-16T20:09:00.866861+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412489+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412489+0000","last_peered":"2023-10-16T20:08:48.412489+0000","last_clean":"2023-10-16T20:08:48.412489+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412489+0000","last_undegraded":"2023-10-16T20:08:48.412489+0000","last_fullsized":"2023-10-16T20:08:48.412489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228267+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228267+0000","last_peered":"2023-10-16T20:09:01.228267+0000","last_clean":"2023-10-16T20:09:01.228267+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228267+0000","last_undegraded":"2023-10-16T20:09:01.228267+0000","last_fullsized":"2023-10-16T20:09:01.228267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475166+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475166+0000","last_peered":"2023-10-16T20:08:29.475166+0000","last_clean":"2023-10-16T20:08:29.475166+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475166+0000","last_undegraded":"2023-10-16T20:08:29.475166+0000","last_fullsized":"2023-10-16T20:08:29.475166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504181+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504181+0000","last_peered":"2023-10-16T20:08:21.504181+0000","last_clean":"2023-10-16T20:08:21.504181+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504181+0000","last_undegraded":"2023-10-16T20:08:21.504181+0000","last_fullsized":"2023-10-16T20:08:21.504181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354283+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354283+0000","last_peered":"2023-10-16T20:08:37.354283+0000","last_clean":"2023-10-16T20:08:37.354283+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354283+0000","last_undegraded":"2023-10-16T20:08:37.354283+0000","last_fullsized":"2023-10-16T20:08:37.354283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895446+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895446+0000","last_peered":"2023-10-16T20:08:38.895446+0000","last_clean":"2023-10-16T20:08:38.895446+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895446+0000","last_undegraded":"2023-10-16T20:08:38.895446+0000","last_fullsized":"2023-10-16T20:08:38.895446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399735+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399735+0000","last_peered":"2023-10-16T20:08:42.399735+0000","last_clean":"2023-10-16T20:08:42.399735+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399735+0000","last_undegraded":"2023-10-16T20:08:42.399735+0000","last_fullsized":"2023-10-16T20:08:42.399735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184786+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184786+0000","last_peered":"2023-10-16T20:08:59.184786+0000","last_clean":"2023-10-16T20:08:59.184786+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184786+0000","last_undegraded":"2023-10-16T20:08:59.184786+0000","last_fullsized":"2023-10-16T20:08:59.184786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544254+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544254+0000","last_peered":"2023-10-16T20:08:14.544254+0000","last_clean":"2023-10-16T20:08:14.544254+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544254+0000","last_undegraded":"2023-10-16T20:08:14.544254+0000","last_fullsized":"2023-10-16T20:08:14.544254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494697+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494697+0000","last_peered":"2023-10-16T20:08:30.494697+0000","last_clean":"2023-10-16T20:08:30.494697+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494697+0000","last_undegraded":"2023-10-16T20:08:30.494697+0000","last_fullsized":"2023-10-16T20:08:30.494697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161664+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161664+0000","last_peered":"2023-10-16T20:08:23.161664+0000","last_clean":"2023-10-16T20:08:23.161664+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161664+0000","last_undegraded":"2023-10-16T20:08:23.161664+0000","last_fullsized":"2023-10-16T20:08:23.161664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392497+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392497+0000","last_peered":"2023-10-16T20:08:36.392497+0000","last_clean":"2023-10-16T20:08:36.392497+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392497+0000","last_undegraded":"2023-10-16T20:08:36.392497+0000","last_fullsized":"2023-10-16T20:08:36.392497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889971+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889971+0000","last_peered":"2023-10-16T20:08:49.889971+0000","last_clean":"2023-10-16T20:08:49.889971+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889971+0000","last_undegraded":"2023-10-16T20:08:49.889971+0000","last_fullsized":"2023-10-16T20:08:49.889971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409846+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409846+0000","last_peered":"2023-10-16T20:08:27.409846+0000","last_clean":"2023-10-16T20:08:27.409846+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409846+0000","last_undegraded":"2023-10-16T20:08:27.409846+0000","last_fullsized":"2023-10-16T20:08:27.409846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423138+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423138+0000","last_peered":"2023-10-16T20:08:24.423138+0000","last_clean":"2023-10-16T20:08:24.423138+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423138+0000","last_undegraded":"2023-10-16T20:08:24.423138+0000","last_fullsized":"2023-10-16T20:08:24.423138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188950+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188950+0000","last_peered":"2023-10-16T20:09:04.188950+0000","last_clean":"2023-10-16T20:09:04.188950+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188950+0000","last_undegraded":"2023-10-16T20:09:04.188950+0000","last_fullsized":"2023-10-16T20:09:04.188950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158114+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158114+0000","last_peered":"2023-10-16T20:08:29.158114+0000","last_clean":"2023-10-16T20:08:29.158114+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158114+0000","last_undegraded":"2023-10-16T20:08:29.158114+0000","last_fullsized":"2023-10-16T20:08:29.158114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306578+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306578+0000","last_peered":"2023-10-16T20:08:35.306578+0000","last_clean":"2023-10-16T20:08:35.306578+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306578+0000","last_undegraded":"2023-10-16T20:08:35.306578+0000","last_fullsized":"2023-10-16T20:08:35.306578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439579+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439579+0000","last_peered":"2023-10-16T20:08:23.439579+0000","last_clean":"2023-10-16T20:08:23.439579+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439579+0000","last_undegraded":"2023-10-16T20:08:23.439579+0000","last_fullsized":"2023-10-16T20:08:23.439579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102269+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102269+0000","last_peered":"2023-10-16T20:08:31.102269+0000","last_clean":"2023-10-16T20:08:31.102269+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102269+0000","last_undegraded":"2023-10-16T20:08:31.102269+0000","last_fullsized":"2023-10-16T20:08:31.102269+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100492+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:14.100492+0000","last_peered":"2023-10-16T20:08:14.100492+0000","last_clean":"2023-10-16T20:08:14.100492+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:14.100492+0000","last_undegraded":"2023-10-16T20:08:14.100492+0000","last_fullsized":"2023-10-16T20:08:14.100492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386428+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386428+0000","last_peered":"2023-10-16T20:08:38.386428+0000","last_clean":"2023-10-16T20:08:38.386428+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386428+0000","last_undegraded":"2023-10-16T20:08:38.386428+0000","last_fullsized":"2023-10-16T20:08:38.386428+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255050+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255050+0000","last_peered":"2023-10-16T20:08:15.255050+0000","last_clean":"2023-10-16T20:08:15.255050+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255050+0000","last_undegraded":"2023-10-16T20:08:15.255050+0000","last_fullsized":"2023-10-16T20:08:15.255050+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798211+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798211+0000","last_peered":"2023-10-16T20:09:02.798211+0000","last_clean":"2023-10-16T20:09:02.798211+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798211+0000","last_undegraded":"2023-10-16T20:09:02.798211+0000","last_fullsized":"2023-10-16T20:09:02.798211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428235+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428235+0000","last_peered":"2023-10-16T20:08:22.428235+0000","last_clean":"2023-10-16T20:08:22.428235+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428235+0000","last_undegraded":"2023-10-16T20:08:22.428235+0000","last_fullsized":"2023-10-16T20:08:22.428235+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528304+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528304+0000","last_peered":"2023-10-16T20:08:29.528304+0000","last_clean":"2023-10-16T20:08:29.528304+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528304+0000","last_undegraded":"2023-10-16T20:08:29.528304+0000","last_fullsized":"2023-10-16T20:08:29.528304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920349+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920349+0000","last_peered":"2023-10-16T20:08:15.920349+0000","last_clean":"2023-10-16T20:08:15.920349+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920349+0000","last_undegraded":"2023-10-16T20:08:15.920349+0000","last_fullsized":"2023-10-16T20:08:15.920349+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902452+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902452+0000","last_peered":"2023-10-16T20:08:47.902452+0000","last_clean":"2023-10-16T20:08:47.902452+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902452+0000","last_undegraded":"2023-10-16T20:08:47.902452+0000","last_fullsized":"2023-10-16T20:08:47.902452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469599+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469599+0000","last_peered":"2023-10-16T20:08:27.469599+0000","last_clean":"2023-10-16T20:08:27.469599+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469599+0000","last_undegraded":"2023-10-16T20:08:27.469599+0000","last_fullsized":"2023-10-16T20:08:27.469599+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441151+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441151+0000","last_peered":"2023-10-16T20:08:40.441151+0000","last_clean":"2023-10-16T20:08:40.441151+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441151+0000","last_undegraded":"2023-10-16T20:08:40.441151+0000","last_fullsized":"2023-10-16T20:08:40.441151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248069+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248069+0000","last_peered":"2023-10-16T20:08:14.248069+0000","last_clean":"2023-10-16T20:08:14.248069+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248069+0000","last_undegraded":"2023-10-16T20:08:14.248069+0000","last_fullsized":"2023-10-16T20:08:14.248069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745452+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745452+0000","last_peered":"2023-10-16T20:08:56.745452+0000","last_clean":"2023-10-16T20:08:56.745452+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745452+0000","last_undegraded":"2023-10-16T20:08:56.745452+0000","last_fullsized":"2023-10-16T20:08:56.745452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362399+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362399+0000","last_peered":"2023-10-16T20:08:15.362399+0000","last_clean":"2023-10-16T20:08:15.362399+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362399+0000","last_undegraded":"2023-10-16T20:08:15.362399+0000","last_fullsized":"2023-10-16T20:08:15.362399+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466503+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466503+0000","last_peered":"2023-10-16T20:08:23.466503+0000","last_clean":"2023-10-16T20:08:23.466503+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466503+0000","last_undegraded":"2023-10-16T20:08:23.466503+0000","last_fullsized":"2023-10-16T20:08:23.466503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.096251+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:13.096251+0000","last_peered":"2023-10-16T20:08:13.096251+0000","last_clean":"2023-10-16T20:08:13.096251+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:13.096251+0000","last_undegraded":"2023-10-16T20:08:13.096251+0000","last_fullsized":"2023-10-16T20:08:13.096251+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217661+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217661+0000","last_peered":"2023-10-16T20:08:57.217661+0000","last_clean":"2023-10-16T20:08:57.217661+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217661+0000","last_undegraded":"2023-10-16T20:08:57.217661+0000","last_fullsized":"2023-10-16T20:08:57.217661+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950617+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950617+0000","last_peered":"2023-10-16T20:08:17.950617+0000","last_clean":"2023-10-16T20:08:17.950617+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950617+0000","last_undegraded":"2023-10-16T20:08:17.950617+0000","last_fullsized":"2023-10-16T20:08:17.950617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548212+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548212+0000","last_peered":"2023-10-16T20:08:26.548212+0000","last_clean":"2023-10-16T20:08:26.548212+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548212+0000","last_undegraded":"2023-10-16T20:08:26.548212+0000","last_fullsized":"2023-10-16T20:08:26.548212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926512+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926512+0000","last_peered":"2023-10-16T20:08:16.926512+0000","last_clean":"2023-10-16T20:08:16.926512+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926512+0000","last_undegraded":"2023-10-16T20:08:16.926512+0000","last_fullsized":"2023-10-16T20:08:16.926512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406316+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406316+0000","last_peered":"2023-10-16T20:08:32.406316+0000","last_clean":"2023-10-16T20:08:32.406316+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406316+0000","last_undegraded":"2023-10-16T20:08:32.406316+0000","last_fullsized":"2023-10-16T20:08:32.406316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713006+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713006+0000","last_peered":"2023-10-16T20:08:14.713006+0000","last_clean":"2023-10-16T20:08:14.713006+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713006+0000","last_undegraded":"2023-10-16T20:08:14.713006+0000","last_fullsized":"2023-10-16T20:08:14.713006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563193+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563193+0000","last_peered":"2023-10-16T20:08:34.563193+0000","last_clean":"2023-10-16T20:08:34.563193+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563193+0000","last_undegraded":"2023-10-16T20:08:34.563193+0000","last_fullsized":"2023-10-16T20:08:34.563193+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-16T20:08:13.742868+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:13.742868+0000","last_peered":"2023-10-16T20:08:13.742868+0000","last_clean":"2023-10-16T20:08:13.742868+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:13.742868+0000","last_undegraded":"2023-10-16T20:08:13.742868+0000","last_fullsized":"2023-10-16T20:08:13.742868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675138+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675138+0000","last_peered":"2023-10-16T20:08:16.675138+0000","last_clean":"2023-10-16T20:08:16.675138+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675138+0000","last_undegraded":"2023-10-16T20:08:16.675138+0000","last_fullsized":"2023-10-16T20:08:16.675138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235501+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235501+0000","last_peered":"2023-10-16T20:08:19.235501+0000","last_clean":"2023-10-16T20:08:19.235501+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235501+0000","last_undegraded":"2023-10-16T20:08:19.235501+0000","last_fullsized":"2023-10-16T20:08:19.235501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333766+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333766+0000","last_peered":"2023-10-16T20:08:32.333766+0000","last_clean":"2023-10-16T20:08:32.333766+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333766+0000","last_undegraded":"2023-10-16T20:08:32.333766+0000","last_fullsized":"2023-10-16T20:08:32.333766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486417+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486417+0000","last_peered":"2023-10-16T20:08:21.486417+0000","last_clean":"2023-10-16T20:08:21.486417+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486417+0000","last_undegraded":"2023-10-16T20:08:21.486417+0000","last_fullsized":"2023-10-16T20:08:21.486417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663909+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663909+0000","last_peered":"2023-10-16T20:08:20.663909+0000","last_clean":"2023-10-16T20:08:20.663909+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663909+0000","last_undegraded":"2023-10-16T20:08:20.663909+0000","last_fullsized":"2023-10-16T20:08:20.663909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713806+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713806+0000","last_peered":"2023-10-16T20:08:17.713806+0000","last_clean":"2023-10-16T20:08:17.713806+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713806+0000","last_undegraded":"2023-10-16T20:08:17.713806+0000","last_fullsized":"2023-10-16T20:08:17.713806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777282+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777282+0000","last_peered":"2023-10-16T20:08:27.777282+0000","last_clean":"2023-10-16T20:08:27.777282+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777282+0000","last_undegraded":"2023-10-16T20:08:27.777282+0000","last_fullsized":"2023-10-16T20:08:27.777282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018874+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018874+0000","last_peered":"2023-10-16T20:08:30.018874+0000","last_clean":"2023-10-16T20:08:30.018874+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018874+0000","last_undegraded":"2023-10-16T20:08:30.018874+0000","last_fullsized":"2023-10-16T20:08:30.018874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948121+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948121+0000","last_peered":"2023-10-16T20:08:31.948121+0000","last_clean":"2023-10-16T20:08:31.948121+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948121+0000","last_undegraded":"2023-10-16T20:08:31.948121+0000","last_fullsized":"2023-10-16T20:08:31.948121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504725+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504725+0000","last_peered":"2023-10-16T20:08:24.504725+0000","last_clean":"2023-10-16T20:08:24.504725+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504725+0000","last_undegraded":"2023-10-16T20:08:24.504725+0000","last_fullsized":"2023-10-16T20:08:24.504725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456890+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456890+0000","last_peered":"2023-10-16T20:08:27.456890+0000","last_clean":"2023-10-16T20:08:27.456890+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456890+0000","last_undegraded":"2023-10-16T20:08:27.456890+0000","last_fullsized":"2023-10-16T20:08:27.456890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498305+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:14.498305+0000","last_peered":"2023-10-16T20:08:14.498305+0000","last_clean":"2023-10-16T20:08:14.498305+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:14.498305+0000","last_undegraded":"2023-10-16T20:08:14.498305+0000","last_fullsized":"2023-10-16T20:08:14.498305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482406+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482406+0000","last_peered":"2023-10-16T20:08:16.482406+0000","last_clean":"2023-10-16T20:08:16.482406+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482406+0000","last_undegraded":"2023-10-16T20:08:16.482406+0000","last_fullsized":"2023-10-16T20:08:16.482406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190567+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190567+0000","last_peered":"2023-10-16T20:08:20.190567+0000","last_clean":"2023-10-16T20:08:20.190567+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190567+0000","last_undegraded":"2023-10-16T20:08:20.190567+0000","last_fullsized":"2023-10-16T20:08:20.190567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208196+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208196+0000","last_peered":"2023-10-16T20:08:58.208196+0000","last_clean":"2023-10-16T20:08:58.208196+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208196+0000","last_undegraded":"2023-10-16T20:08:58.208196+0000","last_fullsized":"2023-10-16T20:08:58.208196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497936+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:14.497936+0000","last_peered":"2023-10-16T20:08:14.497936+0000","last_clean":"2023-10-16T20:08:14.497936+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:14.497936+0000","last_undegraded":"2023-10-16T20:08:14.497936+0000","last_fullsized":"2023-10-16T20:08:14.497936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465827+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465827+0000","last_peered":"2023-10-16T20:08:23.465827+0000","last_clean":"2023-10-16T20:08:23.465827+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465827+0000","last_undegraded":"2023-10-16T20:08:23.465827+0000","last_fullsized":"2023-10-16T20:08:23.465827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498361+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:14.498361+0000","last_peered":"2023-10-16T20:08:14.498361+0000","last_clean":"2023-10-16T20:08:14.498361+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:14.498361+0000","last_undegraded":"2023-10-16T20:08:14.498361+0000","last_fullsized":"2023-10-16T20:08:14.498361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918575+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918575+0000","last_peered":"2023-10-16T20:08:32.918575+0000","last_clean":"2023-10-16T20:08:32.918575+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918575+0000","last_undegraded":"2023-10-16T20:08:32.918575+0000","last_fullsized":"2023-10-16T20:08:32.918575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581879+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581879+0000","last_peered":"2023-10-16T20:08:24.581879+0000","last_clean":"2023-10-16T20:08:24.581879+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581879+0000","last_undegraded":"2023-10-16T20:08:24.581879+0000","last_fullsized":"2023-10-16T20:08:24.581879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690496+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690496+0000","last_peered":"2023-10-16T20:08:46.690496+0000","last_clean":"2023-10-16T20:08:46.690496+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690496+0000","last_undegraded":"2023-10-16T20:08:46.690496+0000","last_fullsized":"2023-10-16T20:08:46.690496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497712+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:14.497712+0000","last_peered":"2023-10-16T20:08:14.497712+0000","last_clean":"2023-10-16T20:08:14.497712+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:14.497712+0000","last_undegraded":"2023-10-16T20:08:14.497712+0000","last_fullsized":"2023-10-16T20:08:14.497712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148089+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148089+0000","last_peered":"2023-10-16T20:08:33.148089+0000","last_clean":"2023-10-16T20:08:33.148089+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148089+0000","last_undegraded":"2023-10-16T20:08:33.148089+0000","last_fullsized":"2023-10-16T20:08:33.148089+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974975+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974975+0000","last_peered":"2023-10-16T20:08:20.974975+0000","last_clean":"2023-10-16T20:08:20.974975+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974975+0000","last_undegraded":"2023-10-16T20:08:20.974975+0000","last_fullsized":"2023-10-16T20:08:20.974975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311276+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311276+0000","last_peered":"2023-10-16T20:08:53.311276+0000","last_clean":"2023-10-16T20:08:53.311276+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311276+0000","last_undegraded":"2023-10-16T20:08:53.311276+0000","last_fullsized":"2023-10-16T20:08:53.311276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497822+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:14.497822+0000","last_peered":"2023-10-16T20:08:14.497822+0000","last_clean":"2023-10-16T20:08:14.497822+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:14.497822+0000","last_undegraded":"2023-10-16T20:08:14.497822+0000","last_fullsized":"2023-10-16T20:08:14.497822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762808+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762808+0000","last_peered":"2023-10-16T20:09:01.762808+0000","last_clean":"2023-10-16T20:09:01.762808+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762808+0000","last_undegraded":"2023-10-16T20:09:01.762808+0000","last_fullsized":"2023-10-16T20:09:01.762808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449316+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449316+0000","last_peered":"2023-10-16T20:08:20.449316+0000","last_clean":"2023-10-16T20:08:20.449316+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449316+0000","last_undegraded":"2023-10-16T20:08:20.449316+0000","last_fullsized":"2023-10-16T20:08:20.449316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526534+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526534+0000","last_peered":"2023-10-16T20:08:31.526534+0000","last_clean":"2023-10-16T20:08:31.526534+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526534+0000","last_undegraded":"2023-10-16T20:08:31.526534+0000","last_fullsized":"2023-10-16T20:08:31.526534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100367+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:14.100367+0000","last_peered":"2023-10-16T20:08:14.100367+0000","last_clean":"2023-10-16T20:08:14.100367+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:14.100367+0000","last_undegraded":"2023-10-16T20:08:14.100367+0000","last_fullsized":"2023-10-16T20:08:14.100367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101643+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101643+0000","last_peered":"2023-10-16T20:08:32.101643+0000","last_clean":"2023-10-16T20:08:32.101643+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101643+0000","last_undegraded":"2023-10-16T20:08:32.101643+0000","last_fullsized":"2023-10-16T20:08:32.101643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100716+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:14.100716+0000","last_peered":"2023-10-16T20:08:14.100716+0000","last_clean":"2023-10-16T20:08:14.100716+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:14.100716+0000","last_undegraded":"2023-10-16T20:08:14.100716+0000","last_fullsized":"2023-10-16T20:08:14.100716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407642+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407642+0000","last_peered":"2023-10-16T20:08:37.407642+0000","last_clean":"2023-10-16T20:08:37.407642+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407642+0000","last_undegraded":"2023-10-16T20:08:37.407642+0000","last_fullsized":"2023-10-16T20:08:37.407642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469249+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469249+0000","last_peered":"2023-10-16T20:08:23.469249+0000","last_clean":"2023-10-16T20:08:23.469249+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469249+0000","last_undegraded":"2023-10-16T20:08:23.469249+0000","last_fullsized":"2023-10-16T20:08:23.469249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129402+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129402+0000","last_peered":"2023-10-16T20:09:06.129402+0000","last_clean":"2023-10-16T20:09:06.129402+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129402+0000","last_undegraded":"2023-10-16T20:09:06.129402+0000","last_fullsized":"2023-10-16T20:09:06.129402+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497630+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:14.497630+0000","last_peered":"2023-10-16T20:08:14.497630+0000","last_clean":"2023-10-16T20:08:14.497630+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:14.497630+0000","last_undegraded":"2023-10-16T20:08:14.497630+0000","last_fullsized":"2023-10-16T20:08:14.497630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.499966+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:14.499966+0000","last_peered":"2023-10-16T20:08:14.499966+0000","last_clean":"2023-10-16T20:08:14.499966+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:14.499966+0000","last_undegraded":"2023-10-16T20:08:14.499966+0000","last_fullsized":"2023-10-16T20:08:14.499966+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437964+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437964+0000","last_peered":"2023-10-16T20:08:29.437964+0000","last_clean":"2023-10-16T20:08:29.437964+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437964+0000","last_undegraded":"2023-10-16T20:08:29.437964+0000","last_fullsized":"2023-10-16T20:08:29.437964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.800563+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:14.800563+0000","last_peered":"2023-10-16T20:08:14.800563+0000","last_clean":"2023-10-16T20:08:14.800563+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:14.800563+0000","last_undegraded":"2023-10-16T20:08:14.800563+0000","last_fullsized":"2023-10-16T20:08:14.800563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.39200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.45200000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69499999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.751}]},{"osd":1,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.53100000000000003,"15min":0.52300000000000002},"min":{"1min":0.42999999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.75,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.627}]},{"osd":2,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.54800000000000004,"15min":0.53300000000000003},"min":{"1min":0.46300000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.751,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73699999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.73599999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68500000000000005,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.75600000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48099999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.60199999999999998},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73399999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61099999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55700000000000005,"15min":0.57099999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71499999999999997,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.443,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77200000000000002,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":1.218,"15min":1.218},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":0.70799999999999996},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.73999999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.755,"5min":1.391,"15min":1.391},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.60099999999999998},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.51900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80200000000000005,"5min":1.516,"15min":1.516},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.79600000000000004,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.622}]},{"osd":4,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56299999999999994,"15min":0.59299999999999997},"min":{"1min":0.33600000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.70299999999999996,"15min":0.76500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73999999999999999,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.39000000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.59999999999999998,"15min":0.625},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68999999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.66400000000000003,"15min":0.70199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71799999999999997,"5min":1.849,"15min":1.849},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.749,"15min":0.81100000000000005},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80600000000000005,"5min":2.585,"15min":2.585},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.115,"15min":1.115},"last":0.505}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.23699999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54200000000000004,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.33300000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54100000000000004,"5min":0.621,"15min":0.621},"last":0.51100000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.34200000000000003},"min":{"1min":0.28999999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.379}]},{"osd":3,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54700000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.38800000000000001},"min":{"1min":0.35399999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64600000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92200000000000004,"5min":1.153,"15min":1.153},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"min":{"1min":0.52000000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89400000000000002,"5min":1.214,"15min":1.214},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.52300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.82099999999999995,"5min":1.135,"15min":1.135},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.53100000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88500000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.628,"15min":0.622},"min":{"1min":0.59299999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1.05,"15min":1.05},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.624,"15min":0.624},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83999999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.53400000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.87,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.748}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.42499999999999999,"15min":0.46200000000000002},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.48999999999999999,"5min":2.798,"15min":2.798},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.33100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":1.087,"15min":1.087},"last":0.437}]},{"osd":2,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46000000000000002,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.309,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59799999999999998,"5min":1.218,"15min":1.218},"last":0.47199999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.439,"15min":0.44},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63700000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.46999999999999997,"15min":0.49399999999999999},"min":{"1min":0.34399999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57899999999999996,"5min":2.754,"15min":2.754},"last":0.57199999999999995}]},{"osd":4,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61599999999999999,"15min":0.627},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86399999999999999,"5min":1.125,"15min":1.125},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.52700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82999999999999996,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76700000000000002,"5min":1.246,"15min":1.246},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.65300000000000002,"15min":0.66500000000000004},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88400000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.52500000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.153,"15min":1.153},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.51700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82899999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.48399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90300000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.748}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33600000000000002,"15min":0.32500000000000001},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.374},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.623},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38,"15min":0.375},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.42099999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40000000000000002},"min":{"1min":0.33600000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.377,"15min":0.371},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.435}]},{"osd":4,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.497,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65500000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60499999999999998,"15min":0.59499999999999997},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.52800000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Oct 16 20:09:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.48499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63600000000000001,"15min":0.61799999999999999},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63500000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36599999999999999,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52900000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38700000000000001,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.63,"15min":0.63},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.31900000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42999999999999999},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.55600000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59399999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60099999999999998,"15min":0.59799999999999998},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.60699999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82499999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.69299999999999995}]},{"osd":5,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.70899999999999996},"min":{"1min":0.54200000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90600000000000003,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.55600000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.81499999999999995,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.44,"15min":0.44},"max":{"1min":0.85299999999999998,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.496,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89000000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.53200000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.626}]}]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85799999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.627},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56899999999999995,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.5,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72599999999999998,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.505},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60799999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.67700000000000005},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":2.899,"15min":2.899},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":1.24,"15min":1.24},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.52300000000000002},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.872,"15min":0.872},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.55500000000000005},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.371,"15min":0.371},"max":{"1min":0.78600000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69399999999999995}]},{"osd":7,"last update":"Mon Oct 16 20:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.42599999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68100000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.47599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.745,"5min":1.046,"15min":1.046},"last":0.622},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.47899999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.81499999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.46200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76600000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.42599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.44900000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":0.87,"15min":0.87},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.51200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.81899999999999995,"5min":1.103,"15min":1.103},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.872,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63900000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53100000000000003,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.63,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69899999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.47499999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.35099999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78900000000000003,"5min":1.546,"15min":1.546},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.66900000000000004,"15min":0.71899999999999997},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72799999999999998,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.51800000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84099999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:14.657 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:14.658 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:10:31.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:31.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:10:34.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.790+0000 7f4c50f49700 1 Processor -- start 2023-10-16T20:10:34.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.790+0000 7f4c50f49700 1 -- start start 2023-10-16T20:10:34.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c50f49700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:34.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c50f49700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c0cfeb0 con 0x7f4c4c0ca7d0 2023-10-16T20:10:34.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c50f49700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c0cfc30 con 0x7f4c4c06a820 2023-10-16T20:10:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c50f49700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0ce410 con 0x7f4c4c0cf7d0 2023-10-16T20:10:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c4ad9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4c4c0ca7d0 0x7f4c4c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41702/0 (socket says 172.21.15.152:41702) 2023-10-16T20:10:34.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c4ad9d700 1 -- 172.21.15.152:0/4127783160 learned_addr learned my addr 172.21.15.152:0/4127783160 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:10:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c49d9b700 1 --2- 172.21.15.152:0/4127783160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980897669 0 0) 0x7f4c4c0cfeb0 con 0x7f4c4c0ca7d0 2023-10-16T20:10:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c340035b0 con 0x7f4c4c0ca7d0 2023-10-16T20:10:34.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 <== mon.1 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279964009 0 0) 0x7f4c4c0cfc30 con 0x7f4c4c06a820 2023-10-16T20:10:34.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c4c0cfeb0 con 0x7f4c4c06a820 2023-10-16T20:10:34.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.791+0000 7f4c49d9b700 1 -- 172.21.15.152:0/4127783160 >> v1:172.21.15.163:6789/0 conn(0x7f4c4c06a820 legacy=0x7f4c4c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:34.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c49d9b700 1 -- 172.21.15.152:0/4127783160 >> v1:172.21.15.152:6789/0 conn(0x7f4c4c0ca7d0 legacy=0x7f4c4c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:34.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c49d9b700 1 -- 172.21.15.152:0/4127783160 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0af9d0 con 0x7f4c4c0cf7d0 2023-10-16T20:10:34.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c49d9b700 1 --2- 172.21.15.152:0/4127783160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c15e7f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009870 tx=0x7f4c40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bd28839e6bc925 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:34.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011830 con 0x7f4c4c0cf7d0 2023-10-16T20:10:34.799 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40011990 con 0x7f4c4c0cf7d0 2023-10-16T20:10:34.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c4959a700 1 -- 172.21.15.152:0/4127783160 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011d00 con 0x7f4c4c0cf7d0 2023-10-16T20:10:34.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c50f49700 1 -- 172.21.15.152:0/4127783160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 msgr2=0x7f4c4c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:34.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.792+0000 7f4c50f49700 1 --2- 172.21.15.152:0/4127783160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c15e7f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009870 tx=0x7f4c40009b80 comp rx=0 tx=0).stop 2023-10-16T20:10:34.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.793+0000 7f4c50f49700 1 -- 172.21.15.152:0/4127783160 shutdown_connections 2023-10-16T20:10:34.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.793+0000 7f4c50f49700 1 --2- 172.21.15.152:0/4127783160 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c15e7f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:34.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.793+0000 7f4c50f49700 1 -- 172.21.15.152:0/4127783160 >> 172.21.15.152:0/4127783160 conn(0x7f4c4c0d0180 msgr2=0x7f4c4c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:34.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.793+0000 7f4c50f49700 1 -- 172.21.15.152:0/4127783160 shutdown_connections 2023-10-16T20:10:34.802 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.793+0000 7f4c50f49700 1 -- 172.21.15.152:0/4127783160 wait complete. 2023-10-16T20:10:34.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.794+0000 7f4c50f49700 1 Processor -- start 2023-10-16T20:10:34.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.794+0000 7f4c50f49700 1 -- start start 2023-10-16T20:10:34.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 0x7f4c4c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:34.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c4c0ca7d0 0x7f4c4c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:34.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c1f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:34.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0acf20 con 0x7f4c4c06a820 2023-10-16T20:10:34.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c1f7360 con 0x7f4c4c0ca7d0 2023-10-16T20:10:34.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0c6670 con 0x7f4c4c0cf7d0 2023-10-16T20:10:34.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 0x7f4c4c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:34.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 0x7f4c4c157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33274/0 (socket says 172.21.15.152:33274) 2023-10-16T20:10:34.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 -- 172.21.15.152:0/3212138449 learned_addr learned my addr 172.21.15.152:0/3212138449 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:10:34.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c49d9b700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c4c0ca7d0 0x7f4c4c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:34.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4ad9d700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c1f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:34.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 -- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 msgr2=0x7f4c4c1f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:34.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c1f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:34.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 -- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c4c0ca7d0 msgr2=0x7f4c4c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:34.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c4c0ca7d0 0x7f4c4c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:34.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 -- 172.21.15.152:0/3212138449 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400094a0 con 0x7f4c4c06a820 2023-10-16T20:10:34.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4ad9d700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c1f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:10:34.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c4a59c700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 0x7f4c4c157620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c550 tx=0x7f4c3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:34.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0052d0 con 0x7f4c4c06a820 2023-10-16T20:10:34.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c005430 con 0x7f4c4c06a820 2023-10-16T20:10:34.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0038c0 con 0x7f4c4c06a820 2023-10-16T20:10:34.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.795+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c0c5dd0 con 0x7f4c4c06a820 2023-10-16T20:10:34.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.796+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c0c6390 con 0x7f4c4c06a820 2023-10-16T20:10:34.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.796+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c0af3e0 con 0x7f4c4c06a820 2023-10-16T20:10:34.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.797+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c3c003a20 con 0x7f4c4c06a820 2023-10-16T20:10:34.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.797+0000 7f4c3affd700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4c2c06af00 0x7f4c2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:34.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.797+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f4c3c088d30 con 0x7f4c4c06a820 2023-10-16T20:10:34.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.797+0000 7f4c49d9b700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4c2c06af00 0x7f4c2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:34.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.798+0000 7f4c49d9b700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4c2c06af00 0x7f4c2c06d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4c400090b0 tx=0x7f4c4001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:34.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.802+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c3c053b50 con 0x7f4c4c06a820 2023-10-16T20:10:34.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.989+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c4c0af6f0 con 0x7f4c2c06af00 2023-10-16T20:10:34.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:34.997+0000 7f4c3affd700 1 -- 172.21.15.152:0/3212138449 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290393 (secure 0 0 0) 0x7f4c40011630 con 0x7f4c2c06af00 2023-10-16T20:10:35.003 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:10:35.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4c2c06af00 msgr2=0x7f4c2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:35.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4c2c06af00 0x7f4c2c06d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4c400090b0 tx=0x7f4c4001c040 comp rx=0 tx=0).stop 2023-10-16T20:10:35.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 msgr2=0x7f4c4c157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:35.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 0x7f4c4c157620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c550 tx=0x7f4c3c00c860 comp rx=0 tx=0).stop 2023-10-16T20:10:35.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 shutdown_connections 2023-10-16T20:10:35.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f4c2c06af00 0x7f4c2c06d3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:35.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f4c4c0cf7d0 0x7f4c4c1f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:35.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c4c06a820 0x7f4c4c157620 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:35.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.000+0000 7f4c50f49700 1 --2- 172.21.15.152:0/3212138449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c4c0ca7d0 0x7f4c4c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:35.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.001+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 >> 172.21.15.152:0/3212138449 conn(0x7f4c4c0d0180 msgr2=0x7f4c4c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:35.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.001+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 shutdown_connections 2023-10-16T20:10:35.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:35.001+0000 7f4c50f49700 1 -- 172.21.15.152:0/3212138449 wait complete. 2023-10-16T20:10:35.009 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:10:35.014 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2023-10-16T20:10:34.826983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003101"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681912+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681912+0000","last_peered":"2023-10-16T20:08:25.681912+0000","last_clean":"2023-10-16T20:08:25.681912+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681912+0000","last_undegraded":"2023-10-16T20:08:25.681912+0000","last_fullsized":"2023-10-16T20:08:25.681912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716377+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716377+0000","last_peered":"2023-10-16T20:08:48.716377+0000","last_clean":"2023-10-16T20:08:48.716377+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716377+0000","last_undegraded":"2023-10-16T20:08:48.716377+0000","last_fullsized":"2023-10-16T20:08:48.716377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568776+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568776+0000","last_peered":"2023-10-16T20:08:27.568776+0000","last_clean":"2023-10-16T20:08:27.568776+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568776+0000","last_undegraded":"2023-10-16T20:08:27.568776+0000","last_fullsized":"2023-10-16T20:08:27.568776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499320+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499320+0000","last_peered":"2023-10-16T20:08:20.499320+0000","last_clean":"2023-10-16T20:08:20.499320+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499320+0000","last_undegraded":"2023-10-16T20:08:20.499320+0000","last_fullsized":"2023-10-16T20:08:20.499320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509653+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509653+0000","last_peered":"2023-10-16T20:08:15.509653+0000","last_clean":"2023-10-16T20:08:15.509653+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509653+0000","last_undegraded":"2023-10-16T20:08:15.509653+0000","last_fullsized":"2023-10-16T20:08:15.509653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157301+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157301+0000","last_peered":"2023-10-16T20:08:25.157301+0000","last_clean":"2023-10-16T20:08:25.157301+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157301+0000","last_undegraded":"2023-10-16T20:08:25.157301+0000","last_fullsized":"2023-10-16T20:08:25.157301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.867048+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.867048+0000","last_peered":"2023-10-16T20:08:59.867048+0000","last_clean":"2023-10-16T20:08:59.867048+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.867048+0000","last_undegraded":"2023-10-16T20:08:59.867048+0000","last_fullsized":"2023-10-16T20:08:59.867048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596703+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596703+0000","last_peered":"2023-10-16T20:08:42.596703+0000","last_clean":"2023-10-16T20:08:42.596703+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596703+0000","last_undegraded":"2023-10-16T20:08:42.596703+0000","last_fullsized":"2023-10-16T20:08:42.596703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606086+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606086+0000","last_peered":"2023-10-16T20:08:35.606086+0000","last_clean":"2023-10-16T20:08:35.606086+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606086+0000","last_undegraded":"2023-10-16T20:08:35.606086+0000","last_fullsized":"2023-10-16T20:08:35.606086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885888+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885888+0000","last_peered":"2023-10-16T20:08:48.885888+0000","last_clean":"2023-10-16T20:08:48.885888+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885888+0000","last_undegraded":"2023-10-16T20:08:48.885888+0000","last_fullsized":"2023-10-16T20:08:48.885888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958979+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958979+0000","last_peered":"2023-10-16T20:08:34.958979+0000","last_clean":"2023-10-16T20:08:34.958979+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958979+0000","last_undegraded":"2023-10-16T20:08:34.958979+0000","last_fullsized":"2023-10-16T20:08:34.958979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500960+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500960+0000","last_peered":"2023-10-16T20:08:24.500960+0000","last_clean":"2023-10-16T20:08:24.500960+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500960+0000","last_undegraded":"2023-10-16T20:08:24.500960+0000","last_fullsized":"2023-10-16T20:08:24.500960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938175+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938175+0000","last_peered":"2023-10-16T20:08:50.938175+0000","last_clean":"2023-10-16T20:08:50.938175+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938175+0000","last_undegraded":"2023-10-16T20:08:50.938175+0000","last_fullsized":"2023-10-16T20:08:50.938175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399659+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399659+0000","last_peered":"2023-10-16T20:08:34.399659+0000","last_clean":"2023-10-16T20:08:34.399659+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399659+0000","last_undegraded":"2023-10-16T20:08:34.399659+0000","last_fullsized":"2023-10-16T20:08:34.399659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866907+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866907+0000","last_peered":"2023-10-16T20:09:00.866907+0000","last_clean":"2023-10-16T20:09:00.866907+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866907+0000","last_undegraded":"2023-10-16T20:09:00.866907+0000","last_fullsized":"2023-10-16T20:09:00.866907+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412539+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412539+0000","last_peered":"2023-10-16T20:08:48.412539+0000","last_clean":"2023-10-16T20:08:48.412539+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412539+0000","last_undegraded":"2023-10-16T20:08:48.412539+0000","last_fullsized":"2023-10-16T20:08:48.412539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228338+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228338+0000","last_peered":"2023-10-16T20:09:01.228338+0000","last_clean":"2023-10-16T20:09:01.228338+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228338+0000","last_undegraded":"2023-10-16T20:09:01.228338+0000","last_fullsized":"2023-10-16T20:09:01.228338+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475212+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475212+0000","last_peered":"2023-10-16T20:08:29.475212+0000","last_clean":"2023-10-16T20:08:29.475212+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475212+0000","last_undegraded":"2023-10-16T20:08:29.475212+0000","last_fullsized":"2023-10-16T20:08:29.475212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504181+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504181+0000","last_peered":"2023-10-16T20:08:21.504181+0000","last_clean":"2023-10-16T20:08:21.504181+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504181+0000","last_undegraded":"2023-10-16T20:08:21.504181+0000","last_fullsized":"2023-10-16T20:08:21.504181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354283+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354283+0000","last_peered":"2023-10-16T20:08:37.354283+0000","last_clean":"2023-10-16T20:08:37.354283+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354283+0000","last_undegraded":"2023-10-16T20:08:37.354283+0000","last_fullsized":"2023-10-16T20:08:37.354283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895446+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895446+0000","last_peered":"2023-10-16T20:08:38.895446+0000","last_clean":"2023-10-16T20:08:38.895446+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895446+0000","last_undegraded":"2023-10-16T20:08:38.895446+0000","last_fullsized":"2023-10-16T20:08:38.895446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399735+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399735+0000","last_peered":"2023-10-16T20:08:42.399735+0000","last_clean":"2023-10-16T20:08:42.399735+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399735+0000","last_undegraded":"2023-10-16T20:08:42.399735+0000","last_fullsized":"2023-10-16T20:08:42.399735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184786+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184786+0000","last_peered":"2023-10-16T20:08:59.184786+0000","last_clean":"2023-10-16T20:08:59.184786+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184786+0000","last_undegraded":"2023-10-16T20:08:59.184786+0000","last_fullsized":"2023-10-16T20:08:59.184786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544254+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544254+0000","last_peered":"2023-10-16T20:08:14.544254+0000","last_clean":"2023-10-16T20:08:14.544254+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544254+0000","last_undegraded":"2023-10-16T20:08:14.544254+0000","last_fullsized":"2023-10-16T20:08:14.544254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494697+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494697+0000","last_peered":"2023-10-16T20:08:30.494697+0000","last_clean":"2023-10-16T20:08:30.494697+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494697+0000","last_undegraded":"2023-10-16T20:08:30.494697+0000","last_fullsized":"2023-10-16T20:08:30.494697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161664+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161664+0000","last_peered":"2023-10-16T20:08:23.161664+0000","last_clean":"2023-10-16T20:08:23.161664+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161664+0000","last_undegraded":"2023-10-16T20:08:23.161664+0000","last_fullsized":"2023-10-16T20:08:23.161664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392497+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392497+0000","last_peered":"2023-10-16T20:08:36.392497+0000","last_clean":"2023-10-16T20:08:36.392497+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392497+0000","last_undegraded":"2023-10-16T20:08:36.392497+0000","last_fullsized":"2023-10-16T20:08:36.392497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889971+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889971+0000","last_peered":"2023-10-16T20:08:49.889971+0000","last_clean":"2023-10-16T20:08:49.889971+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889971+0000","last_undegraded":"2023-10-16T20:08:49.889971+0000","last_fullsized":"2023-10-16T20:08:49.889971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409846+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409846+0000","last_peered":"2023-10-16T20:08:27.409846+0000","last_clean":"2023-10-16T20:08:27.409846+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409846+0000","last_undegraded":"2023-10-16T20:08:27.409846+0000","last_fullsized":"2023-10-16T20:08:27.409846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423138+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423138+0000","last_peered":"2023-10-16T20:08:24.423138+0000","last_clean":"2023-10-16T20:08:24.423138+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423138+0000","last_undegraded":"2023-10-16T20:08:24.423138+0000","last_fullsized":"2023-10-16T20:08:24.423138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188950+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188950+0000","last_peered":"2023-10-16T20:09:04.188950+0000","last_clean":"2023-10-16T20:09:04.188950+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188950+0000","last_undegraded":"2023-10-16T20:09:04.188950+0000","last_fullsized":"2023-10-16T20:09:04.188950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158114+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158114+0000","last_peered":"2023-10-16T20:08:29.158114+0000","last_clean":"2023-10-16T20:08:29.158114+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158114+0000","last_undegraded":"2023-10-16T20:08:29.158114+0000","last_fullsized":"2023-10-16T20:08:29.158114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306622+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306622+0000","last_peered":"2023-10-16T20:08:35.306622+0000","last_clean":"2023-10-16T20:08:35.306622+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306622+0000","last_undegraded":"2023-10-16T20:08:35.306622+0000","last_fullsized":"2023-10-16T20:08:35.306622+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439579+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439579+0000","last_peered":"2023-10-16T20:08:23.439579+0000","last_clean":"2023-10-16T20:08:23.439579+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439579+0000","last_undegraded":"2023-10-16T20:08:23.439579+0000","last_fullsized":"2023-10-16T20:08:23.439579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102316+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102316+0000","last_peered":"2023-10-16T20:08:31.102316+0000","last_clean":"2023-10-16T20:08:31.102316+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102316+0000","last_undegraded":"2023-10-16T20:08:31.102316+0000","last_fullsized":"2023-10-16T20:08:31.102316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100492+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:14.100492+0000","last_peered":"2023-10-16T20:08:14.100492+0000","last_clean":"2023-10-16T20:08:14.100492+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:14.100492+0000","last_undegraded":"2023-10-16T20:08:14.100492+0000","last_fullsized":"2023-10-16T20:08:14.100492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386428+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386428+0000","last_peered":"2023-10-16T20:08:38.386428+0000","last_clean":"2023-10-16T20:08:38.386428+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386428+0000","last_undegraded":"2023-10-16T20:08:38.386428+0000","last_fullsized":"2023-10-16T20:08:38.386428+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255111+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255111+0000","last_peered":"2023-10-16T20:08:15.255111+0000","last_clean":"2023-10-16T20:08:15.255111+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255111+0000","last_undegraded":"2023-10-16T20:08:15.255111+0000","last_fullsized":"2023-10-16T20:08:15.255111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798211+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798211+0000","last_peered":"2023-10-16T20:09:02.798211+0000","last_clean":"2023-10-16T20:09:02.798211+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798211+0000","last_undegraded":"2023-10-16T20:09:02.798211+0000","last_fullsized":"2023-10-16T20:09:02.798211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428287+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428287+0000","last_peered":"2023-10-16T20:08:22.428287+0000","last_clean":"2023-10-16T20:08:22.428287+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428287+0000","last_undegraded":"2023-10-16T20:08:22.428287+0000","last_fullsized":"2023-10-16T20:08:22.428287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528351+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528351+0000","last_peered":"2023-10-16T20:08:29.528351+0000","last_clean":"2023-10-16T20:08:29.528351+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528351+0000","last_undegraded":"2023-10-16T20:08:29.528351+0000","last_fullsized":"2023-10-16T20:08:29.528351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920424+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920424+0000","last_peered":"2023-10-16T20:08:15.920424+0000","last_clean":"2023-10-16T20:08:15.920424+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920424+0000","last_undegraded":"2023-10-16T20:08:15.920424+0000","last_fullsized":"2023-10-16T20:08:15.920424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902525+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902525+0000","last_peered":"2023-10-16T20:08:47.902525+0000","last_clean":"2023-10-16T20:08:47.902525+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902525+0000","last_undegraded":"2023-10-16T20:08:47.902525+0000","last_fullsized":"2023-10-16T20:08:47.902525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469649+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469649+0000","last_peered":"2023-10-16T20:08:27.469649+0000","last_clean":"2023-10-16T20:08:27.469649+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469649+0000","last_undegraded":"2023-10-16T20:08:27.469649+0000","last_fullsized":"2023-10-16T20:08:27.469649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441196+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441196+0000","last_peered":"2023-10-16T20:08:40.441196+0000","last_clean":"2023-10-16T20:08:40.441196+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441196+0000","last_undegraded":"2023-10-16T20:08:40.441196+0000","last_fullsized":"2023-10-16T20:08:40.441196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248152+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248152+0000","last_peered":"2023-10-16T20:08:14.248152+0000","last_clean":"2023-10-16T20:08:14.248152+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248152+0000","last_undegraded":"2023-10-16T20:08:14.248152+0000","last_fullsized":"2023-10-16T20:08:14.248152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745521+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745521+0000","last_peered":"2023-10-16T20:08:56.745521+0000","last_clean":"2023-10-16T20:08:56.745521+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745521+0000","last_undegraded":"2023-10-16T20:08:56.745521+0000","last_fullsized":"2023-10-16T20:08:56.745521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362444+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362444+0000","last_peered":"2023-10-16T20:08:15.362444+0000","last_clean":"2023-10-16T20:08:15.362444+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362444+0000","last_undegraded":"2023-10-16T20:08:15.362444+0000","last_fullsized":"2023-10-16T20:08:15.362444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466549+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466549+0000","last_peered":"2023-10-16T20:08:23.466549+0000","last_clean":"2023-10-16T20:08:23.466549+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466549+0000","last_undegraded":"2023-10-16T20:08:23.466549+0000","last_fullsized":"2023-10-16T20:08:23.466549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498264+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:14.498264+0000","last_peered":"2023-10-16T20:08:14.498264+0000","last_clean":"2023-10-16T20:08:14.498264+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:14.498264+0000","last_undegraded":"2023-10-16T20:08:14.498264+0000","last_fullsized":"2023-10-16T20:08:14.498264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217724+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217724+0000","last_peered":"2023-10-16T20:08:57.217724+0000","last_clean":"2023-10-16T20:08:57.217724+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217724+0000","last_undegraded":"2023-10-16T20:08:57.217724+0000","last_fullsized":"2023-10-16T20:08:57.217724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950663+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950663+0000","last_peered":"2023-10-16T20:08:17.950663+0000","last_clean":"2023-10-16T20:08:17.950663+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950663+0000","last_undegraded":"2023-10-16T20:08:17.950663+0000","last_fullsized":"2023-10-16T20:08:17.950663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548260+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548260+0000","last_peered":"2023-10-16T20:08:26.548260+0000","last_clean":"2023-10-16T20:08:26.548260+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548260+0000","last_undegraded":"2023-10-16T20:08:26.548260+0000","last_fullsized":"2023-10-16T20:08:26.548260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926605+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926605+0000","last_peered":"2023-10-16T20:08:16.926605+0000","last_clean":"2023-10-16T20:08:16.926605+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926605+0000","last_undegraded":"2023-10-16T20:08:16.926605+0000","last_fullsized":"2023-10-16T20:08:16.926605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406378+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406378+0000","last_peered":"2023-10-16T20:08:32.406378+0000","last_clean":"2023-10-16T20:08:32.406378+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406378+0000","last_undegraded":"2023-10-16T20:08:32.406378+0000","last_fullsized":"2023-10-16T20:08:32.406378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713058+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713058+0000","last_peered":"2023-10-16T20:08:14.713058+0000","last_clean":"2023-10-16T20:08:14.713058+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713058+0000","last_undegraded":"2023-10-16T20:08:14.713058+0000","last_fullsized":"2023-10-16T20:08:14.713058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563241+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563241+0000","last_peered":"2023-10-16T20:08:34.563241+0000","last_clean":"2023-10-16T20:08:34.563241+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563241+0000","last_undegraded":"2023-10-16T20:08:34.563241+0000","last_fullsized":"2023-10-16T20:08:34.563241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498231+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:14.498231+0000","last_peered":"2023-10-16T20:08:14.498231+0000","last_clean":"2023-10-16T20:08:14.498231+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:14.498231+0000","last_undegraded":"2023-10-16T20:08:14.498231+0000","last_fullsized":"2023-10-16T20:08:14.498231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675201+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675201+0000","last_peered":"2023-10-16T20:08:16.675201+0000","last_clean":"2023-10-16T20:08:16.675201+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675201+0000","last_undegraded":"2023-10-16T20:08:16.675201+0000","last_fullsized":"2023-10-16T20:08:16.675201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235554+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235554+0000","last_peered":"2023-10-16T20:08:19.235554+0000","last_clean":"2023-10-16T20:08:19.235554+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235554+0000","last_undegraded":"2023-10-16T20:08:19.235554+0000","last_fullsized":"2023-10-16T20:08:19.235554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333836+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333836+0000","last_peered":"2023-10-16T20:08:32.333836+0000","last_clean":"2023-10-16T20:08:32.333836+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333836+0000","last_undegraded":"2023-10-16T20:08:32.333836+0000","last_fullsized":"2023-10-16T20:08:32.333836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486471+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486471+0000","last_peered":"2023-10-16T20:08:21.486471+0000","last_clean":"2023-10-16T20:08:21.486471+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486471+0000","last_undegraded":"2023-10-16T20:08:21.486471+0000","last_fullsized":"2023-10-16T20:08:21.486471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663954+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663954+0000","last_peered":"2023-10-16T20:08:20.663954+0000","last_clean":"2023-10-16T20:08:20.663954+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663954+0000","last_undegraded":"2023-10-16T20:08:20.663954+0000","last_fullsized":"2023-10-16T20:08:20.663954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713903+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713903+0000","last_peered":"2023-10-16T20:08:17.713903+0000","last_clean":"2023-10-16T20:08:17.713903+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713903+0000","last_undegraded":"2023-10-16T20:08:17.713903+0000","last_fullsized":"2023-10-16T20:08:17.713903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777282+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777282+0000","last_peered":"2023-10-16T20:08:27.777282+0000","last_clean":"2023-10-16T20:08:27.777282+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777282+0000","last_undegraded":"2023-10-16T20:08:27.777282+0000","last_fullsized":"2023-10-16T20:08:27.777282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018874+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018874+0000","last_peered":"2023-10-16T20:08:30.018874+0000","last_clean":"2023-10-16T20:08:30.018874+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018874+0000","last_undegraded":"2023-10-16T20:08:30.018874+0000","last_fullsized":"2023-10-16T20:08:30.018874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948121+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948121+0000","last_peered":"2023-10-16T20:08:31.948121+0000","last_clean":"2023-10-16T20:08:31.948121+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948121+0000","last_undegraded":"2023-10-16T20:08:31.948121+0000","last_fullsized":"2023-10-16T20:08:31.948121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504725+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504725+0000","last_peered":"2023-10-16T20:08:24.504725+0000","last_clean":"2023-10-16T20:08:24.504725+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504725+0000","last_undegraded":"2023-10-16T20:08:24.504725+0000","last_fullsized":"2023-10-16T20:08:24.504725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456890+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456890+0000","last_peered":"2023-10-16T20:08:27.456890+0000","last_clean":"2023-10-16T20:08:27.456890+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456890+0000","last_undegraded":"2023-10-16T20:08:27.456890+0000","last_fullsized":"2023-10-16T20:08:27.456890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498305+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:14.498305+0000","last_peered":"2023-10-16T20:08:14.498305+0000","last_clean":"2023-10-16T20:08:14.498305+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:14.498305+0000","last_undegraded":"2023-10-16T20:08:14.498305+0000","last_fullsized":"2023-10-16T20:08:14.498305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482406+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482406+0000","last_peered":"2023-10-16T20:08:16.482406+0000","last_clean":"2023-10-16T20:08:16.482406+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482406+0000","last_undegraded":"2023-10-16T20:08:16.482406+0000","last_fullsized":"2023-10-16T20:08:16.482406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190567+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190567+0000","last_peered":"2023-10-16T20:08:20.190567+0000","last_clean":"2023-10-16T20:08:20.190567+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190567+0000","last_undegraded":"2023-10-16T20:08:20.190567+0000","last_fullsized":"2023-10-16T20:08:20.190567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208196+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208196+0000","last_peered":"2023-10-16T20:08:58.208196+0000","last_clean":"2023-10-16T20:08:58.208196+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208196+0000","last_undegraded":"2023-10-16T20:08:58.208196+0000","last_fullsized":"2023-10-16T20:08:58.208196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497936+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:14.497936+0000","last_peered":"2023-10-16T20:08:14.497936+0000","last_clean":"2023-10-16T20:08:14.497936+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:14.497936+0000","last_undegraded":"2023-10-16T20:08:14.497936+0000","last_fullsized":"2023-10-16T20:08:14.497936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465827+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465827+0000","last_peered":"2023-10-16T20:08:23.465827+0000","last_clean":"2023-10-16T20:08:23.465827+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465827+0000","last_undegraded":"2023-10-16T20:08:23.465827+0000","last_fullsized":"2023-10-16T20:08:23.465827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498361+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:14.498361+0000","last_peered":"2023-10-16T20:08:14.498361+0000","last_clean":"2023-10-16T20:08:14.498361+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:14.498361+0000","last_undegraded":"2023-10-16T20:08:14.498361+0000","last_fullsized":"2023-10-16T20:08:14.498361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918575+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918575+0000","last_peered":"2023-10-16T20:08:32.918575+0000","last_clean":"2023-10-16T20:08:32.918575+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918575+0000","last_undegraded":"2023-10-16T20:08:32.918575+0000","last_fullsized":"2023-10-16T20:08:32.918575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581879+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581879+0000","last_peered":"2023-10-16T20:08:24.581879+0000","last_clean":"2023-10-16T20:08:24.581879+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581879+0000","last_undegraded":"2023-10-16T20:08:24.581879+0000","last_fullsized":"2023-10-16T20:08:24.581879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690496+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690496+0000","last_peered":"2023-10-16T20:08:46.690496+0000","last_clean":"2023-10-16T20:08:46.690496+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690496+0000","last_undegraded":"2023-10-16T20:08:46.690496+0000","last_fullsized":"2023-10-16T20:08:46.690496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497712+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:14.497712+0000","last_peered":"2023-10-16T20:08:14.497712+0000","last_clean":"2023-10-16T20:08:14.497712+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:14.497712+0000","last_undegraded":"2023-10-16T20:08:14.497712+0000","last_fullsized":"2023-10-16T20:08:14.497712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148089+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148089+0000","last_peered":"2023-10-16T20:08:33.148089+0000","last_clean":"2023-10-16T20:08:33.148089+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148089+0000","last_undegraded":"2023-10-16T20:08:33.148089+0000","last_fullsized":"2023-10-16T20:08:33.148089+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974975+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974975+0000","last_peered":"2023-10-16T20:08:20.974975+0000","last_clean":"2023-10-16T20:08:20.974975+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974975+0000","last_undegraded":"2023-10-16T20:08:20.974975+0000","last_fullsized":"2023-10-16T20:08:20.974975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311276+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311276+0000","last_peered":"2023-10-16T20:08:53.311276+0000","last_clean":"2023-10-16T20:08:53.311276+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311276+0000","last_undegraded":"2023-10-16T20:08:53.311276+0000","last_fullsized":"2023-10-16T20:08:53.311276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497822+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:14.497822+0000","last_peered":"2023-10-16T20:08:14.497822+0000","last_clean":"2023-10-16T20:08:14.497822+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:14.497822+0000","last_undegraded":"2023-10-16T20:08:14.497822+0000","last_fullsized":"2023-10-16T20:08:14.497822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762808+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762808+0000","last_peered":"2023-10-16T20:09:01.762808+0000","last_clean":"2023-10-16T20:09:01.762808+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762808+0000","last_undegraded":"2023-10-16T20:09:01.762808+0000","last_fullsized":"2023-10-16T20:09:01.762808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449316+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449316+0000","last_peered":"2023-10-16T20:08:20.449316+0000","last_clean":"2023-10-16T20:08:20.449316+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449316+0000","last_undegraded":"2023-10-16T20:08:20.449316+0000","last_fullsized":"2023-10-16T20:08:20.449316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526534+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526534+0000","last_peered":"2023-10-16T20:08:31.526534+0000","last_clean":"2023-10-16T20:08:31.526534+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526534+0000","last_undegraded":"2023-10-16T20:08:31.526534+0000","last_fullsized":"2023-10-16T20:08:31.526534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100367+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:14.100367+0000","last_peered":"2023-10-16T20:08:14.100367+0000","last_clean":"2023-10-16T20:08:14.100367+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:14.100367+0000","last_undegraded":"2023-10-16T20:08:14.100367+0000","last_fullsized":"2023-10-16T20:08:14.100367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101643+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101643+0000","last_peered":"2023-10-16T20:08:32.101643+0000","last_clean":"2023-10-16T20:08:32.101643+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101643+0000","last_undegraded":"2023-10-16T20:08:32.101643+0000","last_fullsized":"2023-10-16T20:08:32.101643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100716+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:14.100716+0000","last_peered":"2023-10-16T20:08:14.100716+0000","last_clean":"2023-10-16T20:08:14.100716+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:14.100716+0000","last_undegraded":"2023-10-16T20:08:14.100716+0000","last_fullsized":"2023-10-16T20:08:14.100716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407642+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407642+0000","last_peered":"2023-10-16T20:08:37.407642+0000","last_clean":"2023-10-16T20:08:37.407642+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407642+0000","last_undegraded":"2023-10-16T20:08:37.407642+0000","last_fullsized":"2023-10-16T20:08:37.407642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469249+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469249+0000","last_peered":"2023-10-16T20:08:23.469249+0000","last_clean":"2023-10-16T20:08:23.469249+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469249+0000","last_undegraded":"2023-10-16T20:08:23.469249+0000","last_fullsized":"2023-10-16T20:08:23.469249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129402+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129402+0000","last_peered":"2023-10-16T20:09:06.129402+0000","last_clean":"2023-10-16T20:09:06.129402+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129402+0000","last_undegraded":"2023-10-16T20:09:06.129402+0000","last_fullsized":"2023-10-16T20:09:06.129402+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497630+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:14.497630+0000","last_peered":"2023-10-16T20:08:14.497630+0000","last_clean":"2023-10-16T20:08:14.497630+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:14.497630+0000","last_undegraded":"2023-10-16T20:08:14.497630+0000","last_fullsized":"2023-10-16T20:08:14.497630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.900287+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:17.900287+0000","last_peered":"2023-10-16T20:08:17.900287+0000","last_clean":"2023-10-16T20:08:17.900287+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:17.900287+0000","last_undegraded":"2023-10-16T20:08:17.900287+0000","last_fullsized":"2023-10-16T20:08:17.900287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437964+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437964+0000","last_peered":"2023-10-16T20:08:29.437964+0000","last_clean":"2023-10-16T20:08:29.437964+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437964+0000","last_undegraded":"2023-10-16T20:08:29.437964+0000","last_fullsized":"2023-10-16T20:08:29.437964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":197,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.967215+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:23.967215+0000","last_peered":"2023-10-16T20:08:23.967215+0000","last_clean":"2023-10-16T20:08:23.967215+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:23.967215+0000","last_undegraded":"2023-10-16T20:08:23.967215+0000","last_fullsized":"2023-10-16T20:08:23.967215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.47499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.48799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73399999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.53200000000000003},"min":{"1min":0.52800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.754},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67000000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.82699999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.876}]},{"osd":6,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.81399999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.46600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.497,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":1.218,"15min":1.218},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64000000000000001,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.73499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.502,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.745,"5min":1.391,"15min":1.391},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59999999999999998},"min":{"1min":0.48099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77300000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.505}]},{"osd":3,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":1.516,"15min":1.516},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.67200000000000004},"min":{"1min":0.53500000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.80300000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53700000000000003,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.372},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.65100000000000002,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57899999999999996,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76500000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.439},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.69099999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.849,"15min":1.849},"last":0.46000000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.70199999999999996,"15min":0.79500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82599999999999996,"5min":2.585,"15min":2.585},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.115,"15min":1.115},"last":0.63800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542199,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35199999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.621},"last":0.37}]},{"osd":2,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.34499999999999997},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59599999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44600000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39100000000000001},"min":{"1min":0.29299999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.433},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.39300000000000002},"min":{"1min":0.31900000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46899999999999997}]},{"osd":4,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78200000000000003,"5min":1.153,"15min":1.153},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63,"15min":0.63},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97199999999999998,"5min":1.214,"15min":1.214},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":1.135,"15min":1.135},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95199999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80300000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.625},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.876,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68600000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.61199999999999999,"5min":2.798,"15min":2.798},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.223,"15min":0.223},"max":{"1min":0.69999999999999996,"5min":1.087,"15min":1.087},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.59899999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.28899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":1.218,"15min":1.218},"last":0.45700000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57199999999999995,"5min":2.754,"15min":2.754},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":1.125},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.621},"min":{"1min":0.52500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.246,"15min":1.246},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.54200000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97599999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64400000000000002,"15min":0.63},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":1.153,"15min":1.153},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.58199999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.56299999999999994,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85699999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.55200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.32900000000000001},"min":{"1min":0.26000000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.373},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.318,"5min":0.246,"15min":0.246},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.501}]},{"osd":1,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.623,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.53800000000000003,"5min":0.63,"15min":0.63},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.40600000000000003},"min":{"1min":0.40000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.375},"min":{"1min":0.34399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.442}]},{"osd":4,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.504,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83999999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.879,"15min":0.879},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.53100000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63300000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82899999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.83799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80600000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65000000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.373},"min":{"1min":0.24099999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.59599999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.55200000000000005,"5min":0.63,"15min":0.63},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.373}]},{"osd":2,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66200000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.53300000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.497},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47899999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.54500000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82899999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64200000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66400000000000003,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.81399999999999995,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.80100000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.624}]},{"osd":7,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65000000000000002,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84499999999999997,"5min":0.876,"15min":0.876},"last":0.61199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.48299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.433},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.746,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":2.899,"15min":2.899},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53500000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":1.24},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78200000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61099999999999999,"5min":0.872,"15min":0.872},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.378},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.38900000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":1.046,"15min":1.046},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.432,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.56999999999999995},"min":{"1min":0.51000000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.495,"5min":0.376,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.46700000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":1.103,"15min":1.103},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72099999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.54800000000000004,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73799999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40500000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58399999999999996,"15min":0.64600000000000002},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":1.546,"15min":1.546},"last":0.436},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.625,"15min":0.70499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68300000000000005,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.45400000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.61899999999999999},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:35.022 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:35.023 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:10:55.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:10:55.159 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.157+0000 7f76ebd60700 1 Processor -- start 2023-10-16T20:10:55.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.157+0000 7f76ebd60700 1 -- start start 2023-10-16T20:10:55.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.158+0000 7f76ebd60700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 0x7f76e40af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.158+0000 7f76ebd60700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e40caee0 con 0x7f76e40af030 2023-10-16T20:10:55.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.158+0000 7f76ebd60700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e40cfc30 con 0x7f76e415dbf0 2023-10-16T20:10:55.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.158+0000 7f76ebd60700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40cf990 con 0x7f76e415d810 2023-10-16T20:10:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.158+0000 7f76ea2fd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76e40af030 0x7f76e4161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41716/0 (socket says 172.21.15.152:41716) 2023-10-16T20:10:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.158+0000 7f76ea2fd700 1 -- 172.21.15.152:0/1519184022 learned_addr learned my addr 172.21.15.152:0/1519184022 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:10:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e9afc700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 0x7f76e40af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084882514 0 0) 0x7f76e40caee0 con 0x7f76e40af030 2023-10-16T20:10:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d00035b0 con 0x7f76e40af030 2023-10-16T20:10:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274911283 0 0) 0x7f76d00035b0 con 0x7f76e40af030 2023-10-16T20:10:55.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 msgr2=0x7f76e40af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:55.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 0x7f76e40af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 >> v1:172.21.15.163:6789/0 conn(0x7f76e415dbf0 legacy=0x7f76e40ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40cff10 con 0x7f76e40af030 2023-10-16T20:10:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4086537055 0 0) 0x7f76dc0019f0 con 0x7f76e40af030 2023-10-16T20:10:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 >> v1:172.21.15.152:6789/0 conn(0x7f76e40af030 legacy=0x7f76e4161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76d0003a30 0x7f76d0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76d0004850 0x7f76d0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 0x7f76d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40cf990 con 0x7f76d0004850 2023-10-16T20:10:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d000bac0 con 0x7f76d0003a30 2023-10-16T20:10:55.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d000bc80 con 0x7f76e415d810 2023-10-16T20:10:55.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e92fb700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76d0004850 0x7f76d0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e9afc700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76d0003a30 0x7f76d0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76ea2fd700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 0x7f76d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e92fb700 1 -- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 msgr2=0x7f76d0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e92fb700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76e415d810 0x7f76d0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e92fb700 1 -- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76d0003a30 msgr2=0x7f76d0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:10:55.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e92fb700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76d0003a30 0x7f76d0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.159+0000 7f76e92fb700 1 -- 172.21.15.152:0/1519184022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00035b0 con 0x7f76d0004850 2023-10-16T20:10:55.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76e92fb700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76d0004850 0x7f76d0004cd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f76e0007fd0 tx=0x7f76d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6e80fba3f456ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:55.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00012f0 con 0x7f76d0004850 2023-10-16T20:10:55.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0005220 con 0x7f76d0004850 2023-10-16T20:10:55.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76e8afa700 1 -- 172.21.15.152:0/1519184022 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0006860 con 0x7f76d0004850 2023-10-16T20:10:55.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ebd60700 1 -- 172.21.15.152:0/1519184022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76d0004850 msgr2=0x7f76d0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ebd60700 1 --2- 172.21.15.152:0/1519184022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76d0004850 0x7f76d0004cd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f76e0007fd0 tx=0x7f76d0005880 comp rx=0 tx=0).stop 2023-10-16T20:10:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ea2fd700 1 -- 172.21.15.152:0/1519184022 reap_dead start 2023-10-16T20:10:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ebd60700 1 -- 172.21.15.152:0/1519184022 shutdown_connections 2023-10-16T20:10:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ebd60700 1 -- 172.21.15.152:0/1519184022 >> 172.21.15.152:0/1519184022 conn(0x7f76e40d0180 msgr2=0x7f76e40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:55.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ebd60700 1 -- 172.21.15.152:0/1519184022 shutdown_connections 2023-10-16T20:10:55.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.160+0000 7f76ebd60700 1 -- 172.21.15.152:0/1519184022 wait complete. 2023-10-16T20:10:55.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.161+0000 7f76ebd60700 1 Processor -- start 2023-10-16T20:10:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 -- start start 2023-10-16T20:10:55.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76d0004850 0x7f76e40c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76e40c6820 0x7f76e406e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 0x7f76e406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e414b810 con 0x7f76e414b180 2023-10-16T20:10:55.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41608f0 con 0x7f76e40c6820 2023-10-16T20:10:55.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ebd60700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4160bd0 con 0x7f76d0004850 2023-10-16T20:10:55.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ea2fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 0x7f76e406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ea2fd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 0x7f76e406e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33298/0 (socket says 172.21.15.152:33298) 2023-10-16T20:10:55.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.162+0000 7f76ea2fd700 1 -- 172.21.15.152:0/3996044502 learned_addr learned my addr 172.21.15.152:0/3996044502 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:10:55.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76e9afc700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76d0004850 0x7f76e40c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76e92fb700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76e40c6820 0x7f76e406e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ea2fd700 1 -- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76d0004850 msgr2=0x7f76e40c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ea2fd700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76d0004850 0x7f76e40c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ea2fd700 1 -- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76e40c6820 msgr2=0x7f76e406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ea2fd700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76e40c6820 0x7f76e406e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ea2fd700 1 -- 172.21.15.152:0/3996044502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4160eb0 con 0x7f76e414b180 2023-10-16T20:10:55.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ea2fd700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 0x7f76e406e8e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f76e40c3a50 tx=0x7f76dc00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:55.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00add0 con 0x7f76e414b180 2023-10-16T20:10:55.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc0133f0 con 0x7f76e414b180 2023-10-16T20:10:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e4161190 con 0x7f76e414b180 2023-10-16T20:10:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0137a0 con 0x7f76e414b180 2023-10-16T20:10:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.163+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e414d800 con 0x7f76e414b180 2023-10-16T20:10:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.164+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e414b950 con 0x7f76e414b180 2023-10-16T20:10:55.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.164+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f76dc013900 con 0x7f76e414b180 2023-10-16T20:10:55.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.165+0000 7f76da7fc700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76c806af00 0x7f76c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:10:55.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.165+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f76dc08a100 con 0x7f76e414b180 2023-10-16T20:10:55.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.165+0000 7f76e9afc700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76c806af00 0x7f76c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:10:55.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.165+0000 7f76e9afc700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76c806af00 0x7f76c806d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009b20 tx=0x7f76d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:10:55.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.169+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76e414b950 con 0x7f76e414b180 2023-10-16T20:10:55.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.355+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76e415cc10 con 0x7f76c806af00 2023-10-16T20:10:55.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.362+0000 7f76da7fc700 1 -- 172.21.15.152:0/3996044502 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290464 (secure 0 0 0) 0x7f76d4009790 con 0x7f76c806af00 2023-10-16T20:10:55.368 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:10:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76c806af00 msgr2=0x7f76c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76c806af00 0x7f76c806d3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009b20 tx=0x7f76d4008040 comp rx=0 tx=0).stop 2023-10-16T20:10:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 msgr2=0x7f76e406e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:10:55.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 0x7f76e406e8e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f76e40c3a50 tx=0x7f76dc00a6a0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 shutdown_connections 2023-10-16T20:10:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f76c806af00 0x7f76c806d3c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f76d0004850 0x7f76e40c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e414b180 0x7f76e406e8e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 --2- 172.21.15.152:0/3996044502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76e40c6820 0x7f76e406e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:10:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 >> 172.21.15.152:0/3996044502 conn(0x7f76e40d0180 msgr2=0x7f76e40adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:10:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 shutdown_connections 2023-10-16T20:10:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:10:55.366+0000 7f76ebd60700 1 -- 172.21.15.152:0/3996044502 wait complete. 2023-10-16T20:10:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:10:55.379 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2023-10-16T20:10:54.832188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003188"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681912+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681912+0000","last_peered":"2023-10-16T20:08:25.681912+0000","last_clean":"2023-10-16T20:08:25.681912+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681912+0000","last_undegraded":"2023-10-16T20:08:25.681912+0000","last_fullsized":"2023-10-16T20:08:25.681912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716377+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716377+0000","last_peered":"2023-10-16T20:08:48.716377+0000","last_clean":"2023-10-16T20:08:48.716377+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716377+0000","last_undegraded":"2023-10-16T20:08:48.716377+0000","last_fullsized":"2023-10-16T20:08:48.716377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568776+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568776+0000","last_peered":"2023-10-16T20:08:27.568776+0000","last_clean":"2023-10-16T20:08:27.568776+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568776+0000","last_undegraded":"2023-10-16T20:08:27.568776+0000","last_fullsized":"2023-10-16T20:08:27.568776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499320+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499320+0000","last_peered":"2023-10-16T20:08:20.499320+0000","last_clean":"2023-10-16T20:08:20.499320+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499320+0000","last_undegraded":"2023-10-16T20:08:20.499320+0000","last_fullsized":"2023-10-16T20:08:20.499320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509653+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509653+0000","last_peered":"2023-10-16T20:08:15.509653+0000","last_clean":"2023-10-16T20:08:15.509653+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509653+0000","last_undegraded":"2023-10-16T20:08:15.509653+0000","last_fullsized":"2023-10-16T20:08:15.509653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157301+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157301+0000","last_peered":"2023-10-16T20:08:25.157301+0000","last_clean":"2023-10-16T20:08:25.157301+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157301+0000","last_undegraded":"2023-10-16T20:08:25.157301+0000","last_fullsized":"2023-10-16T20:08:25.157301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.867048+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.867048+0000","last_peered":"2023-10-16T20:08:59.867048+0000","last_clean":"2023-10-16T20:08:59.867048+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.867048+0000","last_undegraded":"2023-10-16T20:08:59.867048+0000","last_fullsized":"2023-10-16T20:08:59.867048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596703+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596703+0000","last_peered":"2023-10-16T20:08:42.596703+0000","last_clean":"2023-10-16T20:08:42.596703+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596703+0000","last_undegraded":"2023-10-16T20:08:42.596703+0000","last_fullsized":"2023-10-16T20:08:42.596703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606086+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606086+0000","last_peered":"2023-10-16T20:08:35.606086+0000","last_clean":"2023-10-16T20:08:35.606086+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606086+0000","last_undegraded":"2023-10-16T20:08:35.606086+0000","last_fullsized":"2023-10-16T20:08:35.606086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885888+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885888+0000","last_peered":"2023-10-16T20:08:48.885888+0000","last_clean":"2023-10-16T20:08:48.885888+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885888+0000","last_undegraded":"2023-10-16T20:08:48.885888+0000","last_fullsized":"2023-10-16T20:08:48.885888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958979+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958979+0000","last_peered":"2023-10-16T20:08:34.958979+0000","last_clean":"2023-10-16T20:08:34.958979+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958979+0000","last_undegraded":"2023-10-16T20:08:34.958979+0000","last_fullsized":"2023-10-16T20:08:34.958979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500960+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500960+0000","last_peered":"2023-10-16T20:08:24.500960+0000","last_clean":"2023-10-16T20:08:24.500960+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500960+0000","last_undegraded":"2023-10-16T20:08:24.500960+0000","last_fullsized":"2023-10-16T20:08:24.500960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938175+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938175+0000","last_peered":"2023-10-16T20:08:50.938175+0000","last_clean":"2023-10-16T20:08:50.938175+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938175+0000","last_undegraded":"2023-10-16T20:08:50.938175+0000","last_fullsized":"2023-10-16T20:08:50.938175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399659+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399659+0000","last_peered":"2023-10-16T20:08:34.399659+0000","last_clean":"2023-10-16T20:08:34.399659+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399659+0000","last_undegraded":"2023-10-16T20:08:34.399659+0000","last_fullsized":"2023-10-16T20:08:34.399659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866907+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866907+0000","last_peered":"2023-10-16T20:09:00.866907+0000","last_clean":"2023-10-16T20:09:00.866907+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866907+0000","last_undegraded":"2023-10-16T20:09:00.866907+0000","last_fullsized":"2023-10-16T20:09:00.866907+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412539+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412539+0000","last_peered":"2023-10-16T20:08:48.412539+0000","last_clean":"2023-10-16T20:08:48.412539+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412539+0000","last_undegraded":"2023-10-16T20:08:48.412539+0000","last_fullsized":"2023-10-16T20:08:48.412539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228338+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228338+0000","last_peered":"2023-10-16T20:09:01.228338+0000","last_clean":"2023-10-16T20:09:01.228338+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228338+0000","last_undegraded":"2023-10-16T20:09:01.228338+0000","last_fullsized":"2023-10-16T20:09:01.228338+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475212+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475212+0000","last_peered":"2023-10-16T20:08:29.475212+0000","last_clean":"2023-10-16T20:08:29.475212+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475212+0000","last_undegraded":"2023-10-16T20:08:29.475212+0000","last_fullsized":"2023-10-16T20:08:29.475212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504181+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504181+0000","last_peered":"2023-10-16T20:08:21.504181+0000","last_clean":"2023-10-16T20:08:21.504181+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504181+0000","last_undegraded":"2023-10-16T20:08:21.504181+0000","last_fullsized":"2023-10-16T20:08:21.504181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354283+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354283+0000","last_peered":"2023-10-16T20:08:37.354283+0000","last_clean":"2023-10-16T20:08:37.354283+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354283+0000","last_undegraded":"2023-10-16T20:08:37.354283+0000","last_fullsized":"2023-10-16T20:08:37.354283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895446+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895446+0000","last_peered":"2023-10-16T20:08:38.895446+0000","last_clean":"2023-10-16T20:08:38.895446+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895446+0000","last_undegraded":"2023-10-16T20:08:38.895446+0000","last_fullsized":"2023-10-16T20:08:38.895446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399735+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399735+0000","last_peered":"2023-10-16T20:08:42.399735+0000","last_clean":"2023-10-16T20:08:42.399735+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399735+0000","last_undegraded":"2023-10-16T20:08:42.399735+0000","last_fullsized":"2023-10-16T20:08:42.399735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184786+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184786+0000","last_peered":"2023-10-16T20:08:59.184786+0000","last_clean":"2023-10-16T20:08:59.184786+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184786+0000","last_undegraded":"2023-10-16T20:08:59.184786+0000","last_fullsized":"2023-10-16T20:08:59.184786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544254+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544254+0000","last_peered":"2023-10-16T20:08:14.544254+0000","last_clean":"2023-10-16T20:08:14.544254+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544254+0000","last_undegraded":"2023-10-16T20:08:14.544254+0000","last_fullsized":"2023-10-16T20:08:14.544254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494697+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494697+0000","last_peered":"2023-10-16T20:08:30.494697+0000","last_clean":"2023-10-16T20:08:30.494697+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494697+0000","last_undegraded":"2023-10-16T20:08:30.494697+0000","last_fullsized":"2023-10-16T20:08:30.494697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161664+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161664+0000","last_peered":"2023-10-16T20:08:23.161664+0000","last_clean":"2023-10-16T20:08:23.161664+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161664+0000","last_undegraded":"2023-10-16T20:08:23.161664+0000","last_fullsized":"2023-10-16T20:08:23.161664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392497+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392497+0000","last_peered":"2023-10-16T20:08:36.392497+0000","last_clean":"2023-10-16T20:08:36.392497+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392497+0000","last_undegraded":"2023-10-16T20:08:36.392497+0000","last_fullsized":"2023-10-16T20:08:36.392497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889971+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889971+0000","last_peered":"2023-10-16T20:08:49.889971+0000","last_clean":"2023-10-16T20:08:49.889971+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889971+0000","last_undegraded":"2023-10-16T20:08:49.889971+0000","last_fullsized":"2023-10-16T20:08:49.889971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409846+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409846+0000","last_peered":"2023-10-16T20:08:27.409846+0000","last_clean":"2023-10-16T20:08:27.409846+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409846+0000","last_undegraded":"2023-10-16T20:08:27.409846+0000","last_fullsized":"2023-10-16T20:08:27.409846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423138+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423138+0000","last_peered":"2023-10-16T20:08:24.423138+0000","last_clean":"2023-10-16T20:08:24.423138+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423138+0000","last_undegraded":"2023-10-16T20:08:24.423138+0000","last_fullsized":"2023-10-16T20:08:24.423138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188950+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188950+0000","last_peered":"2023-10-16T20:09:04.188950+0000","last_clean":"2023-10-16T20:09:04.188950+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188950+0000","last_undegraded":"2023-10-16T20:09:04.188950+0000","last_fullsized":"2023-10-16T20:09:04.188950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158114+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158114+0000","last_peered":"2023-10-16T20:08:29.158114+0000","last_clean":"2023-10-16T20:08:29.158114+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158114+0000","last_undegraded":"2023-10-16T20:08:29.158114+0000","last_fullsized":"2023-10-16T20:08:29.158114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306622+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306622+0000","last_peered":"2023-10-16T20:08:35.306622+0000","last_clean":"2023-10-16T20:08:35.306622+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306622+0000","last_undegraded":"2023-10-16T20:08:35.306622+0000","last_fullsized":"2023-10-16T20:08:35.306622+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439579+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439579+0000","last_peered":"2023-10-16T20:08:23.439579+0000","last_clean":"2023-10-16T20:08:23.439579+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439579+0000","last_undegraded":"2023-10-16T20:08:23.439579+0000","last_fullsized":"2023-10-16T20:08:23.439579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102316+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102316+0000","last_peered":"2023-10-16T20:08:31.102316+0000","last_clean":"2023-10-16T20:08:31.102316+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102316+0000","last_undegraded":"2023-10-16T20:08:31.102316+0000","last_fullsized":"2023-10-16T20:08:31.102316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100492+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:14.100492+0000","last_peered":"2023-10-16T20:08:14.100492+0000","last_clean":"2023-10-16T20:08:14.100492+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:14.100492+0000","last_undegraded":"2023-10-16T20:08:14.100492+0000","last_fullsized":"2023-10-16T20:08:14.100492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386428+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386428+0000","last_peered":"2023-10-16T20:08:38.386428+0000","last_clean":"2023-10-16T20:08:38.386428+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386428+0000","last_undegraded":"2023-10-16T20:08:38.386428+0000","last_fullsized":"2023-10-16T20:08:38.386428+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255111+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255111+0000","last_peered":"2023-10-16T20:08:15.255111+0000","last_clean":"2023-10-16T20:08:15.255111+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255111+0000","last_undegraded":"2023-10-16T20:08:15.255111+0000","last_fullsized":"2023-10-16T20:08:15.255111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798211+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798211+0000","last_peered":"2023-10-16T20:09:02.798211+0000","last_clean":"2023-10-16T20:09:02.798211+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798211+0000","last_undegraded":"2023-10-16T20:09:02.798211+0000","last_fullsized":"2023-10-16T20:09:02.798211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428287+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428287+0000","last_peered":"2023-10-16T20:08:22.428287+0000","last_clean":"2023-10-16T20:08:22.428287+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428287+0000","last_undegraded":"2023-10-16T20:08:22.428287+0000","last_fullsized":"2023-10-16T20:08:22.428287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528351+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528351+0000","last_peered":"2023-10-16T20:08:29.528351+0000","last_clean":"2023-10-16T20:08:29.528351+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528351+0000","last_undegraded":"2023-10-16T20:08:29.528351+0000","last_fullsized":"2023-10-16T20:08:29.528351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920424+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920424+0000","last_peered":"2023-10-16T20:08:15.920424+0000","last_clean":"2023-10-16T20:08:15.920424+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920424+0000","last_undegraded":"2023-10-16T20:08:15.920424+0000","last_fullsized":"2023-10-16T20:08:15.920424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902525+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902525+0000","last_peered":"2023-10-16T20:08:47.902525+0000","last_clean":"2023-10-16T20:08:47.902525+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902525+0000","last_undegraded":"2023-10-16T20:08:47.902525+0000","last_fullsized":"2023-10-16T20:08:47.902525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469649+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469649+0000","last_peered":"2023-10-16T20:08:27.469649+0000","last_clean":"2023-10-16T20:08:27.469649+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469649+0000","last_undegraded":"2023-10-16T20:08:27.469649+0000","last_fullsized":"2023-10-16T20:08:27.469649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441196+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441196+0000","last_peered":"2023-10-16T20:08:40.441196+0000","last_clean":"2023-10-16T20:08:40.441196+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441196+0000","last_undegraded":"2023-10-16T20:08:40.441196+0000","last_fullsized":"2023-10-16T20:08:40.441196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248152+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248152+0000","last_peered":"2023-10-16T20:08:14.248152+0000","last_clean":"2023-10-16T20:08:14.248152+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248152+0000","last_undegraded":"2023-10-16T20:08:14.248152+0000","last_fullsized":"2023-10-16T20:08:14.248152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745521+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745521+0000","last_peered":"2023-10-16T20:08:56.745521+0000","last_clean":"2023-10-16T20:08:56.745521+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745521+0000","last_undegraded":"2023-10-16T20:08:56.745521+0000","last_fullsized":"2023-10-16T20:08:56.745521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362444+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362444+0000","last_peered":"2023-10-16T20:08:15.362444+0000","last_clean":"2023-10-16T20:08:15.362444+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362444+0000","last_undegraded":"2023-10-16T20:08:15.362444+0000","last_fullsized":"2023-10-16T20:08:15.362444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466549+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466549+0000","last_peered":"2023-10-16T20:08:23.466549+0000","last_clean":"2023-10-16T20:08:23.466549+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466549+0000","last_undegraded":"2023-10-16T20:08:23.466549+0000","last_fullsized":"2023-10-16T20:08:23.466549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498264+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:14.498264+0000","last_peered":"2023-10-16T20:08:14.498264+0000","last_clean":"2023-10-16T20:08:14.498264+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:14.498264+0000","last_undegraded":"2023-10-16T20:08:14.498264+0000","last_fullsized":"2023-10-16T20:08:14.498264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217724+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217724+0000","last_peered":"2023-10-16T20:08:57.217724+0000","last_clean":"2023-10-16T20:08:57.217724+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217724+0000","last_undegraded":"2023-10-16T20:08:57.217724+0000","last_fullsized":"2023-10-16T20:08:57.217724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950663+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950663+0000","last_peered":"2023-10-16T20:08:17.950663+0000","last_clean":"2023-10-16T20:08:17.950663+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950663+0000","last_undegraded":"2023-10-16T20:08:17.950663+0000","last_fullsized":"2023-10-16T20:08:17.950663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548260+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548260+0000","last_peered":"2023-10-16T20:08:26.548260+0000","last_clean":"2023-10-16T20:08:26.548260+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548260+0000","last_undegraded":"2023-10-16T20:08:26.548260+0000","last_fullsized":"2023-10-16T20:08:26.548260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926605+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926605+0000","last_peered":"2023-10-16T20:08:16.926605+0000","last_clean":"2023-10-16T20:08:16.926605+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926605+0000","last_undegraded":"2023-10-16T20:08:16.926605+0000","last_fullsized":"2023-10-16T20:08:16.926605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406378+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406378+0000","last_peered":"2023-10-16T20:08:32.406378+0000","last_clean":"2023-10-16T20:08:32.406378+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406378+0000","last_undegraded":"2023-10-16T20:08:32.406378+0000","last_fullsized":"2023-10-16T20:08:32.406378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713058+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713058+0000","last_peered":"2023-10-16T20:08:14.713058+0000","last_clean":"2023-10-16T20:08:14.713058+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713058+0000","last_undegraded":"2023-10-16T20:08:14.713058+0000","last_fullsized":"2023-10-16T20:08:14.713058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563241+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563241+0000","last_peered":"2023-10-16T20:08:34.563241+0000","last_clean":"2023-10-16T20:08:34.563241+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563241+0000","last_undegraded":"2023-10-16T20:08:34.563241+0000","last_fullsized":"2023-10-16T20:08:34.563241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498231+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:14.498231+0000","last_peered":"2023-10-16T20:08:14.498231+0000","last_clean":"2023-10-16T20:08:14.498231+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:14.498231+0000","last_undegraded":"2023-10-16T20:08:14.498231+0000","last_fullsized":"2023-10-16T20:08:14.498231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675201+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675201+0000","last_peered":"2023-10-16T20:08:16.675201+0000","last_clean":"2023-10-16T20:08:16.675201+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675201+0000","last_undegraded":"2023-10-16T20:08:16.675201+0000","last_fullsized":"2023-10-16T20:08:16.675201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235554+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235554+0000","last_peered":"2023-10-16T20:08:19.235554+0000","last_clean":"2023-10-16T20:08:19.235554+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235554+0000","last_undegraded":"2023-10-16T20:08:19.235554+0000","last_fullsized":"2023-10-16T20:08:19.235554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333836+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333836+0000","last_peered":"2023-10-16T20:08:32.333836+0000","last_clean":"2023-10-16T20:08:32.333836+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333836+0000","last_undegraded":"2023-10-16T20:08:32.333836+0000","last_fullsized":"2023-10-16T20:08:32.333836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486471+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486471+0000","last_peered":"2023-10-16T20:08:21.486471+0000","last_clean":"2023-10-16T20:08:21.486471+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486471+0000","last_undegraded":"2023-10-16T20:08:21.486471+0000","last_fullsized":"2023-10-16T20:08:21.486471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663954+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663954+0000","last_peered":"2023-10-16T20:08:20.663954+0000","last_clean":"2023-10-16T20:08:20.663954+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663954+0000","last_undegraded":"2023-10-16T20:08:20.663954+0000","last_fullsized":"2023-10-16T20:08:20.663954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713903+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713903+0000","last_peered":"2023-10-16T20:08:17.713903+0000","last_clean":"2023-10-16T20:08:17.713903+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713903+0000","last_undegraded":"2023-10-16T20:08:17.713903+0000","last_fullsized":"2023-10-16T20:08:17.713903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777282+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777282+0000","last_peered":"2023-10-16T20:08:27.777282+0000","last_clean":"2023-10-16T20:08:27.777282+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777282+0000","last_undegraded":"2023-10-16T20:08:27.777282+0000","last_fullsized":"2023-10-16T20:08:27.777282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018874+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018874+0000","last_peered":"2023-10-16T20:08:30.018874+0000","last_clean":"2023-10-16T20:08:30.018874+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018874+0000","last_undegraded":"2023-10-16T20:08:30.018874+0000","last_fullsized":"2023-10-16T20:08:30.018874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948121+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948121+0000","last_peered":"2023-10-16T20:08:31.948121+0000","last_clean":"2023-10-16T20:08:31.948121+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948121+0000","last_undegraded":"2023-10-16T20:08:31.948121+0000","last_fullsized":"2023-10-16T20:08:31.948121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504725+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504725+0000","last_peered":"2023-10-16T20:08:24.504725+0000","last_clean":"2023-10-16T20:08:24.504725+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504725+0000","last_undegraded":"2023-10-16T20:08:24.504725+0000","last_fullsized":"2023-10-16T20:08:24.504725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456890+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456890+0000","last_peered":"2023-10-16T20:08:27.456890+0000","last_clean":"2023-10-16T20:08:27.456890+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456890+0000","last_undegraded":"2023-10-16T20:08:27.456890+0000","last_fullsized":"2023-10-16T20:08:27.456890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498305+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:14.498305+0000","last_peered":"2023-10-16T20:08:14.498305+0000","last_clean":"2023-10-16T20:08:14.498305+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:14.498305+0000","last_undegraded":"2023-10-16T20:08:14.498305+0000","last_fullsized":"2023-10-16T20:08:14.498305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482406+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482406+0000","last_peered":"2023-10-16T20:08:16.482406+0000","last_clean":"2023-10-16T20:08:16.482406+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482406+0000","last_undegraded":"2023-10-16T20:08:16.482406+0000","last_fullsized":"2023-10-16T20:08:16.482406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190567+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190567+0000","last_peered":"2023-10-16T20:08:20.190567+0000","last_clean":"2023-10-16T20:08:20.190567+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190567+0000","last_undegraded":"2023-10-16T20:08:20.190567+0000","last_fullsized":"2023-10-16T20:08:20.190567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208196+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208196+0000","last_peered":"2023-10-16T20:08:58.208196+0000","last_clean":"2023-10-16T20:08:58.208196+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208196+0000","last_undegraded":"2023-10-16T20:08:58.208196+0000","last_fullsized":"2023-10-16T20:08:58.208196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497936+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:14.497936+0000","last_peered":"2023-10-16T20:08:14.497936+0000","last_clean":"2023-10-16T20:08:14.497936+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:14.497936+0000","last_undegraded":"2023-10-16T20:08:14.497936+0000","last_fullsized":"2023-10-16T20:08:14.497936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465827+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465827+0000","last_peered":"2023-10-16T20:08:23.465827+0000","last_clean":"2023-10-16T20:08:23.465827+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465827+0000","last_undegraded":"2023-10-16T20:08:23.465827+0000","last_fullsized":"2023-10-16T20:08:23.465827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498361+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:14.498361+0000","last_peered":"2023-10-16T20:08:14.498361+0000","last_clean":"2023-10-16T20:08:14.498361+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:14.498361+0000","last_undegraded":"2023-10-16T20:08:14.498361+0000","last_fullsized":"2023-10-16T20:08:14.498361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918575+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918575+0000","last_peered":"2023-10-16T20:08:32.918575+0000","last_clean":"2023-10-16T20:08:32.918575+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918575+0000","last_undegraded":"2023-10-16T20:08:32.918575+0000","last_fullsized":"2023-10-16T20:08:32.918575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581879+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581879+0000","last_peered":"2023-10-16T20:08:24.581879+0000","last_clean":"2023-10-16T20:08:24.581879+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581879+0000","last_undegraded":"2023-10-16T20:08:24.581879+0000","last_fullsized":"2023-10-16T20:08:24.581879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690496+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690496+0000","last_peered":"2023-10-16T20:08:46.690496+0000","last_clean":"2023-10-16T20:08:46.690496+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690496+0000","last_undegraded":"2023-10-16T20:08:46.690496+0000","last_fullsized":"2023-10-16T20:08:46.690496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497712+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:14.497712+0000","last_peered":"2023-10-16T20:08:14.497712+0000","last_clean":"2023-10-16T20:08:14.497712+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:14.497712+0000","last_undegraded":"2023-10-16T20:08:14.497712+0000","last_fullsized":"2023-10-16T20:08:14.497712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148089+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148089+0000","last_peered":"2023-10-16T20:08:33.148089+0000","last_clean":"2023-10-16T20:08:33.148089+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148089+0000","last_undegraded":"2023-10-16T20:08:33.148089+0000","last_fullsized":"2023-10-16T20:08:33.148089+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974975+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974975+0000","last_peered":"2023-10-16T20:08:20.974975+0000","last_clean":"2023-10-16T20:08:20.974975+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974975+0000","last_undegraded":"2023-10-16T20:08:20.974975+0000","last_fullsized":"2023-10-16T20:08:20.974975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311276+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311276+0000","last_peered":"2023-10-16T20:08:53.311276+0000","last_clean":"2023-10-16T20:08:53.311276+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311276+0000","last_undegraded":"2023-10-16T20:08:53.311276+0000","last_fullsized":"2023-10-16T20:08:53.311276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497822+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:14.497822+0000","last_peered":"2023-10-16T20:08:14.497822+0000","last_clean":"2023-10-16T20:08:14.497822+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:14.497822+0000","last_undegraded":"2023-10-16T20:08:14.497822+0000","last_fullsized":"2023-10-16T20:08:14.497822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762808+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762808+0000","last_peered":"2023-10-16T20:09:01.762808+0000","last_clean":"2023-10-16T20:09:01.762808+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762808+0000","last_undegraded":"2023-10-16T20:09:01.762808+0000","last_fullsized":"2023-10-16T20:09:01.762808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449316+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449316+0000","last_peered":"2023-10-16T20:08:20.449316+0000","last_clean":"2023-10-16T20:08:20.449316+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449316+0000","last_undegraded":"2023-10-16T20:08:20.449316+0000","last_fullsized":"2023-10-16T20:08:20.449316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526534+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526534+0000","last_peered":"2023-10-16T20:08:31.526534+0000","last_clean":"2023-10-16T20:08:31.526534+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526534+0000","last_undegraded":"2023-10-16T20:08:31.526534+0000","last_fullsized":"2023-10-16T20:08:31.526534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100367+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:14.100367+0000","last_peered":"2023-10-16T20:08:14.100367+0000","last_clean":"2023-10-16T20:08:14.100367+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:14.100367+0000","last_undegraded":"2023-10-16T20:08:14.100367+0000","last_fullsized":"2023-10-16T20:08:14.100367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101643+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101643+0000","last_peered":"2023-10-16T20:08:32.101643+0000","last_clean":"2023-10-16T20:08:32.101643+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101643+0000","last_undegraded":"2023-10-16T20:08:32.101643+0000","last_fullsized":"2023-10-16T20:08:32.101643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100716+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:14.100716+0000","last_peered":"2023-10-16T20:08:14.100716+0000","last_clean":"2023-10-16T20:08:14.100716+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:14.100716+0000","last_undegraded":"2023-10-16T20:08:14.100716+0000","last_fullsized":"2023-10-16T20:08:14.100716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407642+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407642+0000","last_peered":"2023-10-16T20:08:37.407642+0000","last_clean":"2023-10-16T20:08:37.407642+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407642+0000","last_undegraded":"2023-10-16T20:08:37.407642+0000","last_fullsized":"2023-10-16T20:08:37.407642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469249+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469249+0000","last_peered":"2023-10-16T20:08:23.469249+0000","last_clean":"2023-10-16T20:08:23.469249+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469249+0000","last_undegraded":"2023-10-16T20:08:23.469249+0000","last_fullsized":"2023-10-16T20:08:23.469249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129402+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129402+0000","last_peered":"2023-10-16T20:09:06.129402+0000","last_clean":"2023-10-16T20:09:06.129402+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129402+0000","last_undegraded":"2023-10-16T20:09:06.129402+0000","last_fullsized":"2023-10-16T20:09:06.129402+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497630+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:14.497630+0000","last_peered":"2023-10-16T20:08:14.497630+0000","last_clean":"2023-10-16T20:08:14.497630+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:14.497630+0000","last_undegraded":"2023-10-16T20:08:14.497630+0000","last_fullsized":"2023-10-16T20:08:14.497630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.900287+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:17.900287+0000","last_peered":"2023-10-16T20:08:17.900287+0000","last_clean":"2023-10-16T20:08:17.900287+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:17.900287+0000","last_undegraded":"2023-10-16T20:08:17.900287+0000","last_fullsized":"2023-10-16T20:08:17.900287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437964+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437964+0000","last_peered":"2023-10-16T20:08:29.437964+0000","last_clean":"2023-10-16T20:08:29.437964+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437964+0000","last_undegraded":"2023-10-16T20:08:29.437964+0000","last_fullsized":"2023-10-16T20:08:29.437964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":197,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.967215+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:23.967215+0000","last_peered":"2023-10-16T20:08:23.967215+0000","last_clean":"2023-10-16T20:08:23.967215+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:23.967215+0000","last_undegraded":"2023-10-16T20:08:23.967215+0000","last_fullsized":"2023-10-16T20:08:23.967215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.47499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.48799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71399999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.53200000000000003},"min":{"1min":0.52800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69999999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.77700000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.754},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60499999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65800000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.46600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.496},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.497,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":1.218,"15min":1.218},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64000000000000001,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.73499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.502,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.745,"5min":1.391,"15min":1.391},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59999999999999998},"min":{"1min":0.48099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77300000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":1.516,"15min":1.516},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.67200000000000004},"min":{"1min":0.53500000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.80300000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53700000000000003,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.65100000000000002,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.621}]},{"osd":5,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57899999999999996,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76500000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.69099999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.849,"15min":1.849},"last":0.54500000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.70199999999999996,"15min":0.79500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82599999999999996,"5min":2.585,"15min":2.585},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.115,"15min":1.115},"last":0.63400000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35199999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.621},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.34499999999999997},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59599999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39100000000000001},"min":{"1min":0.29299999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.504},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.39300000000000002},"min":{"1min":0.31900000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47899999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78200000000000003,"5min":1.153,"15min":1.153},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.63,"15min":0.63},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97199999999999998,"5min":1.214,"15min":1.214},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":1.135,"15min":1.135},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95199999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80300000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.876,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66000000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.61199999999999999,"5min":2.798,"15min":2.798},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.223,"15min":0.223},"max":{"1min":0.69999999999999996,"5min":1.087,"15min":1.087},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.59899999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.443},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.28899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":1.218,"15min":1.218},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.373},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57199999999999995,"5min":2.754,"15min":2.754},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":1.125},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.621},"min":{"1min":0.52500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.246,"15min":1.246},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.54200000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97599999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64400000000000002,"15min":0.63},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":1.153,"15min":1.153},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.58199999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.56299999999999994,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85699999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63400000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.32900000000000001},"min":{"1min":0.26000000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.318,"5min":0.246,"15min":0.246},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36699999999999999}]},{"osd":1,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.623,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.53800000000000003,"5min":0.63,"15min":0.63},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.40600000000000003},"min":{"1min":0.40000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.375},"min":{"1min":0.34399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.33900000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.504,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83999999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68500000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.879,"15min":0.879},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.53100000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65900000000000003}]},{"osd":6,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82899999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.83799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80600000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76900000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.373},"min":{"1min":0.24099999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.59599999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.442}]},{"osd":1,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.55200000000000005,"5min":0.63,"15min":0.63},"last":0.504},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66200000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.53300000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.78200000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.54500000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82899999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80300000000000005}]},{"osd":6,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66400000000000003,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.81399999999999995,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.80100000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65000000000000002,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84499999999999997,"5min":0.876,"15min":0.876},"last":0.73499999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.48299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.746,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":2.899,"15min":2.899},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55800000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":1.24},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78200000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61099999999999999,"5min":0.872,"15min":0.872},"last":0.378},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39500000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.41499999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58899999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":1.046,"15min":1.046},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.432,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.623}]},{"osd":1,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.56999999999999995},"min":{"1min":0.51000000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.495,"5min":0.376,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.46700000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":1.103,"15min":1.103},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72099999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.54800000000000004,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73799999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58399999999999996,"15min":0.64600000000000002},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":1.546,"15min":1.546},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.625,"15min":0.70499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68300000000000005,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.45100000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.61899999999999999},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:10:55.387 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:10:55.388 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:11:01.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:01.656 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:15.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:11:15.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.520+0000 7ff9430be700 1 Processor -- start 2023-10-16T20:11:15.523 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.520+0000 7ff9430be700 1 -- start start 2023-10-16T20:11:15.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff9430be700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff9430be700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff93c15e7f0 0x7ff93c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff9430be700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff93c0ca7d0 0x7ff93c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff9430be700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0ce410 con 0x7ff93c15e7f0 2023-10-16T20:11:15.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff9430be700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0cfeb0 con 0x7ff93c0ca7d0 2023-10-16T20:11:15.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff9430be700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c15ec70 con 0x7ff93c06a820 2023-10-16T20:11:15.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff93c15e7f0 0x7ff93c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff93c15e7f0 0x7ff93c06ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33304/0 (socket says 172.21.15.152:33304) 2023-10-16T20:11:15.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 -- 172.21.15.152:0/2732829976 learned_addr learned my addr 172.21.15.152:0/2732829976 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:11:15.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff94165b700 1 --2- 172.21.15.152:0/2732829976 >> v2:172.21.15.163:3300/0 conn(0x7ff93c0ca7d0 0x7ff93c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff940e5a700 1 --2- 172.21.15.152:0/2732829976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 -- 172.21.15.152:0/2732829976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 msgr2=0x7ff93c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:15.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 --2- 172.21.15.152:0/2732829976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 -- 172.21.15.152:0/2732829976 >> v2:172.21.15.163:3300/0 conn(0x7ff93c0ca7d0 msgr2=0x7ff93c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:15.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 --2- 172.21.15.152:0/2732829976 >> v2:172.21.15.163:3300/0 conn(0x7ff93c0ca7d0 0x7ff93c071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff93bfff700 1 -- 172.21.15.152:0/2732829976 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0af9d0 con 0x7ff93c15e7f0 2023-10-16T20:11:15.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.521+0000 7ff94165b700 1 --2- 172.21.15.152:0/2732829976 >> v2:172.21.15.163:3300/0 conn(0x7ff93c0ca7d0 0x7ff93c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:11:15.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff93bfff700 1 --2- 172.21.15.152:0/2732829976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c06ac00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06f450 tx=0x7ff928009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2577d240253a303b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff93b7fe700 1 -- 172.21.15.152:0/2732829976 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800b870 con 0x7ff93c15e7f0 2023-10-16T20:11:15.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff93b7fe700 1 -- 172.21.15.152:0/2732829976 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800b9d0 con 0x7ff93c15e7f0 2023-10-16T20:11:15.531 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff93b7fe700 1 -- 172.21.15.152:0/2732829976 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800bd60 con 0x7ff93c15e7f0 2023-10-16T20:11:15.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 -- 172.21.15.152:0/2732829976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 msgr2=0x7ff93c06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 --2- 172.21.15.152:0/2732829976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c06ac00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff93c06f450 tx=0x7ff928009bd0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 -- 172.21.15.152:0/2732829976 shutdown_connections 2023-10-16T20:11:15.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 --2- 172.21.15.152:0/2732829976 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 --2- 172.21.15.152:0/2732829976 >> v2:172.21.15.163:3300/0 conn(0x7ff93c0ca7d0 0x7ff93c071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 --2- 172.21.15.152:0/2732829976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c06ac00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 -- 172.21.15.152:0/2732829976 >> 172.21.15.152:0/2732829976 conn(0x7ff93c0d0180 msgr2=0x7ff93c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:15.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 -- 172.21.15.152:0/2732829976 shutdown_connections 2023-10-16T20:11:15.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.522+0000 7ff9430be700 1 -- 172.21.15.152:0/2732829976 wait complete. 2023-10-16T20:11:15.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.524+0000 7ff9430be700 1 Processor -- start 2023-10-16T20:11:15.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.524+0000 7ff9430be700 1 -- start start 2023-10-16T20:11:15.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c1f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff93c0ca7d0 0x7ff93c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c1f3400 con 0x7ff93c15e7f0 2023-10-16T20:11:15.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0ca130 con 0x7ff93c0ca7d0 2023-10-16T20:11:15.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0c9e50 con 0x7ff93c06a820 2023-10-16T20:11:15.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c0c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33312/0 (socket says 172.21.15.152:33312) 2023-10-16T20:11:15.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 -- 172.21.15.152:0/3079666127 learned_addr learned my addr 172.21.15.152:0/3079666127 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:11:15.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff940e5a700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c1f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff93bfff700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff93c0ca7d0 0x7ff93c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 -- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 msgr2=0x7ff93c1f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c1f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 -- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff93c0ca7d0 msgr2=0x7ff93c0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff93c0ca7d0 0x7ff93c0c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 -- 172.21.15.152:0/3079666127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928009550 con 0x7ff93c15e7f0 2023-10-16T20:11:15.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff940e5a700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c1f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:11:15.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff93bfff700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff93c0ca7d0 0x7ff93c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:11:15.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff94165b700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c0c9390 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff934009fa0 tx=0x7ff93400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934003a70 con 0x7ff93c15e7f0 2023-10-16T20:11:15.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93400f040 con 0x7ff93c15e7f0 2023-10-16T20:11:15.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c1f2db0 con 0x7ff93c15e7f0 2023-10-16T20:11:15.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934003e30 con 0x7ff93c15e7f0 2023-10-16T20:11:15.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.525+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0b53a0 con 0x7ff93c15e7f0 2023-10-16T20:11:15.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.526+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c0b5590 con 0x7ff93c15e7f0 2023-10-16T20:11:15.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.527+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff934004030 con 0x7ff93c15e7f0 2023-10-16T20:11:15.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.527+0000 7ff9397fa700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff92006af00 0x7ff92006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.527+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7ff934089900 con 0x7ff93c15e7f0 2023-10-16T20:11:15.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.527+0000 7ff940e5a700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff92006af00 0x7ff92006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.528+0000 7ff940e5a700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff92006af00 0x7ff92006d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff930009a00 tx=0x7ff930008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.532+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff93c0b5590 con 0x7ff93c15e7f0 2023-10-16T20:11:15.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.716+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff93c0af410 con 0x7ff92006af00 2023-10-16T20:11:15.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.723+0000 7ff9397fa700 1 -- 172.21.15.152:0/3079666127 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290463 (secure 0 0 0) 0x7ff930009610 con 0x7ff92006af00 2023-10-16T20:11:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:11:15.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.726+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff92006af00 msgr2=0x7ff92006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.726+0000 7ff9430be700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff92006af00 0x7ff92006d3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff930009a00 tx=0x7ff930008040 comp rx=0 tx=0).stop 2023-10-16T20:11:15.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 msgr2=0x7ff93c0c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c0c9390 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff934009fa0 tx=0x7ff93400d460 comp rx=0 tx=0).stop 2023-10-16T20:11:15.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 shutdown_connections 2023-10-16T20:11:15.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7ff92006af00 0x7ff92006d3c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7ff93c06a820 0x7ff93c1f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff93c15e7f0 0x7ff93c0c9390 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 --2- 172.21.15.152:0/3079666127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff93c0ca7d0 0x7ff93c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 >> 172.21.15.152:0/3079666127 conn(0x7ff93c0d0180 msgr2=0x7ff93c0cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:15.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 shutdown_connections 2023-10-16T20:11:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.727+0000 7ff9430be700 1 -- 172.21.15.152:0/3079666127 wait complete. 2023-10-16T20:11:15.736 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:11:15.740 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2023-10-16T20:11:14.837992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003316"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681912+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681912+0000","last_peered":"2023-10-16T20:08:25.681912+0000","last_clean":"2023-10-16T20:08:25.681912+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681912+0000","last_undegraded":"2023-10-16T20:08:25.681912+0000","last_fullsized":"2023-10-16T20:08:25.681912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716377+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716377+0000","last_peered":"2023-10-16T20:08:48.716377+0000","last_clean":"2023-10-16T20:08:48.716377+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716377+0000","last_undegraded":"2023-10-16T20:08:48.716377+0000","last_fullsized":"2023-10-16T20:08:48.716377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568776+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568776+0000","last_peered":"2023-10-16T20:08:27.568776+0000","last_clean":"2023-10-16T20:08:27.568776+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568776+0000","last_undegraded":"2023-10-16T20:08:27.568776+0000","last_fullsized":"2023-10-16T20:08:27.568776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499320+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499320+0000","last_peered":"2023-10-16T20:08:20.499320+0000","last_clean":"2023-10-16T20:08:20.499320+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499320+0000","last_undegraded":"2023-10-16T20:08:20.499320+0000","last_fullsized":"2023-10-16T20:08:20.499320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509653+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509653+0000","last_peered":"2023-10-16T20:08:15.509653+0000","last_clean":"2023-10-16T20:08:15.509653+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509653+0000","last_undegraded":"2023-10-16T20:08:15.509653+0000","last_fullsized":"2023-10-16T20:08:15.509653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157301+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157301+0000","last_peered":"2023-10-16T20:08:25.157301+0000","last_clean":"2023-10-16T20:08:25.157301+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157301+0000","last_undegraded":"2023-10-16T20:08:25.157301+0000","last_fullsized":"2023-10-16T20:08:25.157301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.867048+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.867048+0000","last_peered":"2023-10-16T20:08:59.867048+0000","last_clean":"2023-10-16T20:08:59.867048+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.867048+0000","last_undegraded":"2023-10-16T20:08:59.867048+0000","last_fullsized":"2023-10-16T20:08:59.867048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596703+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596703+0000","last_peered":"2023-10-16T20:08:42.596703+0000","last_clean":"2023-10-16T20:08:42.596703+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596703+0000","last_undegraded":"2023-10-16T20:08:42.596703+0000","last_fullsized":"2023-10-16T20:08:42.596703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606086+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606086+0000","last_peered":"2023-10-16T20:08:35.606086+0000","last_clean":"2023-10-16T20:08:35.606086+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606086+0000","last_undegraded":"2023-10-16T20:08:35.606086+0000","last_fullsized":"2023-10-16T20:08:35.606086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885888+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885888+0000","last_peered":"2023-10-16T20:08:48.885888+0000","last_clean":"2023-10-16T20:08:48.885888+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885888+0000","last_undegraded":"2023-10-16T20:08:48.885888+0000","last_fullsized":"2023-10-16T20:08:48.885888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958979+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958979+0000","last_peered":"2023-10-16T20:08:34.958979+0000","last_clean":"2023-10-16T20:08:34.958979+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958979+0000","last_undegraded":"2023-10-16T20:08:34.958979+0000","last_fullsized":"2023-10-16T20:08:34.958979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500960+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500960+0000","last_peered":"2023-10-16T20:08:24.500960+0000","last_clean":"2023-10-16T20:08:24.500960+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500960+0000","last_undegraded":"2023-10-16T20:08:24.500960+0000","last_fullsized":"2023-10-16T20:08:24.500960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938175+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938175+0000","last_peered":"2023-10-16T20:08:50.938175+0000","last_clean":"2023-10-16T20:08:50.938175+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938175+0000","last_undegraded":"2023-10-16T20:08:50.938175+0000","last_fullsized":"2023-10-16T20:08:50.938175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399659+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399659+0000","last_peered":"2023-10-16T20:08:34.399659+0000","last_clean":"2023-10-16T20:08:34.399659+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399659+0000","last_undegraded":"2023-10-16T20:08:34.399659+0000","last_fullsized":"2023-10-16T20:08:34.399659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866907+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866907+0000","last_peered":"2023-10-16T20:09:00.866907+0000","last_clean":"2023-10-16T20:09:00.866907+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866907+0000","last_undegraded":"2023-10-16T20:09:00.866907+0000","last_fullsized":"2023-10-16T20:09:00.866907+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412539+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412539+0000","last_peered":"2023-10-16T20:08:48.412539+0000","last_clean":"2023-10-16T20:08:48.412539+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412539+0000","last_undegraded":"2023-10-16T20:08:48.412539+0000","last_fullsized":"2023-10-16T20:08:48.412539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228338+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228338+0000","last_peered":"2023-10-16T20:09:01.228338+0000","last_clean":"2023-10-16T20:09:01.228338+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228338+0000","last_undegraded":"2023-10-16T20:09:01.228338+0000","last_fullsized":"2023-10-16T20:09:01.228338+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475212+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475212+0000","last_peered":"2023-10-16T20:08:29.475212+0000","last_clean":"2023-10-16T20:08:29.475212+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475212+0000","last_undegraded":"2023-10-16T20:08:29.475212+0000","last_fullsized":"2023-10-16T20:08:29.475212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504181+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504181+0000","last_peered":"2023-10-16T20:08:21.504181+0000","last_clean":"2023-10-16T20:08:21.504181+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504181+0000","last_undegraded":"2023-10-16T20:08:21.504181+0000","last_fullsized":"2023-10-16T20:08:21.504181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354283+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354283+0000","last_peered":"2023-10-16T20:08:37.354283+0000","last_clean":"2023-10-16T20:08:37.354283+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354283+0000","last_undegraded":"2023-10-16T20:08:37.354283+0000","last_fullsized":"2023-10-16T20:08:37.354283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895446+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895446+0000","last_peered":"2023-10-16T20:08:38.895446+0000","last_clean":"2023-10-16T20:08:38.895446+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895446+0000","last_undegraded":"2023-10-16T20:08:38.895446+0000","last_fullsized":"2023-10-16T20:08:38.895446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399735+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399735+0000","last_peered":"2023-10-16T20:08:42.399735+0000","last_clean":"2023-10-16T20:08:42.399735+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399735+0000","last_undegraded":"2023-10-16T20:08:42.399735+0000","last_fullsized":"2023-10-16T20:08:42.399735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184786+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184786+0000","last_peered":"2023-10-16T20:08:59.184786+0000","last_clean":"2023-10-16T20:08:59.184786+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184786+0000","last_undegraded":"2023-10-16T20:08:59.184786+0000","last_fullsized":"2023-10-16T20:08:59.184786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544254+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544254+0000","last_peered":"2023-10-16T20:08:14.544254+0000","last_clean":"2023-10-16T20:08:14.544254+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544254+0000","last_undegraded":"2023-10-16T20:08:14.544254+0000","last_fullsized":"2023-10-16T20:08:14.544254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494697+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494697+0000","last_peered":"2023-10-16T20:08:30.494697+0000","last_clean":"2023-10-16T20:08:30.494697+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494697+0000","last_undegraded":"2023-10-16T20:08:30.494697+0000","last_fullsized":"2023-10-16T20:08:30.494697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161664+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161664+0000","last_peered":"2023-10-16T20:08:23.161664+0000","last_clean":"2023-10-16T20:08:23.161664+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161664+0000","last_undegraded":"2023-10-16T20:08:23.161664+0000","last_fullsized":"2023-10-16T20:08:23.161664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392497+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392497+0000","last_peered":"2023-10-16T20:08:36.392497+0000","last_clean":"2023-10-16T20:08:36.392497+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392497+0000","last_undegraded":"2023-10-16T20:08:36.392497+0000","last_fullsized":"2023-10-16T20:08:36.392497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889971+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889971+0000","last_peered":"2023-10-16T20:08:49.889971+0000","last_clean":"2023-10-16T20:08:49.889971+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889971+0000","last_undegraded":"2023-10-16T20:08:49.889971+0000","last_fullsized":"2023-10-16T20:08:49.889971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409846+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409846+0000","last_peered":"2023-10-16T20:08:27.409846+0000","last_clean":"2023-10-16T20:08:27.409846+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409846+0000","last_undegraded":"2023-10-16T20:08:27.409846+0000","last_fullsized":"2023-10-16T20:08:27.409846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423138+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423138+0000","last_peered":"2023-10-16T20:08:24.423138+0000","last_clean":"2023-10-16T20:08:24.423138+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423138+0000","last_undegraded":"2023-10-16T20:08:24.423138+0000","last_fullsized":"2023-10-16T20:08:24.423138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188950+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188950+0000","last_peered":"2023-10-16T20:09:04.188950+0000","last_clean":"2023-10-16T20:09:04.188950+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188950+0000","last_undegraded":"2023-10-16T20:09:04.188950+0000","last_fullsized":"2023-10-16T20:09:04.188950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158114+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158114+0000","last_peered":"2023-10-16T20:08:29.158114+0000","last_clean":"2023-10-16T20:08:29.158114+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158114+0000","last_undegraded":"2023-10-16T20:08:29.158114+0000","last_fullsized":"2023-10-16T20:08:29.158114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306622+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306622+0000","last_peered":"2023-10-16T20:08:35.306622+0000","last_clean":"2023-10-16T20:08:35.306622+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306622+0000","last_undegraded":"2023-10-16T20:08:35.306622+0000","last_fullsized":"2023-10-16T20:08:35.306622+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439579+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439579+0000","last_peered":"2023-10-16T20:08:23.439579+0000","last_clean":"2023-10-16T20:08:23.439579+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439579+0000","last_undegraded":"2023-10-16T20:08:23.439579+0000","last_fullsized":"2023-10-16T20:08:23.439579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102316+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102316+0000","last_peered":"2023-10-16T20:08:31.102316+0000","last_clean":"2023-10-16T20:08:31.102316+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102316+0000","last_undegraded":"2023-10-16T20:08:31.102316+0000","last_fullsized":"2023-10-16T20:08:31.102316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100492+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:14.100492+0000","last_peered":"2023-10-16T20:08:14.100492+0000","last_clean":"2023-10-16T20:08:14.100492+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:14.100492+0000","last_undegraded":"2023-10-16T20:08:14.100492+0000","last_fullsized":"2023-10-16T20:08:14.100492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386428+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386428+0000","last_peered":"2023-10-16T20:08:38.386428+0000","last_clean":"2023-10-16T20:08:38.386428+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386428+0000","last_undegraded":"2023-10-16T20:08:38.386428+0000","last_fullsized":"2023-10-16T20:08:38.386428+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255111+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255111+0000","last_peered":"2023-10-16T20:08:15.255111+0000","last_clean":"2023-10-16T20:08:15.255111+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255111+0000","last_undegraded":"2023-10-16T20:08:15.255111+0000","last_fullsized":"2023-10-16T20:08:15.255111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798211+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798211+0000","last_peered":"2023-10-16T20:09:02.798211+0000","last_clean":"2023-10-16T20:09:02.798211+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798211+0000","last_undegraded":"2023-10-16T20:09:02.798211+0000","last_fullsized":"2023-10-16T20:09:02.798211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428287+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428287+0000","last_peered":"2023-10-16T20:08:22.428287+0000","last_clean":"2023-10-16T20:08:22.428287+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428287+0000","last_undegraded":"2023-10-16T20:08:22.428287+0000","last_fullsized":"2023-10-16T20:08:22.428287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528351+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528351+0000","last_peered":"2023-10-16T20:08:29.528351+0000","last_clean":"2023-10-16T20:08:29.528351+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528351+0000","last_undegraded":"2023-10-16T20:08:29.528351+0000","last_fullsized":"2023-10-16T20:08:29.528351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920424+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920424+0000","last_peered":"2023-10-16T20:08:15.920424+0000","last_clean":"2023-10-16T20:08:15.920424+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920424+0000","last_undegraded":"2023-10-16T20:08:15.920424+0000","last_fullsized":"2023-10-16T20:08:15.920424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902525+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902525+0000","last_peered":"2023-10-16T20:08:47.902525+0000","last_clean":"2023-10-16T20:08:47.902525+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902525+0000","last_undegraded":"2023-10-16T20:08:47.902525+0000","last_fullsized":"2023-10-16T20:08:47.902525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469649+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469649+0000","last_peered":"2023-10-16T20:08:27.469649+0000","last_clean":"2023-10-16T20:08:27.469649+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469649+0000","last_undegraded":"2023-10-16T20:08:27.469649+0000","last_fullsized":"2023-10-16T20:08:27.469649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441196+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441196+0000","last_peered":"2023-10-16T20:08:40.441196+0000","last_clean":"2023-10-16T20:08:40.441196+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441196+0000","last_undegraded":"2023-10-16T20:08:40.441196+0000","last_fullsized":"2023-10-16T20:08:40.441196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248152+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248152+0000","last_peered":"2023-10-16T20:08:14.248152+0000","last_clean":"2023-10-16T20:08:14.248152+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248152+0000","last_undegraded":"2023-10-16T20:08:14.248152+0000","last_fullsized":"2023-10-16T20:08:14.248152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745521+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745521+0000","last_peered":"2023-10-16T20:08:56.745521+0000","last_clean":"2023-10-16T20:08:56.745521+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745521+0000","last_undegraded":"2023-10-16T20:08:56.745521+0000","last_fullsized":"2023-10-16T20:08:56.745521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362444+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362444+0000","last_peered":"2023-10-16T20:08:15.362444+0000","last_clean":"2023-10-16T20:08:15.362444+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362444+0000","last_undegraded":"2023-10-16T20:08:15.362444+0000","last_fullsized":"2023-10-16T20:08:15.362444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466549+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466549+0000","last_peered":"2023-10-16T20:08:23.466549+0000","last_clean":"2023-10-16T20:08:23.466549+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466549+0000","last_undegraded":"2023-10-16T20:08:23.466549+0000","last_fullsized":"2023-10-16T20:08:23.466549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498264+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:14.498264+0000","last_peered":"2023-10-16T20:08:14.498264+0000","last_clean":"2023-10-16T20:08:14.498264+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:14.498264+0000","last_undegraded":"2023-10-16T20:08:14.498264+0000","last_fullsized":"2023-10-16T20:08:14.498264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217724+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217724+0000","last_peered":"2023-10-16T20:08:57.217724+0000","last_clean":"2023-10-16T20:08:57.217724+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217724+0000","last_undegraded":"2023-10-16T20:08:57.217724+0000","last_fullsized":"2023-10-16T20:08:57.217724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950663+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950663+0000","last_peered":"2023-10-16T20:08:17.950663+0000","last_clean":"2023-10-16T20:08:17.950663+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950663+0000","last_undegraded":"2023-10-16T20:08:17.950663+0000","last_fullsized":"2023-10-16T20:08:17.950663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548260+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548260+0000","last_peered":"2023-10-16T20:08:26.548260+0000","last_clean":"2023-10-16T20:08:26.548260+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548260+0000","last_undegraded":"2023-10-16T20:08:26.548260+0000","last_fullsized":"2023-10-16T20:08:26.548260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926605+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926605+0000","last_peered":"2023-10-16T20:08:16.926605+0000","last_clean":"2023-10-16T20:08:16.926605+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926605+0000","last_undegraded":"2023-10-16T20:08:16.926605+0000","last_fullsized":"2023-10-16T20:08:16.926605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406378+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406378+0000","last_peered":"2023-10-16T20:08:32.406378+0000","last_clean":"2023-10-16T20:08:32.406378+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406378+0000","last_undegraded":"2023-10-16T20:08:32.406378+0000","last_fullsized":"2023-10-16T20:08:32.406378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713058+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713058+0000","last_peered":"2023-10-16T20:08:14.713058+0000","last_clean":"2023-10-16T20:08:14.713058+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713058+0000","last_undegraded":"2023-10-16T20:08:14.713058+0000","last_fullsized":"2023-10-16T20:08:14.713058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563241+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563241+0000","last_peered":"2023-10-16T20:08:34.563241+0000","last_clean":"2023-10-16T20:08:34.563241+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563241+0000","last_undegraded":"2023-10-16T20:08:34.563241+0000","last_fullsized":"2023-10-16T20:08:34.563241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498231+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:14.498231+0000","last_peered":"2023-10-16T20:08:14.498231+0000","last_clean":"2023-10-16T20:08:14.498231+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:14.498231+0000","last_undegraded":"2023-10-16T20:08:14.498231+0000","last_fullsized":"2023-10-16T20:08:14.498231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675201+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675201+0000","last_peered":"2023-10-16T20:08:16.675201+0000","last_clean":"2023-10-16T20:08:16.675201+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675201+0000","last_undegraded":"2023-10-16T20:08:16.675201+0000","last_fullsized":"2023-10-16T20:08:16.675201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235554+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235554+0000","last_peered":"2023-10-16T20:08:19.235554+0000","last_clean":"2023-10-16T20:08:19.235554+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235554+0000","last_undegraded":"2023-10-16T20:08:19.235554+0000","last_fullsized":"2023-10-16T20:08:19.235554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333836+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333836+0000","last_peered":"2023-10-16T20:08:32.333836+0000","last_clean":"2023-10-16T20:08:32.333836+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333836+0000","last_undegraded":"2023-10-16T20:08:32.333836+0000","last_fullsized":"2023-10-16T20:08:32.333836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486471+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486471+0000","last_peered":"2023-10-16T20:08:21.486471+0000","last_clean":"2023-10-16T20:08:21.486471+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486471+0000","last_undegraded":"2023-10-16T20:08:21.486471+0000","last_fullsized":"2023-10-16T20:08:21.486471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663954+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663954+0000","last_peered":"2023-10-16T20:08:20.663954+0000","last_clean":"2023-10-16T20:08:20.663954+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663954+0000","last_undegraded":"2023-10-16T20:08:20.663954+0000","last_fullsized":"2023-10-16T20:08:20.663954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713903+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713903+0000","last_peered":"2023-10-16T20:08:17.713903+0000","last_clean":"2023-10-16T20:08:17.713903+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713903+0000","last_undegraded":"2023-10-16T20:08:17.713903+0000","last_fullsized":"2023-10-16T20:08:17.713903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777282+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777282+0000","last_peered":"2023-10-16T20:08:27.777282+0000","last_clean":"2023-10-16T20:08:27.777282+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777282+0000","last_undegraded":"2023-10-16T20:08:27.777282+0000","last_fullsized":"2023-10-16T20:08:27.777282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018874+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018874+0000","last_peered":"2023-10-16T20:08:30.018874+0000","last_clean":"2023-10-16T20:08:30.018874+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018874+0000","last_undegraded":"2023-10-16T20:08:30.018874+0000","last_fullsized":"2023-10-16T20:08:30.018874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948121+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948121+0000","last_peered":"2023-10-16T20:08:31.948121+0000","last_clean":"2023-10-16T20:08:31.948121+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948121+0000","last_undegraded":"2023-10-16T20:08:31.948121+0000","last_fullsized":"2023-10-16T20:08:31.948121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504725+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504725+0000","last_peered":"2023-10-16T20:08:24.504725+0000","last_clean":"2023-10-16T20:08:24.504725+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504725+0000","last_undegraded":"2023-10-16T20:08:24.504725+0000","last_fullsized":"2023-10-16T20:08:24.504725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456890+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456890+0000","last_peered":"2023-10-16T20:08:27.456890+0000","last_clean":"2023-10-16T20:08:27.456890+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456890+0000","last_undegraded":"2023-10-16T20:08:27.456890+0000","last_fullsized":"2023-10-16T20:08:27.456890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498305+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:14.498305+0000","last_peered":"2023-10-16T20:08:14.498305+0000","last_clean":"2023-10-16T20:08:14.498305+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:14.498305+0000","last_undegraded":"2023-10-16T20:08:14.498305+0000","last_fullsized":"2023-10-16T20:08:14.498305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482406+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482406+0000","last_peered":"2023-10-16T20:08:16.482406+0000","last_clean":"2023-10-16T20:08:16.482406+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482406+0000","last_undegraded":"2023-10-16T20:08:16.482406+0000","last_fullsized":"2023-10-16T20:08:16.482406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190567+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190567+0000","last_peered":"2023-10-16T20:08:20.190567+0000","last_clean":"2023-10-16T20:08:20.190567+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190567+0000","last_undegraded":"2023-10-16T20:08:20.190567+0000","last_fullsized":"2023-10-16T20:08:20.190567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208196+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208196+0000","last_peered":"2023-10-16T20:08:58.208196+0000","last_clean":"2023-10-16T20:08:58.208196+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208196+0000","last_undegraded":"2023-10-16T20:08:58.208196+0000","last_fullsized":"2023-10-16T20:08:58.208196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497936+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:14.497936+0000","last_peered":"2023-10-16T20:08:14.497936+0000","last_clean":"2023-10-16T20:08:14.497936+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:14.497936+0000","last_undegraded":"2023-10-16T20:08:14.497936+0000","last_fullsized":"2023-10-16T20:08:14.497936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465827+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465827+0000","last_peered":"2023-10-16T20:08:23.465827+0000","last_clean":"2023-10-16T20:08:23.465827+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465827+0000","last_undegraded":"2023-10-16T20:08:23.465827+0000","last_fullsized":"2023-10-16T20:08:23.465827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498361+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:14.498361+0000","last_peered":"2023-10-16T20:08:14.498361+0000","last_clean":"2023-10-16T20:08:14.498361+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:14.498361+0000","last_undegraded":"2023-10-16T20:08:14.498361+0000","last_fullsized":"2023-10-16T20:08:14.498361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918575+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918575+0000","last_peered":"2023-10-16T20:08:32.918575+0000","last_clean":"2023-10-16T20:08:32.918575+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918575+0000","last_undegraded":"2023-10-16T20:08:32.918575+0000","last_fullsized":"2023-10-16T20:08:32.918575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581879+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581879+0000","last_peered":"2023-10-16T20:08:24.581879+0000","last_clean":"2023-10-16T20:08:24.581879+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581879+0000","last_undegraded":"2023-10-16T20:08:24.581879+0000","last_fullsized":"2023-10-16T20:08:24.581879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690496+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690496+0000","last_peered":"2023-10-16T20:08:46.690496+0000","last_clean":"2023-10-16T20:08:46.690496+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690496+0000","last_undegraded":"2023-10-16T20:08:46.690496+0000","last_fullsized":"2023-10-16T20:08:46.690496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497712+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:14.497712+0000","last_peered":"2023-10-16T20:08:14.497712+0000","last_clean":"2023-10-16T20:08:14.497712+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:14.497712+0000","last_undegraded":"2023-10-16T20:08:14.497712+0000","last_fullsized":"2023-10-16T20:08:14.497712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148089+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148089+0000","last_peered":"2023-10-16T20:08:33.148089+0000","last_clean":"2023-10-16T20:08:33.148089+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148089+0000","last_undegraded":"2023-10-16T20:08:33.148089+0000","last_fullsized":"2023-10-16T20:08:33.148089+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974975+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974975+0000","last_peered":"2023-10-16T20:08:20.974975+0000","last_clean":"2023-10-16T20:08:20.974975+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974975+0000","last_undegraded":"2023-10-16T20:08:20.974975+0000","last_fullsized":"2023-10-16T20:08:20.974975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311276+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311276+0000","last_peered":"2023-10-16T20:08:53.311276+0000","last_clean":"2023-10-16T20:08:53.311276+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311276+0000","last_undegraded":"2023-10-16T20:08:53.311276+0000","last_fullsized":"2023-10-16T20:08:53.311276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497822+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:14.497822+0000","last_peered":"2023-10-16T20:08:14.497822+0000","last_clean":"2023-10-16T20:08:14.497822+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:14.497822+0000","last_undegraded":"2023-10-16T20:08:14.497822+0000","last_fullsized":"2023-10-16T20:08:14.497822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762808+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762808+0000","last_peered":"2023-10-16T20:09:01.762808+0000","last_clean":"2023-10-16T20:09:01.762808+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762808+0000","last_undegraded":"2023-10-16T20:09:01.762808+0000","last_fullsized":"2023-10-16T20:09:01.762808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449316+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449316+0000","last_peered":"2023-10-16T20:08:20.449316+0000","last_clean":"2023-10-16T20:08:20.449316+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449316+0000","last_undegraded":"2023-10-16T20:08:20.449316+0000","last_fullsized":"2023-10-16T20:08:20.449316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526534+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526534+0000","last_peered":"2023-10-16T20:08:31.526534+0000","last_clean":"2023-10-16T20:08:31.526534+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526534+0000","last_undegraded":"2023-10-16T20:08:31.526534+0000","last_fullsized":"2023-10-16T20:08:31.526534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100367+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:14.100367+0000","last_peered":"2023-10-16T20:08:14.100367+0000","last_clean":"2023-10-16T20:08:14.100367+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:14.100367+0000","last_undegraded":"2023-10-16T20:08:14.100367+0000","last_fullsized":"2023-10-16T20:08:14.100367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101643+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101643+0000","last_peered":"2023-10-16T20:08:32.101643+0000","last_clean":"2023-10-16T20:08:32.101643+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101643+0000","last_undegraded":"2023-10-16T20:08:32.101643+0000","last_fullsized":"2023-10-16T20:08:32.101643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100716+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:14.100716+0000","last_peered":"2023-10-16T20:08:14.100716+0000","last_clean":"2023-10-16T20:08:14.100716+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:14.100716+0000","last_undegraded":"2023-10-16T20:08:14.100716+0000","last_fullsized":"2023-10-16T20:08:14.100716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407642+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407642+0000","last_peered":"2023-10-16T20:08:37.407642+0000","last_clean":"2023-10-16T20:08:37.407642+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407642+0000","last_undegraded":"2023-10-16T20:08:37.407642+0000","last_fullsized":"2023-10-16T20:08:37.407642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469249+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469249+0000","last_peered":"2023-10-16T20:08:23.469249+0000","last_clean":"2023-10-16T20:08:23.469249+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469249+0000","last_undegraded":"2023-10-16T20:08:23.469249+0000","last_fullsized":"2023-10-16T20:08:23.469249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129402+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129402+0000","last_peered":"2023-10-16T20:09:06.129402+0000","last_clean":"2023-10-16T20:09:06.129402+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129402+0000","last_undegraded":"2023-10-16T20:09:06.129402+0000","last_fullsized":"2023-10-16T20:09:06.129402+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497630+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:14.497630+0000","last_peered":"2023-10-16T20:08:14.497630+0000","last_clean":"2023-10-16T20:08:14.497630+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:14.497630+0000","last_undegraded":"2023-10-16T20:08:14.497630+0000","last_fullsized":"2023-10-16T20:08:14.497630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.900287+0000","last_change":"2023-10-16T20:08:14.499177+0000","last_active":"2023-10-16T20:08:17.900287+0000","last_peered":"2023-10-16T20:08:17.900287+0000","last_clean":"2023-10-16T20:08:17.900287+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:08:17.900287+0000","last_undegraded":"2023-10-16T20:08:17.900287+0000","last_fullsized":"2023-10-16T20:08:17.900287+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:07:52.013721+0000","last_clean_scrub_stamp":"2023-10-16T20:07:52.013721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:10.848096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437964+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437964+0000","last_peered":"2023-10-16T20:08:29.437964+0000","last_clean":"2023-10-16T20:08:29.437964+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437964+0000","last_undegraded":"2023-10-16T20:08:29.437964+0000","last_fullsized":"2023-10-16T20:08:29.437964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":197,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.967215+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:23.967215+0000","last_peered":"2023-10-16T20:08:23.967215+0000","last_clean":"2023-10-16T20:08:23.967215+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:23.967215+0000","last_undegraded":"2023-10-16T20:08:23.967215+0000","last_fullsized":"2023-10-16T20:08:23.967215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.47499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.54200000000000004,"15min":0.51000000000000001},"min":{"1min":0.48799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.53200000000000003},"min":{"1min":0.52800000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.626}]},{"osd":2,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.437,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.53900000000000003},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":3,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57799999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.627,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48199999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.505}]}]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.46600000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72499999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.61499999999999999},"min":{"1min":0.497,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.45800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":1.218,"15min":1.218},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.64000000000000001,"15min":0.69899999999999995},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.73499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.499}]},{"osd":2,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.502,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.745,"5min":1.391,"15min":1.391},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.59999999999999998},"min":{"1min":0.48099999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77300000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67700000000000005}]},{"osd":3,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61299999999999999,"15min":0.61199999999999999},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78900000000000003,"5min":1.516,"15min":1.516},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64100000000000001,"15min":0.67200000000000004},"min":{"1min":0.53500000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.80300000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.75900000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53700000000000003,"15min":0.58499999999999996},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.65100000000000002,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57899999999999996,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76500000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63300000000000001,"15min":0.69099999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.849,"15min":1.849},"last":0.78800000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.70199999999999996,"15min":0.79500000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82599999999999996,"5min":2.585,"15min":2.585},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.69299999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.115,"15min":1.115},"last":0.82599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35199999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.59299999999999997,"5min":0.621,"15min":0.621},"last":0.621}]},{"osd":2,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.34499999999999997},"min":{"1min":0.27900000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55800000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39200000000000002,"15min":0.371},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59599999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67100000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40200000000000002,"15min":0.39100000000000001},"min":{"1min":0.29299999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60199999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.39300000000000002},"min":{"1min":0.31900000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.70799999999999996}]},{"osd":4,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.41299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78200000000000003,"5min":1.153,"15min":1.153},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.63,"15min":0.63},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97199999999999998,"5min":1.214,"15min":1.214},"last":0.746}]},{"osd":5,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":1.135,"15min":1.135},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.625,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95199999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92600000000000005,"5min":1.05,"15min":1.05},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80300000000000005,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Mon Oct 16 20:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.876,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.84899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.246,"5min":0.216,"15min":0.216},"max":{"1min":0.61199999999999999,"5min":2.798,"15min":2.798},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.42299999999999999},"min":{"1min":0.311,"5min":0.223,"15min":0.223},"max":{"1min":0.69999999999999996,"5min":1.087,"15min":1.087},"last":0.41899999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.47799999999999998},"min":{"1min":0.27900000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.59899999999999998,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.28899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55500000000000005,"5min":1.218,"15min":1.218},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:10:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63500000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.437},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57199999999999995,"5min":2.754,"15min":2.754},"last":0.45300000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.50800000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91600000000000004,"5min":1.125,"15min":1.125},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.621},"min":{"1min":0.52500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96399999999999997,"5min":1.246,"15min":1.246},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.54200000000000004,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97599999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.753}]},{"osd":6,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64400000000000002,"15min":0.63},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88200000000000001,"5min":1.153,"15min":1.153},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 16 20:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.58199999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91900000000000004,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.56299999999999994,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85699999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79600000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542207,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34799999999999998,"15min":0.32900000000000001},"min":{"1min":0.26000000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.38100000000000001,"15min":0.36499999999999999},"min":{"1min":0.318,"5min":0.246,"15min":0.246},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40400000000000003}]},{"osd":1,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40000000000000002,"15min":0.38},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.623,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.435,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.53800000000000003,"5min":0.63,"15min":0.63},"last":0.376}]},{"osd":3,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.40600000000000003},"min":{"1min":0.40000000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.629,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.375},"min":{"1min":0.34399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.45500000000000002}]},{"osd":4,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61199999999999999,"15min":0.58799999999999997},"min":{"1min":0.504,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83999999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71999999999999997}]},{"osd":5,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86399999999999999,"5min":0.879,"15min":0.879},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.53100000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82899999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64600000000000002,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.83799999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75}]},{"osd":7,"last update":"Mon Oct 16 20:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80600000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.65500000000000003,"15min":0.625},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79400000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542208,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36099999999999999,"15min":0.373},"min":{"1min":0.24099999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.59599999999999997,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.379,"15min":0.372},"min":{"1min":0.27600000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.44700000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.55200000000000005,"5min":0.63,"15min":0.63},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63100000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.50600000000000001}]},{"osd":2,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.432},"min":{"1min":0.32200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.61899999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66200000000000003,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.53300000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73299999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.5,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80700000000000005,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.54500000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82899999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86199999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66400000000000003,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.81399999999999995,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.80100000000000005,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79000000000000004,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65000000000000002,"15min":0.64300000000000002},"min":{"1min":0.48899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84499999999999997,"5min":0.876,"15min":0.876},"last":0.71199999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.48299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.505}]},{"osd":1,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.746,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":2.899,"15min":2.899},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.40899999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.70299999999999996}]},{"osd":3,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.44700000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.72099999999999997,"5min":1.24,"15min":1.24},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78200000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.629}]},{"osd":5,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.61099999999999999,"5min":0.872,"15min":0.872},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54400000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.41499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.79800000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Oct 16 20:10:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59299999999999997,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82099999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.86799999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.73899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.44900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71099999999999997,"5min":1.046,"15min":1.046},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.432,"5min":0.307,"15min":0.307},"max":{"1min":0.69299999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.59199999999999997,"15min":0.56999999999999995},"min":{"1min":0.51000000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.45600000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.68200000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.56200000000000006},"min":{"1min":0.495,"5min":0.376,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.87,"15min":0.87},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.46700000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.70699999999999996,"5min":1.103,"15min":1.103},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.627},"min":{"1min":0.502,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.72099999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.51000000000000001,"15min":0.54000000000000004},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.54800000000000004,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73799999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58399999999999996,"15min":0.64600000000000002},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69199999999999995,"5min":1.546,"15min":1.546},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.625,"15min":0.70499999999999996},"min":{"1min":0.41199999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68300000000000005,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.40100000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.61899999999999999},"min":{"1min":0.38800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:11:15.749 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-16T20:07:52.013721+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=7, tm_sec=52, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=20, tm_min=8, tm_sec=6, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T20:11:15.750 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 6.7 2023-10-16T20:11:15.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.902+0000 7f822e463700 1 Processor -- start 2023-10-16T20:11:15.904 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.902+0000 7f822e463700 1 -- start start 2023-10-16T20:11:15.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f822e463700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280b3410 0x7f82280cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f822e463700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8228070d70 con 0x7f82280cb8d0 2023-10-16T20:11:15.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f822e463700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822815c990 con 0x7f8228152470 2023-10-16T20:11:15.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f822e463700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228071200 con 0x7f82280b3410 2023-10-16T20:11:15.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f822ca00700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f82280cb8d0 0x7f82280b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41750/0 (socket says 172.21.15.152:41750) 2023-10-16T20:11:15.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f822ca00700 1 -- 172.21.15.152:0/4032003137 learned_addr learned my addr 172.21.15.152:0/4032003137 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:11:15.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f82277fe700 1 --2- 172.21.15.152:0/4032003137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280b3410 0x7f82280cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f8226ffd700 1 -- 172.21.15.152:0/4032003137 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181702017 0 0) 0x7f8228070d70 con 0x7f82280cb8d0 2023-10-16T20:11:15.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f8226ffd700 1 -- 172.21.15.152:0/4032003137 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82100035b0 con 0x7f82280cb8d0 2023-10-16T20:11:15.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f8226ffd700 1 -- 172.21.15.152:0/4032003137 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197843131 0 0) 0x7f82100035b0 con 0x7f82280cb8d0 2023-10-16T20:11:15.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f82277fe700 1 -- 172.21.15.152:0/4032003137 >> v1:172.21.15.163:6789/0 conn(0x7f8228152470 legacy=0x7f82280b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f82277fe700 1 -- 172.21.15.152:0/4032003137 >> v1:172.21.15.152:6789/0 conn(0x7f82280cb8d0 legacy=0x7f82280b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.903+0000 7f82277fe700 1 -- 172.21.15.152:0/4032003137 --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280cbd80 con 0x7f82280b3410 2023-10-16T20:11:15.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f82277fe700 1 --2- 172.21.15.152:0/4032003137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280b3410 0x7f82280cd570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f821c009870 tx=0x7f821c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d887ca2614f0bc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f8226ffd700 1 -- 172.21.15.152:0/4032003137 <== mon.2 v2:172.21.15.163:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200019f0 con 0x7f82280b3410 2023-10-16T20:11:15.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f8226ffd700 1 -- 172.21.15.152:0/4032003137 <== mon.2 v2:172.21.15.163:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c004030 con 0x7f82280b3410 2023-10-16T20:11:15.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f8226ffd700 1 -- 172.21.15.152:0/4032003137 <== mon.2 v2:172.21.15.163:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c0043c0 con 0x7f82280b3410 2023-10-16T20:11:15.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 -- 172.21.15.152:0/4032003137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280b3410 msgr2=0x7f82280cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 --2- 172.21.15.152:0/4032003137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280b3410 0x7f82280cd570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f821c009870 tx=0x7f821c009b80 comp rx=0 tx=0).stop 2023-10-16T20:11:15.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 -- 172.21.15.152:0/4032003137 shutdown_connections 2023-10-16T20:11:15.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 --2- 172.21.15.152:0/4032003137 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280b3410 0x7f82280cd570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 -- 172.21.15.152:0/4032003137 >> 172.21.15.152:0/4032003137 conn(0x7f82280cdd00 msgr2=0x7f82280ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:15.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 -- 172.21.15.152:0/4032003137 shutdown_connections 2023-10-16T20:11:15.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.904+0000 7f822e463700 1 -- 172.21.15.152:0/4032003137 wait complete. 2023-10-16T20:11:15.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.905+0000 7f822e463700 1 Processor -- start 2023-10-16T20:11:15.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 -- start start 2023-10-16T20:11:15.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82280b3410 0x7f8228151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280cb8d0 0x7f82281585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 0x7f82280b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.917 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b6350 con 0x7f8228152470 2023-10-16T20:11:15.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b5740 con 0x7f82280b3410 2023-10-16T20:11:15.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.906+0000 7f822e463700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b5a20 con 0x7f82280cb8d0 2023-10-16T20:11:15.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 0x7f82280b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 0x7f82280b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33326/0 (socket says 172.21.15.152:33326) 2023-10-16T20:11:15.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 -- 172.21.15.152:0/2485612975 learned_addr learned my addr 172.21.15.152:0/2485612975 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:11:15.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f82277fe700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280cb8d0 0x7f82281585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f8227fff700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82280b3410 0x7f8228151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 -- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280cb8d0 msgr2=0x7f82281585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280cb8d0 0x7f82281585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 -- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82280b3410 msgr2=0x7f8228151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:15.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82280b3410 0x7f8228151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:15.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 -- 172.21.15.152:0/2485612975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0094a0 con 0x7f8228152470 2023-10-16T20:11:15.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f8227fff700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82280b3410 0x7f8228151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:11:15.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822ca00700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 0x7f82280b4ef0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82200018d0 tx=0x7f822000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000ad40 con 0x7f8228152470 2023-10-16T20:11:15.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82200070d0 con 0x7f8228152470 2023-10-16T20:11:15.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82280b5d00 con 0x7f8228152470 2023-10-16T20:11:15.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220007480 con 0x7f8228152470 2023-10-16T20:11:15.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.907+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82280b5430 con 0x7f8228152470 2023-10-16T20:11:15.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.908+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822804ebb0 con 0x7f8228152470 2023-10-16T20:11:15.923 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.909+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82200075e0 con 0x7f8228152470 2023-10-16T20:11:15.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.909+0000 7f8224ff9700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f821406af00 0x7f821406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:15.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.909+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f8220089620 con 0x7f8228152470 2023-10-16T20:11:15.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.909+0000 7f8227fff700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f821406af00 0x7f821406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:15.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.910+0000 7f8227fff700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f821406af00 0x7f821406d3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8218000f60 tx=0x7f8218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:15.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:15.914+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82200545f0 con 0x7f8228152470 2023-10-16T20:11:16.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.098+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg deep-scrub", "pgid": "6.7", "target": ["mon-mgr", ""]}) v1 -- 0x7f82280b5b90 con 0x7f821406af00 2023-10-16T20:11:16.101 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.099+0000 7f8224ff9700 1 -- 172.21.15.152:0/2485612975 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 instructing pg 6.7 on osd.0 to deep-scrub) v1 ==== 49+0+0 (secure 0 0 0) 0x7f82280b5b90 con 0x7f821406af00 2023-10-16T20:11:16.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f821406af00 msgr2=0x7f821406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:16.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f821406af00 0x7f821406d3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8218000f60 tx=0x7f8218009040 comp rx=0 tx=0).stop 2023-10-16T20:11:16.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 msgr2=0x7f82280b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:16.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 0x7f82280b4ef0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82200018d0 tx=0x7f822000a340 comp rx=0 tx=0).stop 2023-10-16T20:11:16.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 shutdown_connections 2023-10-16T20:11:16.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f821406af00 0x7f821406d3c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8228152470 0x7f82280b4ef0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82280b3410 0x7f8228151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 --2- 172.21.15.152:0/2485612975 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f82280cb8d0 0x7f82281585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:16.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 >> 172.21.15.152:0/2485612975 conn(0x7f82280cdd00 msgr2=0x7f822815a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:16.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 shutdown_connections 2023-10-16T20:11:16.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:16.101+0000 7f822e463700 1 -- 172.21.15.152:0/2485612975 wait complete. 2023-10-16T20:11:16.107 INFO:teuthology.orchestra.run.smithi152.stderr:instructing pg 6.7 on osd.0 to deep-scrub 2023-10-16T20:11:16.115 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T20:11:31.725 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:31.728 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:36.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T20:11:36.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.247+0000 7fe027c5d700 1 Processor -- start 2023-10-16T20:11:36.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.247+0000 7fe027c5d700 1 -- start start 2023-10-16T20:11:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe027c5d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe02006b7e0 0x7fe02006bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe027c5d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe0200b6620 0x7fe0200b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe027c5d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200ce7e0 con 0x7fe02015d890 2023-10-16T20:11:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe027c5d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02006c1d0 con 0x7fe02006b7e0 2023-10-16T20:11:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe027c5d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200ceab0 con 0x7fe0200b6620 2023-10-16T20:11:36.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0251f8700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe02006b7e0 0x7fe02006bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0259f9700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe02015d890 0x7fe0200ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41760/0 (socket says 172.21.15.152:41760) 2023-10-16T20:11:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0259f9700 1 -- 172.21.15.152:0/2986185657 learned_addr learned my addr 172.21.15.152:0/2986185657 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:11:36.255 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0261fa700 1 --2- 172.21.15.152:0/2986185657 >> v2:172.21.15.163:3300/0 conn(0x7fe0200b6620 0x7fe0200b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0251f8700 1 -- 172.21.15.152:0/2986185657 >> v2:172.21.15.163:3300/0 conn(0x7fe0200b6620 msgr2=0x7fe0200b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:36.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0251f8700 1 --2- 172.21.15.152:0/2986185657 >> v2:172.21.15.163:3300/0 conn(0x7fe0200b6620 0x7fe0200b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.256 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0251f8700 1 -- 172.21.15.152:0/2986185657 >> v1:172.21.15.152:6789/0 conn(0x7fe02015d890 legacy=0x7fe0200ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0251f8700 1 -- 172.21.15.152:0/2986185657 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200ced90 con 0x7fe02006b7e0 2023-10-16T20:11:36.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0261fa700 1 --2- 172.21.15.152:0/2986185657 >> v2:172.21.15.163:3300/0 conn(0x7fe0200b6620 0x7fe0200b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:11:36.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0251f8700 1 --2- 172.21.15.152:0/2986185657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02006bc90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe0200b2f40 tx=0x7fe010009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba2f0c3fe50a1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0249f7700 1 -- 172.21.15.152:0/2986185657 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010011830 con 0x7fe02006b7e0 2023-10-16T20:11:36.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0249f7700 1 -- 172.21.15.152:0/2986185657 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010011990 con 0x7fe02006b7e0 2023-10-16T20:11:36.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.248+0000 7fe0249f7700 1 -- 172.21.15.152:0/2986185657 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010011d20 con 0x7fe02006b7e0 2023-10-16T20:11:36.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 -- 172.21.15.152:0/2986185657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 msgr2=0x7fe02006bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 --2- 172.21.15.152:0/2986185657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02006bc90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe0200b2f40 tx=0x7fe010009b20 comp rx=0 tx=0).stop 2023-10-16T20:11:36.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 -- 172.21.15.152:0/2986185657 shutdown_connections 2023-10-16T20:11:36.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 --2- 172.21.15.152:0/2986185657 >> v2:172.21.15.163:3300/0 conn(0x7fe0200b6620 0x7fe0200b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 --2- 172.21.15.152:0/2986185657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02006bc90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 -- 172.21.15.152:0/2986185657 >> 172.21.15.152:0/2986185657 conn(0x7fe020072340 msgr2=0x7fe020072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 -- 172.21.15.152:0/2986185657 shutdown_connections 2023-10-16T20:11:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.249+0000 7fe027c5d700 1 -- 172.21.15.152:0/2986185657 wait complete. 2023-10-16T20:11:36.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.250+0000 7fe027c5d700 1 Processor -- start 2023-10-16T20:11:36.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.250+0000 7fe027c5d700 1 -- start start 2023-10-16T20:11:36.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe027c5d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe027c5d700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe0200b6620 0x7fe020153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe027c5d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe02015d890 0x7fe0200cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe027c5d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201594b0 con 0x7fe02006b7e0 2023-10-16T20:11:36.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe027c5d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02015ebc0 con 0x7fe02015d890 2023-10-16T20:11:36.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe027c5d700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe020158410 con 0x7fe0200b6620 2023-10-16T20:11:36.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe0259f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe0259f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02015e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33340/0 (socket says 172.21.15.152:33340) 2023-10-16T20:11:36.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe0259f9700 1 -- 172.21.15.152:0/959558836 learned_addr learned my addr 172.21.15.152:0/959558836 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:11:36.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe0251f8700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe0200b6620 0x7fe020153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.266 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.251+0000 7fe0261fa700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe02015d890 0x7fe0200cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0259f9700 1 -- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe0200b6620 msgr2=0x7fe020153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0259f9700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe0200b6620 0x7fe020153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0259f9700 1 -- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe02015d890 msgr2=0x7fe0200cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0259f9700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe02015d890 0x7fe0200cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0259f9700 1 -- 172.21.15.152:0/959558836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100094a0 con 0x7fe02006b7e0 2023-10-16T20:11:36.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0251f8700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe0200b6620 0x7fe020153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:11:36.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0261fa700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe02015d890 0x7fe0200cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:11:36.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0259f9700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02015e680 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c480 tx=0x7fe01c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c005d70 con 0x7fe02006b7e0 2023-10-16T20:11:36.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c0070d0 con 0x7fe02006b7e0 2023-10-16T20:11:36.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0201586f0 con 0x7fe02006b7e0 2023-10-16T20:11:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c007440 con 0x7fe02006b7e0 2023-10-16T20:11:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.252+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020158cb0 con 0x7fe02006b7e0 2023-10-16T20:11:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.253+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02015d0f0 con 0x7fe02006b7e0 2023-10-16T20:11:36.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.253+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe01c0075a0 con 0x7fe02006b7e0 2023-10-16T20:11:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.254+0000 7fe0167fc700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe00406af00 0x7fe00406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.254+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7fe01c088b00 con 0x7fe02006b7e0 2023-10-16T20:11:36.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.254+0000 7fe0251f8700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe00406af00 0x7fe00406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.254+0000 7fe0251f8700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe00406af00 0x7fe00406d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe0100090b0 tx=0x7fe010008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.258+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe01c053af0 con 0x7fe02006b7e0 2023-10-16T20:11:36.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.442+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 --> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0200cf350 con 0x7fe00406af00 2023-10-16T20:11:36.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.450+0000 7fe0167fc700 1 -- 172.21.15.152:0/959558836 <== mgr.4107 v2:172.21.15.152:6832/1955925781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290753 (secure 0 0 0) 0x7fe0100117d0 con 0x7fe00406af00 2023-10-16T20:11:36.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:11:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.453+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe00406af00 msgr2=0x7fe00406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.453+0000 7fe027c5d700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe00406af00 0x7fe00406d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe0100090b0 tx=0x7fe010008030 comp rx=0 tx=0).stop 2023-10-16T20:11:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.453+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 msgr2=0x7fe02015e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.453+0000 7fe027c5d700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02015e680 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c480 tx=0x7fe01c00c840 comp rx=0 tx=0).stop 2023-10-16T20:11:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 shutdown_connections 2023-10-16T20:11:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7fe00406af00 0x7fe00406d3c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe02015d890 0x7fe0200cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe02006b7e0 0x7fe02015e680 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 --2- 172.21.15.152:0/959558836 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7fe0200b6620 0x7fe020153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 >> 172.21.15.152:0/959558836 conn(0x7fe020072340 msgr2=0x7fe0200b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 shutdown_connections 2023-10-16T20:11:36.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.454+0000 7fe027c5d700 1 -- 172.21.15.152:0/959558836 wait complete. 2023-10-16T20:11:36.463 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-10-16T20:11:36.468 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-10-16T20:11:34.843555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":5064,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5185536,"data_stored":2896828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003285"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.681912+0000","last_change":"2023-10-16T20:08:25.681912+0000","last_active":"2023-10-16T20:08:25.681912+0000","last_peered":"2023-10-16T20:08:25.681912+0000","last_clean":"2023-10-16T20:08:25.681912+0000","last_became_active":"2023-10-16T20:07:53.031820+0000","last_became_peered":"2023-10-16T20:07:53.031820+0000","last_unstale":"2023-10-16T20:08:25.681912+0000","last_undegraded":"2023-10-16T20:08:25.681912+0000","last_fullsized":"2023-10-16T20:08:25.681912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.681779+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.681779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:41.805249+0000","scrub_duration":0.001523826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.716377+0000","last_change":"2023-10-16T20:08:48.716377+0000","last_active":"2023-10-16T20:08:48.716377+0000","last_peered":"2023-10-16T20:08:48.716377+0000","last_clean":"2023-10-16T20:08:48.716377+0000","last_became_active":"2023-10-16T20:07:53.033028+0000","last_became_peered":"2023-10-16T20:07:53.033028+0000","last_unstale":"2023-10-16T20:08:48.716377+0000","last_undegraded":"2023-10-16T20:08:48.716377+0000","last_fullsized":"2023-10-16T20:08:48.716377+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.716215+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.716215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:13:40.340625+0000","scrub_duration":0.0014583560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.568776+0000","last_change":"2023-10-16T20:08:27.568776+0000","last_active":"2023-10-16T20:08:27.568776+0000","last_peered":"2023-10-16T20:08:27.568776+0000","last_clean":"2023-10-16T20:08:27.568776+0000","last_became_active":"2023-10-16T20:07:53.041678+0000","last_became_peered":"2023-10-16T20:07:53.041678+0000","last_unstale":"2023-10-16T20:08:27.568776+0000","last_undegraded":"2023-10-16T20:08:27.568776+0000","last_fullsized":"2023-10-16T20:08:27.568776+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.568589+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.568589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:42:18.340773+0000","scrub_duration":0.0021063869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.499320+0000","last_change":"2023-10-16T20:08:20.499320+0000","last_active":"2023-10-16T20:08:20.499320+0000","last_peered":"2023-10-16T20:08:20.499320+0000","last_clean":"2023-10-16T20:08:20.499320+0000","last_became_active":"2023-10-16T20:07:53.037454+0000","last_became_peered":"2023-10-16T20:07:53.037454+0000","last_unstale":"2023-10-16T20:08:20.499320+0000","last_undegraded":"2023-10-16T20:08:20.499320+0000","last_fullsized":"2023-10-16T20:08:20.499320+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.499155+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.499155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:20:22.351174+0000","scrub_duration":0.001855946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.509653+0000","last_change":"2023-10-16T20:08:15.509653+0000","last_active":"2023-10-16T20:08:15.509653+0000","last_peered":"2023-10-16T20:08:15.509653+0000","last_clean":"2023-10-16T20:08:15.509653+0000","last_became_active":"2023-10-16T20:07:53.037224+0000","last_became_peered":"2023-10-16T20:07:53.037224+0000","last_unstale":"2023-10-16T20:08:15.509653+0000","last_undegraded":"2023-10-16T20:08:15.509653+0000","last_fullsized":"2023-10-16T20:08:15.509653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.509485+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.509485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:36:12.762514+0000","scrub_duration":0.0024802639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:25.157301+0000","last_change":"2023-10-16T20:08:25.157301+0000","last_active":"2023-10-16T20:08:25.157301+0000","last_peered":"2023-10-16T20:08:25.157301+0000","last_clean":"2023-10-16T20:08:25.157301+0000","last_became_active":"2023-10-16T20:07:53.033783+0000","last_became_peered":"2023-10-16T20:07:53.033783+0000","last_unstale":"2023-10-16T20:08:25.157301+0000","last_undegraded":"2023-10-16T20:08:25.157301+0000","last_fullsized":"2023-10-16T20:08:25.157301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:25.157120+0000","last_clean_scrub_stamp":"2023-10-16T20:08:25.157120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:41.719911+0000","scrub_duration":0.001548626,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.867048+0000","last_change":"2023-10-16T20:08:59.867048+0000","last_active":"2023-10-16T20:08:59.867048+0000","last_peered":"2023-10-16T20:08:59.867048+0000","last_clean":"2023-10-16T20:08:59.867048+0000","last_became_active":"2023-10-16T20:07:53.048453+0000","last_became_peered":"2023-10-16T20:07:53.048453+0000","last_unstale":"2023-10-16T20:08:59.867048+0000","last_undegraded":"2023-10-16T20:08:59.867048+0000","last_fullsized":"2023-10-16T20:08:59.867048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.866892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.866892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:56.891213+0000","scrub_duration":0.001706801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.596703+0000","last_change":"2023-10-16T20:08:42.596703+0000","last_active":"2023-10-16T20:08:42.596703+0000","last_peered":"2023-10-16T20:08:42.596703+0000","last_clean":"2023-10-16T20:08:42.596703+0000","last_became_active":"2023-10-16T20:07:53.031287+0000","last_became_peered":"2023-10-16T20:07:53.031287+0000","last_unstale":"2023-10-16T20:08:42.596703+0000","last_undegraded":"2023-10-16T20:08:42.596703+0000","last_fullsized":"2023-10-16T20:08:42.596703+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.596562+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.596562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:35.629189+0000","scrub_duration":0.001928049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.606086+0000","last_change":"2023-10-16T20:08:35.606086+0000","last_active":"2023-10-16T20:08:35.606086+0000","last_peered":"2023-10-16T20:08:35.606086+0000","last_clean":"2023-10-16T20:08:35.606086+0000","last_became_active":"2023-10-16T20:07:53.053315+0000","last_became_peered":"2023-10-16T20:07:53.053315+0000","last_unstale":"2023-10-16T20:08:35.606086+0000","last_undegraded":"2023-10-16T20:08:35.606086+0000","last_fullsized":"2023-10-16T20:08:35.606086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.605930+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.605930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:12:16.080474+0000","scrub_duration":0.002122886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.885888+0000","last_change":"2023-10-16T20:08:48.885888+0000","last_active":"2023-10-16T20:08:48.885888+0000","last_peered":"2023-10-16T20:08:48.885888+0000","last_clean":"2023-10-16T20:08:48.885888+0000","last_became_active":"2023-10-16T20:07:53.047913+0000","last_became_peered":"2023-10-16T20:07:53.047913+0000","last_unstale":"2023-10-16T20:08:48.885888+0000","last_undegraded":"2023-10-16T20:08:48.885888+0000","last_fullsized":"2023-10-16T20:08:48.885888+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.885721+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.885721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:56.751842+0000","scrub_duration":0.0014916770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.958979+0000","last_change":"2023-10-16T20:08:34.958979+0000","last_active":"2023-10-16T20:08:34.958979+0000","last_peered":"2023-10-16T20:08:34.958979+0000","last_clean":"2023-10-16T20:08:34.958979+0000","last_became_active":"2023-10-16T20:07:53.039964+0000","last_became_peered":"2023-10-16T20:07:53.039964+0000","last_unstale":"2023-10-16T20:08:34.958979+0000","last_undegraded":"2023-10-16T20:08:34.958979+0000","last_fullsized":"2023-10-16T20:08:34.958979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.958822+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.958822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:35:33.714463+0000","scrub_duration":0.0014039740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.500960+0000","last_change":"2023-10-16T20:08:24.500960+0000","last_active":"2023-10-16T20:08:24.500960+0000","last_peered":"2023-10-16T20:08:24.500960+0000","last_clean":"2023-10-16T20:08:24.500960+0000","last_became_active":"2023-10-16T20:07:53.038668+0000","last_became_peered":"2023-10-16T20:07:53.038668+0000","last_unstale":"2023-10-16T20:08:24.500960+0000","last_undegraded":"2023-10-16T20:08:24.500960+0000","last_fullsized":"2023-10-16T20:08:24.500960+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.500820+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.500820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:58.021585+0000","scrub_duration":0.0014940699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:50.938175+0000","last_change":"2023-10-16T20:08:50.938175+0000","last_active":"2023-10-16T20:08:50.938175+0000","last_peered":"2023-10-16T20:08:50.938175+0000","last_clean":"2023-10-16T20:08:50.938175+0000","last_became_active":"2023-10-16T20:07:53.053419+0000","last_became_peered":"2023-10-16T20:07:53.053419+0000","last_unstale":"2023-10-16T20:08:50.938175+0000","last_undegraded":"2023-10-16T20:08:50.938175+0000","last_fullsized":"2023-10-16T20:08:50.938175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:50.938037+0000","last_clean_scrub_stamp":"2023-10-16T20:08:50.938037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:32:34.033447+0000","scrub_duration":0.0014816320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.399659+0000","last_change":"2023-10-16T20:08:34.399659+0000","last_active":"2023-10-16T20:08:34.399659+0000","last_peered":"2023-10-16T20:08:34.399659+0000","last_clean":"2023-10-16T20:08:34.399659+0000","last_became_active":"2023-10-16T20:07:53.040775+0000","last_became_peered":"2023-10-16T20:07:53.040775+0000","last_unstale":"2023-10-16T20:08:34.399659+0000","last_undegraded":"2023-10-16T20:08:34.399659+0000","last_fullsized":"2023-10-16T20:08:34.399659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.399494+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.399494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:50.392734+0000","scrub_duration":0.0018419090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:00.866907+0000","last_change":"2023-10-16T20:09:00.866907+0000","last_active":"2023-10-16T20:09:00.866907+0000","last_peered":"2023-10-16T20:09:00.866907+0000","last_clean":"2023-10-16T20:09:00.866907+0000","last_became_active":"2023-10-16T20:07:53.052433+0000","last_became_peered":"2023-10-16T20:07:53.052433+0000","last_unstale":"2023-10-16T20:09:00.866907+0000","last_undegraded":"2023-10-16T20:09:00.866907+0000","last_fullsized":"2023-10-16T20:09:00.866907+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:00.866754+0000","last_clean_scrub_stamp":"2023-10-16T20:09:00.866754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:39.886438+0000","scrub_duration":0.0017366320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:48.412539+0000","last_change":"2023-10-16T20:08:48.412539+0000","last_active":"2023-10-16T20:08:48.412539+0000","last_peered":"2023-10-16T20:08:48.412539+0000","last_clean":"2023-10-16T20:08:48.412539+0000","last_became_active":"2023-10-16T20:07:53.057238+0000","last_became_peered":"2023-10-16T20:07:53.057238+0000","last_unstale":"2023-10-16T20:08:48.412539+0000","last_undegraded":"2023-10-16T20:08:48.412539+0000","last_fullsized":"2023-10-16T20:08:48.412539+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:48.412381+0000","last_clean_scrub_stamp":"2023-10-16T20:08:48.412381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:03:48.810430+0000","scrub_duration":0.0014150110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.228338+0000","last_change":"2023-10-16T20:09:01.228338+0000","last_active":"2023-10-16T20:09:01.228338+0000","last_peered":"2023-10-16T20:09:01.228338+0000","last_clean":"2023-10-16T20:09:01.228338+0000","last_became_active":"2023-10-16T20:07:53.054421+0000","last_became_peered":"2023-10-16T20:07:53.054421+0000","last_unstale":"2023-10-16T20:09:01.228338+0000","last_undegraded":"2023-10-16T20:09:01.228338+0000","last_fullsized":"2023-10-16T20:09:01.228338+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.228154+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.228154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:35:58.252474+0000","scrub_duration":0.0015816280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.475212+0000","last_change":"2023-10-16T20:08:29.475212+0000","last_active":"2023-10-16T20:08:29.475212+0000","last_peered":"2023-10-16T20:08:29.475212+0000","last_clean":"2023-10-16T20:08:29.475212+0000","last_became_active":"2023-10-16T20:07:53.038289+0000","last_became_peered":"2023-10-16T20:07:53.038289+0000","last_unstale":"2023-10-16T20:08:29.475212+0000","last_undegraded":"2023-10-16T20:08:29.475212+0000","last_fullsized":"2023-10-16T20:08:29.475212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.475065+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.475065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:45.468305+0000","scrub_duration":0.001407791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.504181+0000","last_change":"2023-10-16T20:08:21.504181+0000","last_active":"2023-10-16T20:08:21.504181+0000","last_peered":"2023-10-16T20:08:21.504181+0000","last_clean":"2023-10-16T20:08:21.504181+0000","last_became_active":"2023-10-16T20:07:53.036244+0000","last_became_peered":"2023-10-16T20:07:53.036244+0000","last_unstale":"2023-10-16T20:08:21.504181+0000","last_undegraded":"2023-10-16T20:08:21.504181+0000","last_fullsized":"2023-10-16T20:08:21.504181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.504033+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.504033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:26:48.803293+0000","scrub_duration":0.001563027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.354283+0000","last_change":"2023-10-16T20:08:37.354283+0000","last_active":"2023-10-16T20:08:37.354283+0000","last_peered":"2023-10-16T20:08:37.354283+0000","last_clean":"2023-10-16T20:08:37.354283+0000","last_became_active":"2023-10-16T20:07:53.037574+0000","last_became_peered":"2023-10-16T20:07:53.037574+0000","last_unstale":"2023-10-16T20:08:37.354283+0000","last_undegraded":"2023-10-16T20:08:37.354283+0000","last_fullsized":"2023-10-16T20:08:37.354283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.354136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.354136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:39:59.040252+0000","scrub_duration":0.001478345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.895446+0000","last_change":"2023-10-16T20:08:38.895446+0000","last_active":"2023-10-16T20:08:38.895446+0000","last_peered":"2023-10-16T20:08:38.895446+0000","last_clean":"2023-10-16T20:08:38.895446+0000","last_became_active":"2023-10-16T20:07:53.034008+0000","last_became_peered":"2023-10-16T20:07:53.034008+0000","last_unstale":"2023-10-16T20:08:38.895446+0000","last_undegraded":"2023-10-16T20:08:38.895446+0000","last_fullsized":"2023-10-16T20:08:38.895446+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.895236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.895236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:44:25.616614+0000","scrub_duration":0.001975353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:42.399735+0000","last_change":"2023-10-16T20:08:42.399735+0000","last_active":"2023-10-16T20:08:42.399735+0000","last_peered":"2023-10-16T20:08:42.399735+0000","last_clean":"2023-10-16T20:08:42.399735+0000","last_became_active":"2023-10-16T20:07:53.036509+0000","last_became_peered":"2023-10-16T20:07:53.036509+0000","last_unstale":"2023-10-16T20:08:42.399735+0000","last_undegraded":"2023-10-16T20:08:42.399735+0000","last_fullsized":"2023-10-16T20:08:42.399735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:42.399521+0000","last_clean_scrub_stamp":"2023-10-16T20:08:42.399521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:25.697975+0000","scrub_duration":0.0018795120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:59.184786+0000","last_change":"2023-10-16T20:08:59.184786+0000","last_active":"2023-10-16T20:08:59.184786+0000","last_peered":"2023-10-16T20:08:59.184786+0000","last_clean":"2023-10-16T20:08:59.184786+0000","last_became_active":"2023-10-16T20:07:53.056099+0000","last_became_peered":"2023-10-16T20:07:53.056099+0000","last_unstale":"2023-10-16T20:08:59.184786+0000","last_undegraded":"2023-10-16T20:08:59.184786+0000","last_fullsized":"2023-10-16T20:08:59.184786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:59.184635+0000","last_clean_scrub_stamp":"2023-10-16T20:08:59.184635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:03:18.306222+0000","scrub_duration":0.001870093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.544254+0000","last_change":"2023-10-16T20:08:14.544254+0000","last_active":"2023-10-16T20:08:14.544254+0000","last_peered":"2023-10-16T20:08:14.544254+0000","last_clean":"2023-10-16T20:08:14.544254+0000","last_became_active":"2023-10-16T20:07:53.049402+0000","last_became_peered":"2023-10-16T20:07:53.049402+0000","last_unstale":"2023-10-16T20:08:14.544254+0000","last_undegraded":"2023-10-16T20:08:14.544254+0000","last_fullsized":"2023-10-16T20:08:14.544254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.544070+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.544070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:23:10.990058+0000","scrub_duration":0.002102928,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.494697+0000","last_change":"2023-10-16T20:08:30.494697+0000","last_active":"2023-10-16T20:08:30.494697+0000","last_peered":"2023-10-16T20:08:30.494697+0000","last_clean":"2023-10-16T20:08:30.494697+0000","last_became_active":"2023-10-16T20:07:53.044510+0000","last_became_peered":"2023-10-16T20:07:53.044510+0000","last_unstale":"2023-10-16T20:08:30.494697+0000","last_undegraded":"2023-10-16T20:08:30.494697+0000","last_fullsized":"2023-10-16T20:08:30.494697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:30.494532+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.494532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:15:34.963761+0000","scrub_duration":0.0020301020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.161664+0000","last_change":"2023-10-16T20:08:23.161664+0000","last_active":"2023-10-16T20:08:23.161664+0000","last_peered":"2023-10-16T20:08:23.161664+0000","last_clean":"2023-10-16T20:08:23.161664+0000","last_became_active":"2023-10-16T20:07:53.041223+0000","last_became_peered":"2023-10-16T20:07:53.041223+0000","last_unstale":"2023-10-16T20:08:23.161664+0000","last_undegraded":"2023-10-16T20:08:23.161664+0000","last_fullsized":"2023-10-16T20:08:23.161664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.161504+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.161504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:13.925615+0000","scrub_duration":0.0020654150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:36.392497+0000","last_change":"2023-10-16T20:08:36.392497+0000","last_active":"2023-10-16T20:08:36.392497+0000","last_peered":"2023-10-16T20:08:36.392497+0000","last_clean":"2023-10-16T20:08:36.392497+0000","last_became_active":"2023-10-16T20:07:53.037640+0000","last_became_peered":"2023-10-16T20:07:53.037640+0000","last_unstale":"2023-10-16T20:08:36.392497+0000","last_undegraded":"2023-10-16T20:08:36.392497+0000","last_fullsized":"2023-10-16T20:08:36.392497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:36.392313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:36.392313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:17.859041+0000","scrub_duration":0.0022410350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:49.889971+0000","last_change":"2023-10-16T20:08:49.889971+0000","last_active":"2023-10-16T20:08:49.889971+0000","last_peered":"2023-10-16T20:08:49.889971+0000","last_clean":"2023-10-16T20:08:49.889971+0000","last_became_active":"2023-10-16T20:07:53.041076+0000","last_became_peered":"2023-10-16T20:07:53.041076+0000","last_unstale":"2023-10-16T20:08:49.889971+0000","last_undegraded":"2023-10-16T20:08:49.889971+0000","last_fullsized":"2023-10-16T20:08:49.889971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:49.889748+0000","last_clean_scrub_stamp":"2023-10-16T20:08:49.889748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:32.918998+0000","scrub_duration":0.0019966530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.409846+0000","last_change":"2023-10-16T20:08:27.409846+0000","last_active":"2023-10-16T20:08:27.409846+0000","last_peered":"2023-10-16T20:08:27.409846+0000","last_clean":"2023-10-16T20:08:27.409846+0000","last_became_active":"2023-10-16T20:07:53.036079+0000","last_became_peered":"2023-10-16T20:07:53.036079+0000","last_unstale":"2023-10-16T20:08:27.409846+0000","last_undegraded":"2023-10-16T20:08:27.409846+0000","last_fullsized":"2023-10-16T20:08:27.409846+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.409687+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.409687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:17:57.927026+0000","scrub_duration":0.0021036230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.423138+0000","last_change":"2023-10-16T20:08:24.423138+0000","last_active":"2023-10-16T20:08:24.423138+0000","last_peered":"2023-10-16T20:08:24.423138+0000","last_clean":"2023-10-16T20:08:24.423138+0000","last_became_active":"2023-10-16T20:07:53.043946+0000","last_became_peered":"2023-10-16T20:07:53.043946+0000","last_unstale":"2023-10-16T20:08:24.423138+0000","last_undegraded":"2023-10-16T20:08:24.423138+0000","last_fullsized":"2023-10-16T20:08:24.423138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.422932+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.422932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:05.709362+0000","scrub_duration":0.0019662490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:04.188950+0000","last_change":"2023-10-16T20:09:04.188950+0000","last_active":"2023-10-16T20:09:04.188950+0000","last_peered":"2023-10-16T20:09:04.188950+0000","last_clean":"2023-10-16T20:09:04.188950+0000","last_became_active":"2023-10-16T20:07:53.054244+0000","last_became_peered":"2023-10-16T20:07:53.054244+0000","last_unstale":"2023-10-16T20:09:04.188950+0000","last_undegraded":"2023-10-16T20:09:04.188950+0000","last_fullsized":"2023-10-16T20:09:04.188950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:04.188791+0000","last_clean_scrub_stamp":"2023-10-16T20:09:04.188791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:08:43.208475+0000","scrub_duration":0.00212918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.158114+0000","last_change":"2023-10-16T20:08:29.158114+0000","last_active":"2023-10-16T20:08:29.158114+0000","last_peered":"2023-10-16T20:08:29.158114+0000","last_clean":"2023-10-16T20:08:29.158114+0000","last_became_active":"2023-10-16T20:07:53.033241+0000","last_became_peered":"2023-10-16T20:07:53.033241+0000","last_unstale":"2023-10-16T20:08:29.158114+0000","last_undegraded":"2023-10-16T20:08:29.158114+0000","last_fullsized":"2023-10-16T20:08:29.158114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.157892+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.157892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:14.196436+0000","scrub_duration":0.001773541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:35.306622+0000","last_change":"2023-10-16T20:08:35.306622+0000","last_active":"2023-10-16T20:08:35.306622+0000","last_peered":"2023-10-16T20:08:35.306622+0000","last_clean":"2023-10-16T20:08:35.306622+0000","last_became_active":"2023-10-16T20:07:53.054332+0000","last_became_peered":"2023-10-16T20:07:53.054332+0000","last_unstale":"2023-10-16T20:08:35.306622+0000","last_undegraded":"2023-10-16T20:08:35.306622+0000","last_fullsized":"2023-10-16T20:08:35.306622+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:35.306487+0000","last_clean_scrub_stamp":"2023-10-16T20:08:35.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:28:23.204769+0000","scrub_duration":0.001571879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.439579+0000","last_change":"2023-10-16T20:08:23.439579+0000","last_active":"2023-10-16T20:08:23.439579+0000","last_peered":"2023-10-16T20:08:23.439579+0000","last_clean":"2023-10-16T20:08:23.439579+0000","last_became_active":"2023-10-16T20:07:52.033731+0000","last_became_peered":"2023-10-16T20:07:52.033731+0000","last_unstale":"2023-10-16T20:08:23.439579+0000","last_undegraded":"2023-10-16T20:08:23.439579+0000","last_fullsized":"2023-10-16T20:08:23.439579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'6","last_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_deep_scrub":"43'6","last_deep_scrub_stamp":"2023-10-16T20:08:23.439425+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.439425+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:45.931921+0000","scrub_duration":0.004237864,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.102316+0000","last_change":"2023-10-16T20:08:31.102316+0000","last_active":"2023-10-16T20:08:31.102316+0000","last_peered":"2023-10-16T20:08:31.102316+0000","last_clean":"2023-10-16T20:08:31.102316+0000","last_became_active":"2023-10-16T20:07:53.041178+0000","last_became_peered":"2023-10-16T20:07:53.041178+0000","last_unstale":"2023-10-16T20:08:31.102316+0000","last_undegraded":"2023-10-16T20:08:31.102316+0000","last_fullsized":"2023-10-16T20:08:31.102316+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.102154+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.102154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:16:13.593591+0000","scrub_duration":0.0020746969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100492+0000","last_change":"2023-10-16T20:08:10.448020+0000","last_active":"2023-10-16T20:08:14.100492+0000","last_peered":"2023-10-16T20:08:14.100492+0000","last_clean":"2023-10-16T20:08:14.100492+0000","last_became_active":"2023-10-16T20:07:52.036154+0000","last_became_peered":"2023-10-16T20:07:52.036154+0000","last_unstale":"2023-10-16T20:08:14.100492+0000","last_undegraded":"2023-10-16T20:08:14.100492+0000","last_fullsized":"2023-10-16T20:08:14.100492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.447914+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.447914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:28.021772+0000","scrub_duration":0.0021724119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:38.386428+0000","last_change":"2023-10-16T20:08:38.386428+0000","last_active":"2023-10-16T20:08:38.386428+0000","last_peered":"2023-10-16T20:08:38.386428+0000","last_clean":"2023-10-16T20:08:38.386428+0000","last_became_active":"2023-10-16T20:07:53.036617+0000","last_became_peered":"2023-10-16T20:07:53.036617+0000","last_unstale":"2023-10-16T20:08:38.386428+0000","last_undegraded":"2023-10-16T20:08:38.386428+0000","last_fullsized":"2023-10-16T20:08:38.386428+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:38.386262+0000","last_clean_scrub_stamp":"2023-10-16T20:08:38.386262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:53:19.852990+0000","scrub_duration":0.0016026160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.255111+0000","last_change":"2023-10-16T20:08:15.255111+0000","last_active":"2023-10-16T20:08:15.255111+0000","last_peered":"2023-10-16T20:08:15.255111+0000","last_clean":"2023-10-16T20:08:15.255111+0000","last_became_active":"2023-10-16T20:07:52.032935+0000","last_became_peered":"2023-10-16T20:07:52.032935+0000","last_unstale":"2023-10-16T20:08:15.255111+0000","last_undegraded":"2023-10-16T20:08:15.255111+0000","last_fullsized":"2023-10-16T20:08:15.255111+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:15.254952+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.254952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:33:55.049794+0000","scrub_duration":0.0023765629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:02.798211+0000","last_change":"2023-10-16T20:09:02.798211+0000","last_active":"2023-10-16T20:09:02.798211+0000","last_peered":"2023-10-16T20:09:02.798211+0000","last_clean":"2023-10-16T20:09:02.798211+0000","last_became_active":"2023-10-16T20:07:53.037443+0000","last_became_peered":"2023-10-16T20:07:53.037443+0000","last_unstale":"2023-10-16T20:09:02.798211+0000","last_undegraded":"2023-10-16T20:09:02.798211+0000","last_fullsized":"2023-10-16T20:09:02.798211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:02.798035+0000","last_clean_scrub_stamp":"2023-10-16T20:09:02.798035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:07:46.787871+0000","scrub_duration":0.0019661269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:22.428287+0000","last_change":"2023-10-16T20:08:22.428287+0000","last_active":"2023-10-16T20:08:22.428287+0000","last_peered":"2023-10-16T20:08:22.428287+0000","last_clean":"2023-10-16T20:08:22.428287+0000","last_became_active":"2023-10-16T20:07:52.041089+0000","last_became_peered":"2023-10-16T20:07:52.041089+0000","last_unstale":"2023-10-16T20:08:22.428287+0000","last_undegraded":"2023-10-16T20:08:22.428287+0000","last_fullsized":"2023-10-16T20:08:22.428287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:22.428142+0000","last_clean_scrub_stamp":"2023-10-16T20:08:22.428142+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:27:06.019308+0000","scrub_duration":0.0026081300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.528351+0000","last_change":"2023-10-16T20:08:29.528351+0000","last_active":"2023-10-16T20:08:29.528351+0000","last_peered":"2023-10-16T20:08:29.528351+0000","last_clean":"2023-10-16T20:08:29.528351+0000","last_became_active":"2023-10-16T20:07:53.031163+0000","last_became_peered":"2023-10-16T20:07:53.031163+0000","last_unstale":"2023-10-16T20:08:29.528351+0000","last_undegraded":"2023-10-16T20:08:29.528351+0000","last_fullsized":"2023-10-16T20:08:29.528351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.528210+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.528210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:09:05.933839+0000","scrub_duration":0.001469635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.920424+0000","last_change":"2023-10-16T20:08:15.920424+0000","last_active":"2023-10-16T20:08:15.920424+0000","last_peered":"2023-10-16T20:08:15.920424+0000","last_clean":"2023-10-16T20:08:15.920424+0000","last_became_active":"2023-10-16T20:07:52.036344+0000","last_became_peered":"2023-10-16T20:07:52.036344+0000","last_unstale":"2023-10-16T20:08:15.920424+0000","last_undegraded":"2023-10-16T20:08:15.920424+0000","last_fullsized":"2023-10-16T20:08:15.920424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:15.920245+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.920245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:52:57.386973+0000","scrub_duration":0.0022037419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:47.902525+0000","last_change":"2023-10-16T20:08:47.902525+0000","last_active":"2023-10-16T20:08:47.902525+0000","last_peered":"2023-10-16T20:08:47.902525+0000","last_clean":"2023-10-16T20:08:47.902525+0000","last_became_active":"2023-10-16T20:07:53.049126+0000","last_became_peered":"2023-10-16T20:07:53.049126+0000","last_unstale":"2023-10-16T20:08:47.902525+0000","last_undegraded":"2023-10-16T20:08:47.902525+0000","last_fullsized":"2023-10-16T20:08:47.902525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:47.902348+0000","last_clean_scrub_stamp":"2023-10-16T20:08:47.902348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:39:59.401881+0000","scrub_duration":0.001918484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.469649+0000","last_change":"2023-10-16T20:08:27.469649+0000","last_active":"2023-10-16T20:08:27.469649+0000","last_peered":"2023-10-16T20:08:27.469649+0000","last_clean":"2023-10-16T20:08:27.469649+0000","last_became_active":"2023-10-16T20:07:52.039004+0000","last_became_peered":"2023-10-16T20:07:52.039004+0000","last_unstale":"2023-10-16T20:08:27.469649+0000","last_undegraded":"2023-10-16T20:08:27.469649+0000","last_fullsized":"2023-10-16T20:08:27.469649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:27.469514+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.469514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:10.767968+0000","scrub_duration":0.00153217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:40.441196+0000","last_change":"2023-10-16T20:08:40.441196+0000","last_active":"2023-10-16T20:08:40.441196+0000","last_peered":"2023-10-16T20:08:40.441196+0000","last_clean":"2023-10-16T20:08:40.441196+0000","last_became_active":"2023-10-16T20:07:53.035348+0000","last_became_peered":"2023-10-16T20:07:53.035348+0000","last_unstale":"2023-10-16T20:08:40.441196+0000","last_undegraded":"2023-10-16T20:08:40.441196+0000","last_fullsized":"2023-10-16T20:08:40.441196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:40.441059+0000","last_clean_scrub_stamp":"2023-10-16T20:08:40.441059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:40.507219+0000","scrub_duration":0.001520286,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.248152+0000","last_change":"2023-10-16T20:08:14.248152+0000","last_active":"2023-10-16T20:08:14.248152+0000","last_peered":"2023-10-16T20:08:14.248152+0000","last_clean":"2023-10-16T20:08:14.248152+0000","last_became_active":"2023-10-16T20:07:52.035375+0000","last_became_peered":"2023-10-16T20:07:52.035375+0000","last_unstale":"2023-10-16T20:08:14.248152+0000","last_undegraded":"2023-10-16T20:08:14.248152+0000","last_fullsized":"2023-10-16T20:08:14.248152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:14.247965+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.247965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:31:33.082340+0000","scrub_duration":0.0020567329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:56.745521+0000","last_change":"2023-10-16T20:08:56.745521+0000","last_active":"2023-10-16T20:08:56.745521+0000","last_peered":"2023-10-16T20:08:56.745521+0000","last_clean":"2023-10-16T20:08:56.745521+0000","last_became_active":"2023-10-16T20:07:53.051142+0000","last_became_peered":"2023-10-16T20:07:53.051142+0000","last_unstale":"2023-10-16T20:08:56.745521+0000","last_undegraded":"2023-10-16T20:08:56.745521+0000","last_fullsized":"2023-10-16T20:08:56.745521+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:56.745298+0000","last_clean_scrub_stamp":"2023-10-16T20:08:56.745298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:29.644322+0000","scrub_duration":0.0021953860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:15.362444+0000","last_change":"2023-10-16T20:08:15.362444+0000","last_active":"2023-10-16T20:08:15.362444+0000","last_peered":"2023-10-16T20:08:15.362444+0000","last_clean":"2023-10-16T20:08:15.362444+0000","last_became_active":"2023-10-16T20:07:52.027938+0000","last_became_peered":"2023-10-16T20:07:52.027938+0000","last_unstale":"2023-10-16T20:08:15.362444+0000","last_undegraded":"2023-10-16T20:08:15.362444+0000","last_fullsized":"2023-10-16T20:08:15.362444+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:15.362306+0000","last_clean_scrub_stamp":"2023-10-16T20:08:15.362306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:24:35.725694+0000","scrub_duration":0.0015698050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.466549+0000","last_change":"2023-10-16T20:08:23.466549+0000","last_active":"2023-10-16T20:08:23.466549+0000","last_peered":"2023-10-16T20:08:23.466549+0000","last_clean":"2023-10-16T20:08:23.466549+0000","last_became_active":"2023-10-16T20:07:53.037853+0000","last_became_peered":"2023-10-16T20:07:53.037853+0000","last_unstale":"2023-10-16T20:08:23.466549+0000","last_undegraded":"2023-10-16T20:08:23.466549+0000","last_fullsized":"2023-10-16T20:08:23.466549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.466412+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.466412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:03.261255+0000","scrub_duration":0.001642255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498264+0000","last_change":"2023-10-16T20:08:11.728360+0000","last_active":"2023-10-16T20:08:14.498264+0000","last_peered":"2023-10-16T20:08:14.498264+0000","last_clean":"2023-10-16T20:08:14.498264+0000","last_became_active":"2023-10-16T20:07:52.043022+0000","last_became_peered":"2023-10-16T20:07:52.043022+0000","last_unstale":"2023-10-16T20:08:14.498264+0000","last_undegraded":"2023-10-16T20:08:14.498264+0000","last_fullsized":"2023-10-16T20:08:14.498264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:11.728236+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.728236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:42.001675+0000","scrub_duration":0.001331348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:57.217724+0000","last_change":"2023-10-16T20:08:57.217724+0000","last_active":"2023-10-16T20:08:57.217724+0000","last_peered":"2023-10-16T20:08:57.217724+0000","last_clean":"2023-10-16T20:08:57.217724+0000","last_became_active":"2023-10-16T20:07:53.047207+0000","last_became_peered":"2023-10-16T20:07:53.047207+0000","last_unstale":"2023-10-16T20:08:57.217724+0000","last_undegraded":"2023-10-16T20:08:57.217724+0000","last_fullsized":"2023-10-16T20:08:57.217724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:57.217543+0000","last_clean_scrub_stamp":"2023-10-16T20:08:57.217543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:35:34.245479+0000","scrub_duration":0.001512897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.950663+0000","last_change":"2023-10-16T20:08:17.950663+0000","last_active":"2023-10-16T20:08:17.950663+0000","last_peered":"2023-10-16T20:08:17.950663+0000","last_clean":"2023-10-16T20:08:17.950663+0000","last_became_active":"2023-10-16T20:07:52.040219+0000","last_became_peered":"2023-10-16T20:07:52.040219+0000","last_unstale":"2023-10-16T20:08:17.950663+0000","last_undegraded":"2023-10-16T20:08:17.950663+0000","last_fullsized":"2023-10-16T20:08:17.950663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:17.950490+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.950490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:42:26.244350+0000","scrub_duration":0.0020517310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:26.548260+0000","last_change":"2023-10-16T20:08:26.548260+0000","last_active":"2023-10-16T20:08:26.548260+0000","last_peered":"2023-10-16T20:08:26.548260+0000","last_clean":"2023-10-16T20:08:26.548260+0000","last_became_active":"2023-10-16T20:07:53.048024+0000","last_became_peered":"2023-10-16T20:07:53.048024+0000","last_unstale":"2023-10-16T20:08:26.548260+0000","last_undegraded":"2023-10-16T20:08:26.548260+0000","last_fullsized":"2023-10-16T20:08:26.548260+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:26.548111+0000","last_clean_scrub_stamp":"2023-10-16T20:08:26.548111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:56.821550+0000","scrub_duration":0.0021990820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.926605+0000","last_change":"2023-10-16T20:08:16.926605+0000","last_active":"2023-10-16T20:08:16.926605+0000","last_peered":"2023-10-16T20:08:16.926605+0000","last_clean":"2023-10-16T20:08:16.926605+0000","last_became_active":"2023-10-16T20:07:52.041088+0000","last_became_peered":"2023-10-16T20:07:52.041088+0000","last_unstale":"2023-10-16T20:08:16.926605+0000","last_undegraded":"2023-10-16T20:08:16.926605+0000","last_fullsized":"2023-10-16T20:08:16.926605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-10-16T20:08:16.926415+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.926415+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:16.992575+0000","scrub_duration":0.0028011120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.406378+0000","last_change":"2023-10-16T20:08:32.406378+0000","last_active":"2023-10-16T20:08:32.406378+0000","last_peered":"2023-10-16T20:08:32.406378+0000","last_clean":"2023-10-16T20:08:32.406378+0000","last_became_active":"2023-10-16T20:07:53.034169+0000","last_became_peered":"2023-10-16T20:07:53.034169+0000","last_unstale":"2023-10-16T20:08:32.406378+0000","last_undegraded":"2023-10-16T20:08:32.406378+0000","last_fullsized":"2023-10-16T20:08:32.406378+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.406194+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.406194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:45:38.906720+0000","scrub_duration":0.001807101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.713058+0000","last_change":"2023-10-16T20:08:14.713058+0000","last_active":"2023-10-16T20:08:14.713058+0000","last_peered":"2023-10-16T20:08:14.713058+0000","last_clean":"2023-10-16T20:08:14.713058+0000","last_became_active":"2023-10-16T20:07:52.040241+0000","last_became_peered":"2023-10-16T20:07:52.040241+0000","last_unstale":"2023-10-16T20:08:14.713058+0000","last_undegraded":"2023-10-16T20:08:14.713058+0000","last_fullsized":"2023-10-16T20:08:14.713058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'6","last_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_deep_scrub":"40'6","last_deep_scrub_stamp":"2023-10-16T20:08:14.712915+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.712915+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:08:51.118545+0000","scrub_duration":0.0030310509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:34.563241+0000","last_change":"2023-10-16T20:08:34.563241+0000","last_active":"2023-10-16T20:08:34.563241+0000","last_peered":"2023-10-16T20:08:34.563241+0000","last_clean":"2023-10-16T20:08:34.563241+0000","last_became_active":"2023-10-16T20:07:53.048629+0000","last_became_peered":"2023-10-16T20:07:53.048629+0000","last_unstale":"2023-10-16T20:08:34.563241+0000","last_undegraded":"2023-10-16T20:08:34.563241+0000","last_fullsized":"2023-10-16T20:08:34.563241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:34.563087+0000","last_clean_scrub_stamp":"2023-10-16T20:08:34.563087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:16.854659+0000","scrub_duration":0.0019598950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498231+0000","last_change":"2023-10-16T20:08:13.742868+0000","last_active":"2023-10-16T20:08:14.498231+0000","last_peered":"2023-10-16T20:08:14.498231+0000","last_clean":"2023-10-16T20:08:14.498231+0000","last_became_active":"2023-10-16T20:07:52.039942+0000","last_became_peered":"2023-10-16T20:07:52.039942+0000","last_unstale":"2023-10-16T20:08:14.498231+0000","last_undegraded":"2023-10-16T20:08:14.498231+0000","last_fullsized":"2023-10-16T20:08:14.498231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:13.742671+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.742671+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:19.483158+0000","scrub_duration":0.0021545700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.675201+0000","last_change":"2023-10-16T20:08:16.675201+0000","last_active":"2023-10-16T20:08:16.675201+0000","last_peered":"2023-10-16T20:08:16.675201+0000","last_clean":"2023-10-16T20:08:16.675201+0000","last_became_active":"2023-10-16T20:07:53.031322+0000","last_became_peered":"2023-10-16T20:07:53.031322+0000","last_unstale":"2023-10-16T20:08:16.675201+0000","last_undegraded":"2023-10-16T20:08:16.675201+0000","last_fullsized":"2023-10-16T20:08:16.675201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.675020+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.675020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:23:49.526617+0000","scrub_duration":0.001445163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:19.235554+0000","last_change":"2023-10-16T20:08:19.235554+0000","last_active":"2023-10-16T20:08:19.235554+0000","last_peered":"2023-10-16T20:08:19.235554+0000","last_clean":"2023-10-16T20:08:19.235554+0000","last_became_active":"2023-10-16T20:07:52.037934+0000","last_became_peered":"2023-10-16T20:07:52.037934+0000","last_unstale":"2023-10-16T20:08:19.235554+0000","last_undegraded":"2023-10-16T20:08:19.235554+0000","last_fullsized":"2023-10-16T20:08:19.235554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:19.235408+0000","last_clean_scrub_stamp":"2023-10-16T20:08:19.235408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:19:16.450339+0000","scrub_duration":0.0021356420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.333836+0000","last_change":"2023-10-16T20:08:32.333836+0000","last_active":"2023-10-16T20:08:32.333836+0000","last_peered":"2023-10-16T20:08:32.333836+0000","last_clean":"2023-10-16T20:08:32.333836+0000","last_became_active":"2023-10-16T20:07:53.056250+0000","last_became_peered":"2023-10-16T20:07:53.056250+0000","last_unstale":"2023-10-16T20:08:32.333836+0000","last_undegraded":"2023-10-16T20:08:32.333836+0000","last_fullsized":"2023-10-16T20:08:32.333836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.333657+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.333657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:02.562795+0000","scrub_duration":0.0019526680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:21.486471+0000","last_change":"2023-10-16T20:08:21.486471+0000","last_active":"2023-10-16T20:08:21.486471+0000","last_peered":"2023-10-16T20:08:21.486471+0000","last_clean":"2023-10-16T20:08:21.486471+0000","last_became_active":"2023-10-16T20:07:52.033065+0000","last_became_peered":"2023-10-16T20:07:52.033065+0000","last_unstale":"2023-10-16T20:08:21.486471+0000","last_undegraded":"2023-10-16T20:08:21.486471+0000","last_fullsized":"2023-10-16T20:08:21.486471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:21.486313+0000","last_clean_scrub_stamp":"2023-10-16T20:08:21.486313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:27.520320+0000","scrub_duration":0.0016356879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.663954+0000","last_change":"2023-10-16T20:08:20.663954+0000","last_active":"2023-10-16T20:08:20.663954+0000","last_peered":"2023-10-16T20:08:20.663954+0000","last_clean":"2023-10-16T20:08:20.663954+0000","last_became_active":"2023-10-16T20:07:53.029671+0000","last_became_peered":"2023-10-16T20:07:53.029671+0000","last_unstale":"2023-10-16T20:08:20.663954+0000","last_undegraded":"2023-10-16T20:08:20.663954+0000","last_fullsized":"2023-10-16T20:08:20.663954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.663817+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.663817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:19.213429+0000","scrub_duration":0.001504081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:17.713903+0000","last_change":"2023-10-16T20:08:17.713903+0000","last_active":"2023-10-16T20:08:17.713903+0000","last_peered":"2023-10-16T20:08:17.713903+0000","last_clean":"2023-10-16T20:08:17.713903+0000","last_became_active":"2023-10-16T20:07:52.038813+0000","last_became_peered":"2023-10-16T20:07:52.038813+0000","last_unstale":"2023-10-16T20:08:17.713903+0000","last_undegraded":"2023-10-16T20:08:17.713903+0000","last_fullsized":"2023-10-16T20:08:17.713903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'8","last_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_deep_scrub":"40'8","last_deep_scrub_stamp":"2023-10-16T20:08:17.713704+0000","last_clean_scrub_stamp":"2023-10-16T20:08:17.713704+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:33.499640+0000","scrub_duration":0.002654361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.777282+0000","last_change":"2023-10-16T20:08:27.777282+0000","last_active":"2023-10-16T20:08:27.777282+0000","last_peered":"2023-10-16T20:08:27.777282+0000","last_clean":"2023-10-16T20:08:27.777282+0000","last_became_active":"2023-10-16T20:07:53.037373+0000","last_became_peered":"2023-10-16T20:07:53.037373+0000","last_unstale":"2023-10-16T20:08:27.777282+0000","last_undegraded":"2023-10-16T20:08:27.777282+0000","last_fullsized":"2023-10-16T20:08:27.777282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.777076+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.777076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:44:02.467931+0000","scrub_duration":0.001724361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:30.018874+0000","last_change":"2023-10-16T20:08:30.018874+0000","last_active":"2023-10-16T20:08:30.018874+0000","last_peered":"2023-10-16T20:08:30.018874+0000","last_clean":"2023-10-16T20:08:30.018874+0000","last_became_active":"2023-10-16T20:07:52.037988+0000","last_became_peered":"2023-10-16T20:07:52.037988+0000","last_unstale":"2023-10-16T20:08:30.018874+0000","last_undegraded":"2023-10-16T20:08:30.018874+0000","last_fullsized":"2023-10-16T20:08:30.018874+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2023-10-16T20:08:30.018725+0000","last_clean_scrub_stamp":"2023-10-16T20:08:30.018725+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:27.195152+0000","scrub_duration":0.0029286009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.948121+0000","last_change":"2023-10-16T20:08:31.948121+0000","last_active":"2023-10-16T20:08:31.948121+0000","last_peered":"2023-10-16T20:08:31.948121+0000","last_clean":"2023-10-16T20:08:31.948121+0000","last_became_active":"2023-10-16T20:07:53.040353+0000","last_became_peered":"2023-10-16T20:07:53.040353+0000","last_unstale":"2023-10-16T20:08:31.948121+0000","last_undegraded":"2023-10-16T20:08:31.948121+0000","last_fullsized":"2023-10-16T20:08:31.948121+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.947913+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.947913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:11:19.200900+0000","scrub_duration":0.002362173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.504725+0000","last_change":"2023-10-16T20:08:24.504725+0000","last_active":"2023-10-16T20:08:24.504725+0000","last_peered":"2023-10-16T20:08:24.504725+0000","last_clean":"2023-10-16T20:08:24.504725+0000","last_became_active":"2023-10-16T20:07:52.038708+0000","last_became_peered":"2023-10-16T20:07:52.038708+0000","last_unstale":"2023-10-16T20:08:24.504725+0000","last_undegraded":"2023-10-16T20:08:24.504725+0000","last_fullsized":"2023-10-16T20:08:24.504725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2023-10-16T20:08:24.504595+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.504595+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:59:46.997090+0000","scrub_duration":0.0029734819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:27.456890+0000","last_change":"2023-10-16T20:08:27.456890+0000","last_active":"2023-10-16T20:08:27.456890+0000","last_peered":"2023-10-16T20:08:27.456890+0000","last_clean":"2023-10-16T20:08:27.456890+0000","last_became_active":"2023-10-16T20:07:53.032576+0000","last_became_peered":"2023-10-16T20:07:53.032576+0000","last_unstale":"2023-10-16T20:08:27.456890+0000","last_undegraded":"2023-10-16T20:08:27.456890+0000","last_fullsized":"2023-10-16T20:08:27.456890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:27.456767+0000","last_clean_scrub_stamp":"2023-10-16T20:08:27.456767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:02:08.743197+0000","scrub_duration":0.0016827669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498305+0000","last_change":"2023-10-16T20:08:11.592807+0000","last_active":"2023-10-16T20:08:14.498305+0000","last_peered":"2023-10-16T20:08:14.498305+0000","last_clean":"2023-10-16T20:08:14.498305+0000","last_became_active":"2023-10-16T20:07:52.036072+0000","last_became_peered":"2023-10-16T20:07:52.036072+0000","last_unstale":"2023-10-16T20:08:14.498305+0000","last_undegraded":"2023-10-16T20:08:14.498305+0000","last_fullsized":"2023-10-16T20:08:14.498305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1","last_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_deep_scrub":"40'1","last_deep_scrub_stamp":"2023-10-16T20:08:11.592618+0000","last_clean_scrub_stamp":"2023-10-16T20:08:11.592618+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:49:28.835983+0000","scrub_duration":0.0023944069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:16.482406+0000","last_change":"2023-10-16T20:08:16.482406+0000","last_active":"2023-10-16T20:08:16.482406+0000","last_peered":"2023-10-16T20:08:16.482406+0000","last_clean":"2023-10-16T20:08:16.482406+0000","last_became_active":"2023-10-16T20:07:53.039229+0000","last_became_peered":"2023-10-16T20:07:53.039229+0000","last_unstale":"2023-10-16T20:08:16.482406+0000","last_undegraded":"2023-10-16T20:08:16.482406+0000","last_fullsized":"2023-10-16T20:08:16.482406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:16.482261+0000","last_clean_scrub_stamp":"2023-10-16T20:08:16.482261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:14.465388+0000","scrub_duration":0.0014984589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.190567+0000","last_change":"2023-10-16T20:08:20.190567+0000","last_active":"2023-10-16T20:08:20.190567+0000","last_peered":"2023-10-16T20:08:20.190567+0000","last_clean":"2023-10-16T20:08:20.190567+0000","last_became_active":"2023-10-16T20:07:52.034798+0000","last_became_peered":"2023-10-16T20:07:52.034798+0000","last_unstale":"2023-10-16T20:08:20.190567+0000","last_undegraded":"2023-10-16T20:08:20.190567+0000","last_fullsized":"2023-10-16T20:08:20.190567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.190375+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.190375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:31.465537+0000","scrub_duration":0.0021221130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:58.208196+0000","last_change":"2023-10-16T20:08:58.208196+0000","last_active":"2023-10-16T20:08:58.208196+0000","last_peered":"2023-10-16T20:08:58.208196+0000","last_clean":"2023-10-16T20:08:58.208196+0000","last_became_active":"2023-10-16T20:07:53.056711+0000","last_became_peered":"2023-10-16T20:07:53.056711+0000","last_unstale":"2023-10-16T20:08:58.208196+0000","last_undegraded":"2023-10-16T20:08:58.208196+0000","last_fullsized":"2023-10-16T20:08:58.208196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:58.208044+0000","last_clean_scrub_stamp":"2023-10-16T20:08:58.208044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:05:39.605592+0000","scrub_duration":0.0020642799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497936+0000","last_change":"2023-10-16T20:08:09.627083+0000","last_active":"2023-10-16T20:08:14.497936+0000","last_peered":"2023-10-16T20:08:14.497936+0000","last_clean":"2023-10-16T20:08:14.497936+0000","last_became_active":"2023-10-16T20:07:52.035264+0000","last_became_peered":"2023-10-16T20:07:52.035264+0000","last_unstale":"2023-10-16T20:08:14.497936+0000","last_undegraded":"2023-10-16T20:08:14.497936+0000","last_fullsized":"2023-10-16T20:08:14.497936+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:09.626969+0000","last_clean_scrub_stamp":"2023-10-16T20:08:09.626969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:33.130298+0000","scrub_duration":0.00183387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.465827+0000","last_change":"2023-10-16T20:08:23.465827+0000","last_active":"2023-10-16T20:08:23.465827+0000","last_peered":"2023-10-16T20:08:23.465827+0000","last_clean":"2023-10-16T20:08:23.465827+0000","last_became_active":"2023-10-16T20:07:53.047872+0000","last_became_peered":"2023-10-16T20:07:53.047872+0000","last_unstale":"2023-10-16T20:08:23.465827+0000","last_undegraded":"2023-10-16T20:08:23.465827+0000","last_fullsized":"2023-10-16T20:08:23.465827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.465645+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.465645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:59:05.072528+0000","scrub_duration":0.001932645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.498361+0000","last_change":"2023-10-16T20:08:12.563298+0000","last_active":"2023-10-16T20:08:14.498361+0000","last_peered":"2023-10-16T20:08:14.498361+0000","last_clean":"2023-10-16T20:08:14.498361+0000","last_became_active":"2023-10-16T20:07:52.033726+0000","last_became_peered":"2023-10-16T20:07:52.033726+0000","last_unstale":"2023-10-16T20:08:14.498361+0000","last_undegraded":"2023-10-16T20:08:14.498361+0000","last_fullsized":"2023-10-16T20:08:14.498361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.563187+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.563187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:58:48.030255+0000","scrub_duration":0.0015880569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.918575+0000","last_change":"2023-10-16T20:08:32.918575+0000","last_active":"2023-10-16T20:08:32.918575+0000","last_peered":"2023-10-16T20:08:32.918575+0000","last_clean":"2023-10-16T20:08:32.918575+0000","last_became_active":"2023-10-16T20:07:53.036238+0000","last_became_peered":"2023-10-16T20:07:53.036238+0000","last_unstale":"2023-10-16T20:08:32.918575+0000","last_undegraded":"2023-10-16T20:08:32.918575+0000","last_fullsized":"2023-10-16T20:08:32.918575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.918430+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.918430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:12:31.418288+0000","scrub_duration":0.001503618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:24.581879+0000","last_change":"2023-10-16T20:08:24.581879+0000","last_active":"2023-10-16T20:08:24.581879+0000","last_peered":"2023-10-16T20:08:24.581879+0000","last_clean":"2023-10-16T20:08:24.581879+0000","last_became_active":"2023-10-16T20:07:52.039429+0000","last_became_peered":"2023-10-16T20:07:52.039429+0000","last_unstale":"2023-10-16T20:08:24.581879+0000","last_undegraded":"2023-10-16T20:08:24.581879+0000","last_fullsized":"2023-10-16T20:08:24.581879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:24.581744+0000","last_clean_scrub_stamp":"2023-10-16T20:08:24.581744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:09:24.647904+0000","scrub_duration":0.0014213159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:46.690496+0000","last_change":"2023-10-16T20:08:46.690496+0000","last_active":"2023-10-16T20:08:46.690496+0000","last_peered":"2023-10-16T20:08:46.690496+0000","last_clean":"2023-10-16T20:08:46.690496+0000","last_became_active":"2023-10-16T20:07:53.051012+0000","last_became_peered":"2023-10-16T20:07:53.051012+0000","last_unstale":"2023-10-16T20:08:46.690496+0000","last_undegraded":"2023-10-16T20:08:46.690496+0000","last_fullsized":"2023-10-16T20:08:46.690496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:46.690300+0000","last_clean_scrub_stamp":"2023-10-16T20:08:46.690300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:50.998090+0000","scrub_duration":0.0020345459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497712+0000","last_change":"2023-10-16T20:08:13.573398+0000","last_active":"2023-10-16T20:08:14.497712+0000","last_peered":"2023-10-16T20:08:14.497712+0000","last_clean":"2023-10-16T20:08:14.497712+0000","last_became_active":"2023-10-16T20:07:52.037053+0000","last_became_peered":"2023-10-16T20:07:52.037053+0000","last_unstale":"2023-10-16T20:08:14.497712+0000","last_undegraded":"2023-10-16T20:08:14.497712+0000","last_fullsized":"2023-10-16T20:08:14.497712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:13.573216+0000","last_clean_scrub_stamp":"2023-10-16T20:08:13.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:33:46.689343+0000","scrub_duration":0.00140446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:33.148089+0000","last_change":"2023-10-16T20:08:33.148089+0000","last_active":"2023-10-16T20:08:33.148089+0000","last_peered":"2023-10-16T20:08:33.148089+0000","last_clean":"2023-10-16T20:08:33.148089+0000","last_became_active":"2023-10-16T20:07:53.041759+0000","last_became_peered":"2023-10-16T20:07:53.041759+0000","last_unstale":"2023-10-16T20:08:33.148089+0000","last_undegraded":"2023-10-16T20:08:33.148089+0000","last_fullsized":"2023-10-16T20:08:33.148089+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:33.147922+0000","last_clean_scrub_stamp":"2023-10-16T20:08:33.147922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:49.271392+0000","scrub_duration":0.0018772350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.974975+0000","last_change":"2023-10-16T20:08:20.974975+0000","last_active":"2023-10-16T20:08:20.974975+0000","last_peered":"2023-10-16T20:08:20.974975+0000","last_clean":"2023-10-16T20:08:20.974975+0000","last_became_active":"2023-10-16T20:07:52.043310+0000","last_became_peered":"2023-10-16T20:07:52.043310+0000","last_unstale":"2023-10-16T20:08:20.974975+0000","last_undegraded":"2023-10-16T20:08:20.974975+0000","last_fullsized":"2023-10-16T20:08:20.974975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2","last_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_deep_scrub":"40'2","last_deep_scrub_stamp":"2023-10-16T20:08:20.974832+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.974832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:36:04.273286+0000","scrub_duration":0.001795334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:53.311276+0000","last_change":"2023-10-16T20:08:53.311276+0000","last_active":"2023-10-16T20:08:53.311276+0000","last_peered":"2023-10-16T20:08:53.311276+0000","last_clean":"2023-10-16T20:08:53.311276+0000","last_became_active":"2023-10-16T20:07:53.047195+0000","last_became_peered":"2023-10-16T20:07:53.047195+0000","last_unstale":"2023-10-16T20:08:53.311276+0000","last_undegraded":"2023-10-16T20:08:53.311276+0000","last_fullsized":"2023-10-16T20:08:53.311276+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:53.311136+0000","last_clean_scrub_stamp":"2023-10-16T20:08:53.311136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:40:04.810669+0000","scrub_duration":0.0015476590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497822+0000","last_change":"2023-10-16T20:08:10.579873+0000","last_active":"2023-10-16T20:08:14.497822+0000","last_peered":"2023-10-16T20:08:14.497822+0000","last_clean":"2023-10-16T20:08:14.497822+0000","last_became_active":"2023-10-16T20:07:52.038274+0000","last_became_peered":"2023-10-16T20:07:52.038274+0000","last_unstale":"2023-10-16T20:08:14.497822+0000","last_undegraded":"2023-10-16T20:08:14.497822+0000","last_fullsized":"2023-10-16T20:08:14.497822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1","last_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_deep_scrub":"41'1","last_deep_scrub_stamp":"2023-10-16T20:08:10.579699+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.579699+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:56:02.493583+0000","scrub_duration":0.0022451950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:01.762808+0000","last_change":"2023-10-16T20:09:01.762808+0000","last_active":"2023-10-16T20:09:01.762808+0000","last_peered":"2023-10-16T20:09:01.762808+0000","last_clean":"2023-10-16T20:09:01.762808+0000","last_became_active":"2023-10-16T20:07:53.037133+0000","last_became_peered":"2023-10-16T20:07:53.037133+0000","last_unstale":"2023-10-16T20:09:01.762808+0000","last_undegraded":"2023-10-16T20:09:01.762808+0000","last_fullsized":"2023-10-16T20:09:01.762808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:01.762585+0000","last_clean_scrub_stamp":"2023-10-16T20:09:01.762585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:13:00.713898+0000","scrub_duration":0.001905641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:20.449316+0000","last_change":"2023-10-16T20:08:20.449316+0000","last_active":"2023-10-16T20:08:20.449316+0000","last_peered":"2023-10-16T20:08:20.449316+0000","last_clean":"2023-10-16T20:08:20.449316+0000","last_became_active":"2023-10-16T20:07:52.039943+0000","last_became_peered":"2023-10-16T20:07:52.039943+0000","last_unstale":"2023-10-16T20:08:20.449316+0000","last_undegraded":"2023-10-16T20:08:20.449316+0000","last_fullsized":"2023-10-16T20:08:20.449316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:20.449181+0000","last_clean_scrub_stamp":"2023-10-16T20:08:20.449181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:54:48.745567+0000","scrub_duration":0.0014394360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:31.526534+0000","last_change":"2023-10-16T20:08:31.526534+0000","last_active":"2023-10-16T20:08:31.526534+0000","last_peered":"2023-10-16T20:08:31.526534+0000","last_clean":"2023-10-16T20:08:31.526534+0000","last_became_active":"2023-10-16T20:07:53.033777+0000","last_became_peered":"2023-10-16T20:07:53.033777+0000","last_unstale":"2023-10-16T20:08:31.526534+0000","last_undegraded":"2023-10-16T20:08:31.526534+0000","last_fullsized":"2023-10-16T20:08:31.526534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:31.526380+0000","last_clean_scrub_stamp":"2023-10-16T20:08:31.526380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:03:16.564924+0000","scrub_duration":0.001580054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100367+0000","last_change":"2023-10-16T20:08:12.433505+0000","last_active":"2023-10-16T20:08:14.100367+0000","last_peered":"2023-10-16T20:08:14.100367+0000","last_clean":"2023-10-16T20:08:14.100367+0000","last_became_active":"2023-10-16T20:07:52.035617+0000","last_became_peered":"2023-10-16T20:07:52.035617+0000","last_unstale":"2023-10-16T20:08:14.100367+0000","last_undegraded":"2023-10-16T20:08:14.100367+0000","last_fullsized":"2023-10-16T20:08:14.100367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.433327+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.433327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:22:31.000732+0000","scrub_duration":0.0020332449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:32.101643+0000","last_change":"2023-10-16T20:08:32.101643+0000","last_active":"2023-10-16T20:08:32.101643+0000","last_peered":"2023-10-16T20:08:32.101643+0000","last_clean":"2023-10-16T20:08:32.101643+0000","last_became_active":"2023-10-16T20:07:53.036054+0000","last_became_peered":"2023-10-16T20:07:53.036054+0000","last_unstale":"2023-10-16T20:08:32.101643+0000","last_undegraded":"2023-10-16T20:08:32.101643+0000","last_fullsized":"2023-10-16T20:08:32.101643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:32.101511+0000","last_clean_scrub_stamp":"2023-10-16T20:08:32.101511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:49:30.651124+0000","scrub_duration":0.0020267929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.100716+0000","last_change":"2023-10-16T20:08:12.475937+0000","last_active":"2023-10-16T20:08:14.100716+0000","last_peered":"2023-10-16T20:08:14.100716+0000","last_clean":"2023-10-16T20:08:14.100716+0000","last_became_active":"2023-10-16T20:07:52.034543+0000","last_became_peered":"2023-10-16T20:07:52.034543+0000","last_unstale":"2023-10-16T20:08:14.100716+0000","last_undegraded":"2023-10-16T20:08:14.100716+0000","last_fullsized":"2023-10-16T20:08:14.100716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:12.475800+0000","last_clean_scrub_stamp":"2023-10-16T20:08:12.475800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:27.656843+0000","scrub_duration":0.00158522,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:37.407642+0000","last_change":"2023-10-16T20:08:37.407642+0000","last_active":"2023-10-16T20:08:37.407642+0000","last_peered":"2023-10-16T20:08:37.407642+0000","last_clean":"2023-10-16T20:08:37.407642+0000","last_became_active":"2023-10-16T20:07:53.044689+0000","last_became_peered":"2023-10-16T20:07:53.044689+0000","last_unstale":"2023-10-16T20:08:37.407642+0000","last_undegraded":"2023-10-16T20:08:37.407642+0000","last_fullsized":"2023-10-16T20:08:37.407642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:37.407507+0000","last_clean_scrub_stamp":"2023-10-16T20:08:37.407507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:34:53.193443+0000","scrub_duration":0.001934952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.469249+0000","last_change":"2023-10-16T20:08:23.469249+0000","last_active":"2023-10-16T20:08:23.469249+0000","last_peered":"2023-10-16T20:08:23.469249+0000","last_clean":"2023-10-16T20:08:23.469249+0000","last_became_active":"2023-10-16T20:07:52.040290+0000","last_became_peered":"2023-10-16T20:07:52.040290+0000","last_unstale":"2023-10-16T20:08:23.469249+0000","last_undegraded":"2023-10-16T20:08:23.469249+0000","last_fullsized":"2023-10-16T20:08:23.469249+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:23.469101+0000","last_clean_scrub_stamp":"2023-10-16T20:08:23.469101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:38:29.503109+0000","scrub_duration":0.0014701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:09:06.129402+0000","last_change":"2023-10-16T20:09:06.129402+0000","last_active":"2023-10-16T20:09:06.129402+0000","last_peered":"2023-10-16T20:09:06.129402+0000","last_clean":"2023-10-16T20:09:06.129402+0000","last_became_active":"2023-10-16T20:07:53.050633+0000","last_became_peered":"2023-10-16T20:07:53.050633+0000","last_unstale":"2023-10-16T20:09:06.129402+0000","last_undegraded":"2023-10-16T20:09:06.129402+0000","last_fullsized":"2023-10-16T20:09:06.129402+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:09:06.129204+0000","last_clean_scrub_stamp":"2023-10-16T20:09:06.129204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:43:42.325295+0000","scrub_duration":0.001601559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:14.497630+0000","last_change":"2023-10-16T20:08:10.737196+0000","last_active":"2023-10-16T20:08:14.497630+0000","last_peered":"2023-10-16T20:08:14.497630+0000","last_clean":"2023-10-16T20:08:14.497630+0000","last_became_active":"2023-10-16T20:07:52.042990+0000","last_became_peered":"2023-10-16T20:07:52.042990+0000","last_unstale":"2023-10-16T20:08:14.497630+0000","last_undegraded":"2023-10-16T20:08:14.497630+0000","last_fullsized":"2023-10-16T20:08:14.497630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:10.737080+0000","last_clean_scrub_stamp":"2023-10-16T20:08:10.737080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:46:44.257846+0000","scrub_duration":0.001554773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:11:18.760690+0000","last_change":"2023-10-16T20:11:18.760750+0000","last_active":"2023-10-16T20:11:18.760690+0000","last_peered":"2023-10-16T20:11:18.760690+0000","last_clean":"2023-10-16T20:11:18.760690+0000","last_became_active":"2023-10-16T20:08:14.498840+0000","last_became_peered":"2023-10-16T20:08:14.498840+0000","last_unstale":"2023-10-16T20:11:18.760690+0000","last_undegraded":"2023-10-16T20:11:18.760690+0000","last_fullsized":"2023-10-16T20:11:18.760690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:11:18.760593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:11:18.760593+0000","last_clean_scrub_stamp":"2023-10-16T20:11:18.760593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:50:20.065886+0000","scrub_duration":0.001500131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:29.437964+0000","last_change":"2023-10-16T20:08:29.437964+0000","last_active":"2023-10-16T20:08:29.437964+0000","last_peered":"2023-10-16T20:08:29.437964+0000","last_clean":"2023-10-16T20:08:29.437964+0000","last_became_active":"2023-10-16T20:07:52.039604+0000","last_became_peered":"2023-10-16T20:07:52.039604+0000","last_unstale":"2023-10-16T20:08:29.437964+0000","last_undegraded":"2023-10-16T20:08:29.437964+0000","last_fullsized":"2023-10-16T20:08:29.437964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T20:08:29.437773+0000","last_clean_scrub_stamp":"2023-10-16T20:08:29.437773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:45.247588+0000","scrub_duration":0.0020136389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"43'119","reported_seq":197,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-16T20:08:23.967215+0000","last_change":"2023-10-16T20:08:14.800563+0000","last_active":"2023-10-16T20:08:23.967215+0000","last_peered":"2023-10-16T20:08:23.967215+0000","last_clean":"2023-10-16T20:08:23.967215+0000","last_became_active":"2023-10-16T20:06:20.818601+0000","last_became_peered":"2023-10-16T20:06:20.818601+0000","last_unstale":"2023-10-16T20:08:23.967215+0000","last_undegraded":"2023-10-16T20:08:23.967215+0000","last_fullsized":"2023-10-16T20:08:23.967215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2023-10-16T20:08:14.800374+0000","last_clean_scrub_stamp":"2023-10-16T20:08:14.800374+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:30.793614+0000","scrub_duration":0.0057230190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1101824,"data_stored":805959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55600000000000005,"15min":0.52000000000000002},"min":{"1min":0.432,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.36899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78300000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57699999999999996,"15min":0.53800000000000003},"min":{"1min":0.44900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.58399999999999996},"min":{"1min":0.504,"5min":0.37,"15min":0.37},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57699999999999996}]},{"osd":2,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.47599999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50900000000000001}]},{"osd":3,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.52500000000000002},"min":{"1min":0.46899999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77000000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.32800000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.75900000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.36399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.876,"15min":0.876},"last":0.33800000000000002}]},{"osd":6,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77700000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49099999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509507,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":214491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69999999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.44700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72399999999999998,"5min":1.218,"15min":1.218},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.61799999999999999,"15min":0.69199999999999995},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.81200000000000006}]},{"osd":2,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.496,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78700000000000003,"5min":1.391,"15min":1.391},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73899999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61299999999999999},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79100000000000004,"5min":1.516,"15min":1.516},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63100000000000001,"15min":0.66900000000000004},"min":{"1min":0.52200000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.63}]},{"osd":4,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51300000000000001,"15min":0.57699999999999996},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81000000000000005,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56000000000000005,"15min":0.61199999999999999},"min":{"1min":0.439,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78800000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59999999999999998,"15min":0.68000000000000005},"min":{"1min":0.43099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":1.849,"15min":1.849},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.77900000000000003},"min":{"1min":0.44400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":2.585,"15min":2.585},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82599999999999996,"5min":1.115,"15min":1.115},"last":0.67700000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.372,"15min":0.35699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.38300000000000001,"15min":0.35599999999999998},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.27900000000000003}]},{"osd":2,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.38200000000000001,"15min":0.35199999999999998},"min":{"1min":0.29399999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.41099999999999998,"15min":0.377},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.501}]},{"osd":3,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.41399999999999998,"15min":0.39500000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.34599999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.29999999999999999}]},{"osd":4,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.59199999999999997},"min":{"1min":0.52600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89600000000000002,"5min":1.153,"15min":1.153},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63300000000000001},"min":{"1min":0.55500000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89100000000000001,"5min":1.214,"15min":1.214},"last":0.41899999999999998}]},{"osd":5,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.625,"15min":0.61099999999999999},"min":{"1min":0.51200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.85199999999999998,"5min":1.135,"15min":1.135},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64700000000000002,"15min":0.61399999999999999},"min":{"1min":0.48399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86499999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":1.05,"15min":1.05},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.56200000000000006,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89300000000000002,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.57499999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86899999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.67300000000000004,"15min":0.64500000000000002},"min":{"1min":0.499,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542212,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39000000000000001,"15min":0.45000000000000001},"min":{"1min":0.218,"5min":0.216,"15min":0.216},"max":{"1min":0.54900000000000004,"5min":2.798,"15min":2.798},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.29499999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.61699999999999999,"5min":1.087,"15min":1.087},"last":0.42199999999999999}]},{"osd":2,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.436,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":2.8769999999999998,"15min":2.8769999999999998},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67200000000000004,"5min":1.218,"15min":1.218},"last":0.39800000000000002}]},{"osd":3,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60599999999999998,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44900000000000001,"15min":0.48699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":2.754,"15min":2.754},"last":0.34899999999999998}]},{"osd":4,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":1.125,"15min":1.125},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.53300000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79900000000000004,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.504,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93100000000000005,"5min":1.246,"15min":1.246},"last":0.746},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85099999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97799999999999998,"5min":1.153,"15min":1.153},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Oct 16 20:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91800000000000004,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0049999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79100000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":213979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.33400000000000002},"min":{"1min":0.29399999999999998,"5min":0.188,"15min":0.188},"max":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.378},{"interface":"front","average":{"1min":0.438,"5min":0.39700000000000002,"15min":0.371},"min":{"1min":0.27700000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.64100000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.499}]},{"osd":1,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.38600000000000001},"min":{"1min":0.33700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.433},{"interface":"front","average":{"1min":0.437,"5min":0.40500000000000003,"15min":0.38300000000000001},"min":{"1min":0.29999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.58999999999999997,"5min":0.63,"15min":0.63},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.44600000000000001,"15min":0.41299999999999998},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.38100000000000001},"min":{"1min":0.30499999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40400000000000003}]},{"osd":4,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90800000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.627},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63,"15min":0.59499999999999997},"min":{"1min":0.504,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45900000000000002}]},{"osd":5,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.47699999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.60199999999999998},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58599999999999997}]},{"osd":6,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.54400000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66400000000000003,"15min":0.63300000000000001},"min":{"1min":0.58599999999999997,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 16 20:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.53300000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67600000000000005,"15min":0.63200000000000001},"min":{"1min":0.51600000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90300000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542212,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":215555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36099999999999999,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.51500000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.497},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.40500000000000003,"15min":0.38900000000000001},"min":{"1min":0.308,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55900000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.443,"15min":0.435},"min":{"1min":0.38100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59199999999999997}]},{"osd":4,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80700000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65200000000000002,"15min":0.69899999999999995},"min":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82799999999999996,"5min":3.0819999999999999,"15min":3.0819999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.88300000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.54000000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.84499999999999997,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Oct 16 20:11:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.52500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65900000000000003,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84199999999999997,"5min":0.876,"15min":0.876},"last":0.747}]}]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.54700000000000004},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.746,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.55900000000000005},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69899999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56399999999999995,"15min":0.53400000000000003},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67400000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.59199999999999997}]},{"osd":2,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60799999999999998,"15min":0.66400000000000003},"min":{"1min":0.436,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82399999999999995,"5min":2.899,"15min":2.899},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70299999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58899999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":1.24,"15min":1.24},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60799999999999998,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79300000000000004,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45400000000000001}]},{"osd":5,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48399999999999999,"15min":0.51200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75800000000000001,"5min":0.872,"15min":0.872},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66900000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52600000000000002,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71199999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.40000000000000002}]},{"osd":7,"last update":"Mon Oct 16 20:11:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.436},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":499712,"data_stored":214021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57999999999999996,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.78500000000000003,"5min":1.046,"15min":1.046},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58499999999999996,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.72299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57599999999999996,"15min":0.55000000000000004},"min":{"1min":0.51000000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.75900000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74199999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.378}]},{"osd":2,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82399999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.56499999999999995},"min":{"1min":0.49399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.72099999999999997,"5min":0.87,"15min":0.87},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60299999999999998},"min":{"1min":0.45100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.77300000000000002,"5min":1.103,"15min":1.103},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81200000000000006,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49199999999999999,"15min":0.53400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64600000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.502},{"interface":"front","average":{"1min":0.499,"5min":0.52800000000000002,"15min":0.57399999999999995},"min":{"1min":0.33600000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.63700000000000001},"min":{"1min":0.36199999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81699999999999995,"5min":1.546,"15min":1.546},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57899999999999996,"15min":0.68899999999999995},"min":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.76300000000000001,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.626}]},{"osd":7,"last update":"Mon Oct 16 20:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80100000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.60199999999999998,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T20:11:36.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-16T20:11:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.625+0000 7f65f38a3700 1 Processor -- start 2023-10-16T20:11:36.628 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.625+0000 7f65f38a3700 1 -- start start 2023-10-16T20:11:36.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f38a3700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f65ec06a820 0x7f65ec15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f38a3700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec161360 con 0x7f65ec06b370 2023-10-16T20:11:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f38a3700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ec06b750 con 0x7f65ec0cdd30 2023-10-16T20:11:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f38a3700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ec06dcc0 con 0x7f65ec06a820 2023-10-16T20:11:36.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f0e3e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f65ec06a820 0x7f65ec15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f163f700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f65ec06b370 0x7f65ec06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41774/0 (socket says 172.21.15.152:41774) 2023-10-16T20:11:36.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f163f700 1 -- 172.21.15.152:0/31824067 learned_addr learned my addr 172.21.15.152:0/31824067 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:11:36.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f0e3e700 1 -- 172.21.15.152:0/31824067 >> v1:172.21.15.163:6789/0 conn(0x7f65ec0cdd30 legacy=0x7f65ec1617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f0e3e700 1 -- 172.21.15.152:0/31824067 >> v1:172.21.15.152:6789/0 conn(0x7f65ec06b370 legacy=0x7f65ec06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f0e3e700 1 -- 172.21.15.152:0/31824067 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec15e300 con 0x7f65ec06a820 2023-10-16T20:11:36.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65f0e3e700 1 --2- 172.21.15.152:0/31824067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06a820 0x7f65ec15dcb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009840 tx=0x7f65dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd785aab9b33ad62 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65e3fff700 1 -- 172.21.15.152:0/31824067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc011830 con 0x7f65ec06a820 2023-10-16T20:11:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65e3fff700 1 -- 172.21.15.152:0/31824067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc011990 con 0x7f65ec06a820 2023-10-16T20:11:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.626+0000 7f65e3fff700 1 -- 172.21.15.152:0/31824067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc011d20 con 0x7f65ec06a820 2023-10-16T20:11:36.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 -- 172.21.15.152:0/31824067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06a820 msgr2=0x7f65ec15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 --2- 172.21.15.152:0/31824067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06a820 0x7f65ec15dcb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f65dc009840 tx=0x7f65dc009b50 comp rx=0 tx=0).stop 2023-10-16T20:11:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 -- 172.21.15.152:0/31824067 shutdown_connections 2023-10-16T20:11:36.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 --2- 172.21.15.152:0/31824067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06a820 0x7f65ec15dcb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 -- 172.21.15.152:0/31824067 >> 172.21.15.152:0/31824067 conn(0x7f65ec0ccbe0 msgr2=0x7f65ec0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:36.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 -- 172.21.15.152:0/31824067 shutdown_connections 2023-10-16T20:11:36.636 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.627+0000 7f65f38a3700 1 -- 172.21.15.152:0/31824067 wait complete. 2023-10-16T20:11:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.628+0000 7f65f38a3700 1 Processor -- start 2023-10-16T20:11:36.639 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.628+0000 7f65f38a3700 1 -- start start 2023-10-16T20:11:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f38a3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65ec06a820 0x7f65ec0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f38a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 0x7f65ec0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f38a3700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65ec0cdd30 0x7f65ec0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f38a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0c8cf0 con 0x7f65ec06b370 2023-10-16T20:11:36.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f38a3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0b4c20 con 0x7f65ec06a820 2023-10-16T20:11:36.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f38a3700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0adff0 con 0x7f65ec0cdd30 2023-10-16T20:11:36.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 0x7f65ec0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 0x7f65ec0adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33352/0 (socket says 172.21.15.152:33352) 2023-10-16T20:11:36.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 -- 172.21.15.152:0/3529359320 learned_addr learned my addr 172.21.15.152:0/3529359320 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:11:36.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f163f700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65ec06a820 0x7f65ec0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f1e40700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65ec0cdd30 0x7f65ec0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 -- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65ec0cdd30 msgr2=0x7f65ec0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65ec0cdd30 0x7f65ec0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 -- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65ec06a820 msgr2=0x7f65ec0c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65ec06a820 0x7f65ec0c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f0e3e700 1 -- 172.21.15.152:0/3529359320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0094a0 con 0x7f65ec06b370 2023-10-16T20:11:36.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.629+0000 7f65f1e40700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65ec0cdd30 0x7f65ec0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T20:11:36.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.630+0000 7f65f0e3e700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 0x7f65ec0adab0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f65dc000c00 tx=0x7f65dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.630+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0038a0 con 0x7f65ec06b370 2023-10-16T20:11:36.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.630+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc01e070 con 0x7f65ec06b370 2023-10-16T20:11:36.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.630+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec157720 con 0x7f65ec06b370 2023-10-16T20:11:36.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.630+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc003c20 con 0x7f65ec06b370 2023-10-16T20:11:36.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.630+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec157440 con 0x7f65ec06b370 2023-10-16T20:11:36.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.631+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec072d10 con 0x7f65ec06b370 2023-10-16T20:11:36.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.631+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f65dc02d450 con 0x7f65ec06b370 2023-10-16T20:11:36.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.632+0000 7f65e1ffb700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65d006af00 0x7f65d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.632+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f65dc08a840 con 0x7f65ec06b370 2023-10-16T20:11:36.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.632+0000 7f65f163f700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65d006af00 0x7f65d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.632+0000 7f65f163f700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65d006af00 0x7f65d006d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f65e8005910 tx=0x7f65e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.649 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.636+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f65dc055810 con 0x7f65ec06b370 2023-10-16T20:11:36.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.825+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f65ec0b4db0 con 0x7f65ec06b370 2023-10-16T20:11:36.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.829+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f65dc020020 con 0x7f65ec06b370 2023-10-16T20:11:36.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.830+0000 7f65e1ffb700 1 -- 172.21.15.152:0/3529359320 <== mon.0 v2:172.21.15.152:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f65dc055810 con 0x7f65ec06b370 2023-10-16T20:11:36.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.831+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65d006af00 msgr2=0x7f65d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.831+0000 7f65f38a3700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65d006af00 0x7f65d006d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f65e8005910 tx=0x7f65e8009040 comp rx=0 tx=0).stop 2023-10-16T20:11:36.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 msgr2=0x7f65ec0adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 0x7f65ec0adab0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f65dc000c00 tx=0x7f65dc004750 comp rx=0 tx=0).stop 2023-10-16T20:11:36.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 shutdown_connections 2023-10-16T20:11:36.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f65d006af00 0x7f65d006d3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f65ec0cdd30 0x7f65ec0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f65ec06a820 0x7f65ec0c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 --2- 172.21.15.152:0/3529359320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65ec06b370 0x7f65ec0adab0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 >> 172.21.15.152:0/3529359320 conn(0x7f65ec0ccbe0 msgr2=0x7f65ec15d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:36.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 shutdown_connections 2023-10-16T20:11:36.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.832+0000 7f65f38a3700 1 -- 172.21.15.152:0/3529359320 wait complete. 2023-10-16T20:11:36.849 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T20:11:36.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T20:11:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.968+0000 7f3dd5016700 1 Processor -- start 2023-10-16T20:11:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.968+0000 7f3dd5016700 1 -- start start 2023-10-16T20:11:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dd5016700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3dd00cf5f0 0x7f3dd00b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dd5016700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00b3240 0x7f3dd006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dd5016700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00b36a0 con 0x7f3dd015b0e0 2023-10-16T20:11:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dd5016700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd0161180 con 0x7f3dd00cf5f0 2023-10-16T20:11:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dd5016700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0161fe0 con 0x7f3dd00b3240 2023-10-16T20:11:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dce59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3dd00cf5f0 0x7f3dd00b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dced9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3dd015b0e0 0x7f3dd00ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:41788/0 (socket says 172.21.15.152:41788) 2023-10-16T20:11:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dced9d700 1 -- 172.21.15.152:0/928065475 learned_addr learned my addr 172.21.15.152:0/928065475 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-10-16T20:11:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.969+0000 7f3dcf59e700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00b3240 0x7f3dd006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dce59c700 1 -- 172.21.15.152:0/928065475 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00b3240 msgr2=0x7f3dd006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T20:11:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dce59c700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00b3240 0x7f3dd006bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dce59c700 1 -- 172.21.15.152:0/928065475 >> v1:172.21.15.152:6789/0 conn(0x7f3dd015b0e0 legacy=0x7f3dd00ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dcdd9b700 1 -- 172.21.15.152:0/928065475 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435831370 0 0) 0x7f3dd00b36a0 con 0x7f3dd015b0e0 2023-10-16T20:11:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dce59c700 1 -- 172.21.15.152:0/928065475 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd01613d0 con 0x7f3dd00cf5f0 2023-10-16T20:11:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dcf59e700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00b3240 0x7f3dd006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T20:11:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dce59c700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00cf5f0 0x7f3dd00b2d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009840 tx=0x7f3dc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a71047a39f6ba28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dcdd9b700 1 -- 172.21.15.152:0/928065475 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011830 con 0x7f3dd00cf5f0 2023-10-16T20:11:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dcdd9b700 1 -- 172.21.15.152:0/928065475 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3dc0011990 con 0x7f3dd00cf5f0 2023-10-16T20:11:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dcdd9b700 1 -- 172.21.15.152:0/928065475 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011d40 con 0x7f3dd00cf5f0 2023-10-16T20:11:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dd5016700 1 -- 172.21.15.152:0/928065475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00cf5f0 msgr2=0x7f3dd00b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.970+0000 7f3dd5016700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00cf5f0 0x7f3dd00b2d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009840 tx=0x7f3dc0009b50 comp rx=0 tx=0).stop 2023-10-16T20:11:36.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.971+0000 7f3dd5016700 1 -- 172.21.15.152:0/928065475 shutdown_connections 2023-10-16T20:11:36.980 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.971+0000 7f3dd5016700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00b3240 0x7f3dd006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.971+0000 7f3dd5016700 1 --2- 172.21.15.152:0/928065475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00cf5f0 0x7f3dd00b2d00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.971+0000 7f3dd5016700 1 -- 172.21.15.152:0/928065475 >> 172.21.15.152:0/928065475 conn(0x7f3dd00cdd00 msgr2=0x7f3dd00ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:36.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.971+0000 7f3dd5016700 1 -- 172.21.15.152:0/928065475 shutdown_connections 2023-10-16T20:11:36.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.971+0000 7f3dd5016700 1 -- 172.21.15.152:0/928065475 wait complete. 2023-10-16T20:11:36.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.972+0000 7f3dd5016700 1 Processor -- start 2023-10-16T20:11:36.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.972+0000 7f3dd5016700 1 -- start start 2023-10-16T20:11:36.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dd5016700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 0x7f3dd00b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dd5016700 1 --2- >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00cf5f0 0x7f3dd0145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dd5016700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3dd015b0e0 0x7f3dd0148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dd5016700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd014c790 con 0x7f3dd00b3240 2023-10-16T20:11:36.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dd5016700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01492f0 con 0x7f3dd015b0e0 2023-10-16T20:11:36.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dd5016700 1 -- --> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00b5a80 con 0x7f3dd00cf5f0 2023-10-16T20:11:36.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 0x7f3dd00b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 0x7f3dd00b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:33364/0 (socket says 172.21.15.152:33364) 2023-10-16T20:11:36.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 -- 172.21.15.152:0/3172767384 learned_addr learned my addr 172.21.15.152:0/3172767384 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-10-16T20:11:36.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dce59c700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00cf5f0 0x7f3dd0145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dcf59e700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3dd015b0e0 0x7f3dd0148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 -- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00cf5f0 msgr2=0x7f3dd0145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00cf5f0 0x7f3dd0145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 -- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3dd015b0e0 msgr2=0x7f3dd0148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:36.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3dd015b0e0 0x7f3dd0148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:36.988 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 -- 172.21.15.152:0/3172767384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00094a0 con 0x7f3dd00b3240 2023-10-16T20:11:36.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3dced9d700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 0x7f3dd00b5480 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c550 tx=0x7f3dc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.973+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4004c80 con 0x7f3dd00b3240 2023-10-16T20:11:36.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.974+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3dc4004e00 con 0x7f3dd00b3240 2023-10-16T20:11:36.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.974+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00b5d60 con 0x7f3dd00b3240 2023-10-16T20:11:36.990 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.974+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4007330 con 0x7f3dd00b3240 2023-10-16T20:11:36.990 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.974+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00b6320 con 0x7f3dd00b3240 2023-10-16T20:11:36.990 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.975+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00671b0 con 0x7f3dd00b3240 2023-10-16T20:11:36.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.975+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3dc4007490 con 0x7f3dd00b3240 2023-10-16T20:11:36.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.975+0000 7f3db77fe700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3dbc06af30 0x7f3dbc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T20:11:36.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.975+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f3dc4089490 con 0x7f3dd00b3240 2023-10-16T20:11:36.991 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.975+0000 7f3dce59c700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3dbc06af30 0x7f3dbc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T20:11:36.992 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.976+0000 7f3dce59c700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3dbc06af30 0x7f3dbc06d3f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00090b0 tx=0x7f3dc0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T20:11:36.992 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:36.980+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3dc4054340 con 0x7f3dd00b3240 2023-10-16T20:11:37.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.213+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dd004ebb0 con 0x7f3dd00b3240 2023-10-16T20:11:37.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.213+0000 7f3db77fe700 1 -- 172.21.15.152:0/3172767384 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f3dc4057960 con 0x7f3dd00b3240 2023-10-16T20:11:37.217 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-10-16T20:11:37.217 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6834/2930592275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":2930592275},{"type":"v1","addr":"172.21.15.163:6834","nonce":2930592275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/3404226802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6833","nonce":3404226802},{"type":"v1","addr":"172.21.15.163:6835","nonce":3404226802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5295,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2105247281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2105247281},{"type":"v1","addr":"172.21.15.152:6835","nonce":2105247281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T20:07:52.423205+0000","modified":"2023-10-16T20:07:55.444012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5310},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5310":{"gid":5310,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6837/829949938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":829949938},{"type":"v1","addr":"172.21.15.152:6837","nonce":829949938}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T20:11:37.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3dbc06af30 msgr2=0x7f3dbc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:37.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3dbc06af30 0x7f3dbc06d3f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00090b0 tx=0x7f3dc0008030 comp rx=0 tx=0).stop 2023-10-16T20:11:37.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 msgr2=0x7f3dd00b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T20:11:37.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 0x7f3dd00b5480 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c550 tx=0x7f3dc400c860 comp rx=0 tx=0).stop 2023-10-16T20:11:37.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 shutdown_connections 2023-10-16T20:11:37.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:6832/1955925781,v1:172.21.15.152:6833/1955925781] conn(0x7f3dbc06af30 0x7f3dbc06d3f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3dd015b0e0 0x7f3dd0148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3dd00b3240 0x7f3dd00b5480 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 --2- 172.21.15.152:0/3172767384 >> [v2:172.21.15.163:3301/0,v1:172.21.15.163:6790/0] conn(0x7f3dd00cf5f0 0x7f3dd0145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T20:11:37.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.215+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 >> 172.21.15.152:0/3172767384 conn(0x7f3dd00cdd00 msgr2=0x7f3dd015fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T20:11:37.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.216+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 shutdown_connections 2023-10-16T20:11:37.221 INFO:teuthology.orchestra.run.smithi152.stderr:2023-10-16T20:11:37.216+0000 7f3dd5016700 1 -- 172.21.15.152:0/3172767384 wait complete. 2023-10-16T20:11:37.222 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 19 2023-10-16T20:11:37.230 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-16T20:11:37.231 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T20:11:37.231 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T20:11:37.232 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.240 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T20:11:37.241 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T20:11:37.241 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.289 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T20:11:37.290 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T20:11:37.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.300 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T20:11:37.301 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T20:11:37.301 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.352 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T20:11:37.352 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T20:11:37.353 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T20:11:37.353 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.386 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T20:11:37.387 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T20:11:37.387 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.461 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T20:11:37.462 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T20:11:37.462 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.533 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T20:11:37.533 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T20:11:37.534 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.605 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T20:11:37.606 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T20:11:37.606 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.641 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T20:11:37.641 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T20:11:37.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.714 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T20:11:37.715 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T20:11:37.715 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.787 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T20:11:37.788 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T20:11:37.788 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.867 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T20:11:37.868 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T20:11:37.868 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T20:11:37.869 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.892 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T20:11:37.893 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T20:11:37.893 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.934 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T20:11:37.934 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T20:11:37.935 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T20:11:37.935 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.945 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T20:11:37.946 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T20:11:37.946 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:37.986 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T20:11:37.987 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T20:11:37.987 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T20:11:38.038 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T20:11:38.039 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T20:11:38.039 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'client session with non-allowable root' | head -n 1 2023-10-16T20:11:38.071 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:11:38.071 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T20:11:38.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:11:38.351 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-16T20:11:38.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:11:38.462 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-16T20:11:38.542 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:11:38.543 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-16T20:11:38.615 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:11:38.616 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-16T20:11:38.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:11:38.814 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-16T20:11:38.922 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:11:38.923 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-16T20:11:39.006 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:11:39.006 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-16T20:11:39.078 INFO:tasks.ceph:Archiving mon data... 2023-10-16T20:11:39.080 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/data/mon.a.tgz 2023-10-16T20:11:39.081 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-10-16T20:11:39.098 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.4tD4ycrYZ6 2023-10-16T20:11:39.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4tD4ycrYZ6 2023-10-16T20:11:39.243 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.4tD4ycrYZ6 2023-10-16T20:11:39.340 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.4tD4ycrYZ6 is 341KB 2023-10-16T20:11:39.453 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.4tD4ycrYZ6 2023-10-16T20:11:39.471 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/data/mon.b.tgz 2023-10-16T20:11:39.471 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2023-10-16T20:11:39.491 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.Dxhr3dE3Lx 2023-10-16T20:11:39.491 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Dxhr3dE3Lx 2023-10-16T20:11:39.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.Dxhr3dE3Lx 2023-10-16T20:11:39.749 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.Dxhr3dE3Lx is 455KB 2023-10-16T20:11:39.839 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.Dxhr3dE3Lx 2023-10-16T20:11:39.857 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/data/mon.c.tgz 2023-10-16T20:11:39.858 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2023-10-16T20:11:39.917 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.ChmQ9VVH19 2023-10-16T20:11:39.918 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ChmQ9VVH19 2023-10-16T20:11:40.066 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.ChmQ9VVH19 2023-10-16T20:11:40.153 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.ChmQ9VVH19 is 456KB 2023-10-16T20:11:40.237 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.ChmQ9VVH19 2023-10-16T20:11:40.254 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-16T20:11:40.255 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T20:11:40.257 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T20:11:40.320 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-16T20:11:40.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T20:11:40.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T20:11:40.368 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T20:11:40.411 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T20:11:40.416 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T20:11:40.418 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/remote/smithi152/crash 2023-10-16T20:11:40.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T20:11:40.448 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/remote/smithi163/crash 2023-10-16T20:11:40.450 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T20:11:40.476 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T20:11:40.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:40.493 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:40.576 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:40.604 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T20:11:40.630 INFO:tasks.ceph:Compressing logs... 2023-10-16T20:11:40.630 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T20:11:40.646 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-16T20:11:40.671 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119931.log 2023-10-16T20:11:40.672 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119155.log 2023-10-16T20:11:40.689 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120247.log 2023-10-16T20:11:40.689 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118274.log 2023-10-16T20:11:40.689 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119931.log.gz 2023-10-16T20:11:40.690 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119155.log.gz/var/log/ceph/ceph-client.admin.120247.log: 2023-10-16T20:11:40.690 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117415.log 2023-10-16T20:11:40.690 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4%/var/log/ceph/ceph-client.admin.118274.log: -- replaced with /var/log/ceph/ceph-client.admin.120247.log.gz 2023-10-16T20:11:40.691 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112687.log 2023-10-16T20:11:40.691 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117415.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118274.log.gz 2023-10-16T20:11:40.691 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110289.log 2023-10-16T20:11:40.691 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117415.log.gz 2023-10-16T20:11:40.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119109.log 2023-10-16T20:11:40.692 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122779.log 2023-10-16T20:11:40.692 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112687.log.gz 2023-10-16T20:11:40.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110289.log: /var/log/ceph/ceph-client.admin.119109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114007.log 2023-10-16T20:11:40.693 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110289.log.gz 2023-10-16T20:11:40.693 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122779.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.119109.log.gz 2023-10-16T20:11:40.693 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113271.log 2023-10-16T20:11:40.693 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122779.log.gz 2023-10-16T20:11:40.694 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119247.log 2023-10-16T20:11:40.694 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114007.log: /var/log/ceph/ceph-client.admin.113271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119544.log 2023-10-16T20:11:40.694 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114007.log.gz 2023-10-16T20:11:40.695 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113271.log.gz 2023-10-16T20:11:40.695 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122687.log 2023-10-16T20:11:40.695 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119247.log.gz 2023-10-16T20:11:40.695 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-16T20:11:40.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119544.log: /var/log/ceph/ceph-client.admin.122687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117369.log 2023-10-16T20:11:40.696 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119544.log.gz 2023-10-16T20:11:40.696 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122687.log.gz 2023-10-16T20:11:40.696 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123549.log /var/log/ceph/ceph-osd.2.log: 2023-10-16T20:11:40.697 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112871.log 2023-10-16T20:11:40.697 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123549.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117369.log.gz 2023-10-16T20:11:40.697 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112323.log 2023-10-16T20:11:40.697 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123549.log.gz 2023-10-16T20:11:40.698 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122641.log 2023-10-16T20:11:40.698 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112871.log: /var/log/ceph/ceph-client.admin.112323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112595.log 2023-10-16T20:11:40.698 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112871.log.gz 2023-10-16T20:11:40.699 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112323.log.gz 2023-10-16T20:11:40.699 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112120.log 2023-10-16T20:11:40.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111760.log 2023-10-16T20:11:40.699 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112595.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122641.log.gz 2023-10-16T20:11:40.700 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116724.log 2023-10-16T20:11:40.700 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112595.log.gz 2023-10-16T20:11:40.700 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112120.log.gz 2023-10-16T20:11:40.701 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.111760.log: -- /var/log/ceph/ceph-client.admin.121256.log 2023-10-16T20:11:40.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123014.log 2023-10-16T20:11:40.701 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116724.log.gz 2023-10-16T20:11:40.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121697.log 2023-10-16T20:11:40.702 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121256.log.gz 2023-10-16T20:11:40.702 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123014.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T20:11:40.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114812.log 2023-10-16T20:11:40.702 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.121697.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123014.log.gz 2023-10-16T20:11:40.703 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121697.log.gz 2023-10-16T20:11:40.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117323.log 2023-10-16T20:11:40.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121701.log 2023-10-16T20:11:40.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117323.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114812.log.gz 2023-10-16T20:11:40.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110737.log 2023-10-16T20:11:40.704 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4%/var/log/ceph/ceph-client.0.121701.log: -- replaced with /var/log/ceph/ceph-client.admin.117323.log.gz 2023-10-16T20:11:40.704 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.111760.log.gz 2023-10-16T20:11:40.704 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121701.log.gz 2023-10-16T20:11:40.705 INFO:teuthology.orchestra.run.smithi152.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T20:11:40.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118837.log 2023-10-16T20:11:40.705 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110737.log.gz 2023-10-16T20:11:40.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116816.log 2023-10-16T20:11:40.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120569.log 2023-10-16T20:11:40.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116816.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118837.log.gz 2023-10-16T20:11:40.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114971.log 2023-10-16T20:11:40.707 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116816.log.gz 2023-10-16T20:11:40.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120155.log 2023-10-16T20:11:40.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114971.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120569.log.gz 2023-10-16T20:11:40.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114444.log 2023-10-16T20:11:40.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114971.log.gz 2023-10-16T20:11:40.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117277.log 2023-10-16T20:11:40.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114444.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120155.log.gz 2023-10-16T20:11:40.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112415.log 2023-10-16T20:11:40.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114444.log.gz 2023-10-16T20:11:40.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114260.log 2023-10-16T20:11:40.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112415.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117277.log.gz 2023-10-16T20:11:40.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120959.log 2023-10-16T20:11:40.710 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112415.log.gz 2023-10-16T20:11:40.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114000.log 2023-10-16T20:11:40.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120959.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114260.log.gz 2023-10-16T20:11:40.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111179.log 2023-10-16T20:11:40.711 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114000.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120959.log.gzgzip 2023-10-16T20:11:40.711 INFO:teuthology.orchestra.run.smithi152.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.119792.log 2023-10-16T20:11:40.711 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114000.log.gz 2023-10-16T20:11:40.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119063.log 2023-10-16T20:11:40.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118366.log 2023-10-16T20:11:40.712 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111179.log.gz 2023-10-16T20:11:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119063.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119792.log.gz 2023-10-16T20:11:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122135.log 2023-10-16T20:11:40.713 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119063.log.gz 2023-10-16T20:11:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120819.log 2023-10-16T20:11:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118366.log: /var/log/ceph/ceph-client.admin.122135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120867.log 2023-10-16T20:11:40.714 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118366.log.gz 2023-10-16T20:11:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120819.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122135.log.gz 2023-10-16T20:11:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117139.log 2023-10-16T20:11:40.715 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120819.log.gz 2023-10-16T20:11:40.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122503.log 2023-10-16T20:11:40.715 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120867.log.gz 2023-10-16T20:11:40.716 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-16T20:11:40.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117139.log: /var/log/ceph/ceph-client.admin.122503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113266.log 2023-10-16T20:11:40.716 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117139.log.gz 2023-10-16T20:11:40.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.0.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122503.log.gz 2023-10-16T20:11:40.716 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123392.log 2023-10-16T20:11:40.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123595.log 2023-10-16T20:11:40.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113266.log: /var/log/ceph/ceph-client.admin.123392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112369.log 2023-10-16T20:11:40.717 INFO:teuthology.orchestra.run.smithi152.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113266.log.gz 2023-10-16T20:11:40.717 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123392.log.gz 2023-10-16T20:11:40.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117507.log 2023-10-16T20:11:40.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118925.log 2023-10-16T20:11:40.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112369.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123595.log.gz 2023-10-16T20:11:40.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113999.log 2023-10-16T20:11:40.719 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112369.log.gz 2023-10-16T20:11:40.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118925.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117507.log.gz 2023-10-16T20:11:40.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110787.log 2023-10-16T20:11:40.720 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118925.log.gz 2023-10-16T20:11:40.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113999.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-16T20:11:40.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114858.log 2023-10-16T20:11:40.720 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113999.log.gz 2023-10-16T20:11:40.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose 89.0%-- /var/log/ceph/ceph-client.admin.112733.log 2023-10-16T20:11:40.721 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110787.log.gz 2023-10-16T20:11:40.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119201.log 2023-10-16T20:11:40.733 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104131.log 2023-10-16T20:11:40.734 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-16T20:11:40.734 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.104131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110703.log 2023-10-16T20:11:40.734 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.5.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104131.log.gz 2023-10-16T20:11:40.735 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-16T20:11:40.735 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.1.110703.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.1.110703.log.gz--verbose 2023-10-16T20:11:40.735 INFO:teuthology.orchestra.run.smithi163.stderr:-- /var/log/ceph/ceph-client.admin.104221.log 2023-10-16T20:11:40.735 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104274.log 2023-10-16T20:11:40.736 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.104221.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-16T20:11:40.736 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.104274.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104221.log.gz 2023-10-16T20:11:40.736 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103939.log 2023-10-16T20:11:40.736 INFO:teuthology.orchestra.run.smithi163.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104274.log.gz 2023-10-16T20:11:40.737 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111314.log 2023-10-16T20:11:40.737 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.103939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110695.log 2023-10-16T20:11:40.737 INFO:teuthology.orchestra.run.smithi163.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-16T20:11:40.737 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.3.111314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104039.log 2023-10-16T20:11:40.738 INFO:teuthology.orchestra.run.smithi163.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103939.log.gz 2023-10-16T20:11:40.738 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111314.log.gz 2023-10-16T20:11:40.738 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.1.110695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104086.log 2023-10-16T20:11:40.739 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110695.log.gz 2023-10-16T20:11:40.739 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.104039.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-16T20:11:40.739 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.104086.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104039.log.gz 2023-10-16T20:11:40.739 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T20:11:40.740 INFO:teuthology.orchestra.run.smithi163.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104086.log.gz 2023-10-16T20:11:40.740 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-16T20:11:40.740 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111310.log 2023-10-16T20:11:40.740 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104176.log 2023-10-16T20:11:40.741 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.3.111310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111310.log.gz 2023-10-16T20:11:40.741 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.104176.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104176.log.gz 2023-10-16T20:11:40.741 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-16T20:11:40.741 INFO:teuthology.orchestra.run.smithi163.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-16T20:11:40.742 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103986.log 2023-10-16T20:11:40.742 INFO:teuthology.orchestra.run.smithi163.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T20:11:40.742 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.103986.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103986.log.gz 2023-10-16T20:11:40.743 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-16T20:11:40.743 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-16T20:11:40.743 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-16T20:11:40.743 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mon.b.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-16T20:11:40.744 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-16T20:11:40.744 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-mds.b.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-16T20:11:40.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112733.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114858.log.gz 2023-10-16T20:11:40.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119201.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112733.log.gz 2023-10-16T20:11:40.775 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119201.log.gz 2023-10-16T20:11:40.776 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122457.log 2023-10-16T20:11:40.776 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113635.log 2023-10-16T20:11:40.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118320.log 2023-10-16T20:11:40.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113635.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122457.log.gz 2023-10-16T20:11:40.777 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113635.log.gz 2023-10-16T20:11:40.777 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110879.log 2023-10-16T20:11:40.777 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118320.log.gz 2023-10-16T20:11:40.777 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119406.log 2023-10-16T20:11:40.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116632.log 2023-10-16T20:11:40.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110879.log.gz 2023-10-16T20:11:40.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116632.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119406.log.gz 2023-10-16T20:11:40.778 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116632.log.gz 2023-10-16T20:11:40.779 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119636.log 2023-10-16T20:11:40.779 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118971.log 2023-10-16T20:11:40.779 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119636.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-16T20:11:40.780 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118971.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119636.log.gz 2023-10-16T20:11:40.780 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.3.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118971.log.gz 2023-10-16T20:11:40.780 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115653.log 2023-10-16T20:11:40.780 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110971.log 2023-10-16T20:11:40.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.115653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115653.log.gz 2023-10-16T20:11:40.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110971.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110971.log.gz 2023-10-16T20:11:40.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114628.log 2023-10-16T20:11:40.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114720.log 2023-10-16T20:11:40.782 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114628.log: /var/log/ceph/ceph-client.admin.114720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114628.log.gz 2023-10-16T20:11:40.782 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114720.log.gz 2023-10-16T20:11:40.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113270.log 2023-10-16T20:11:40.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117691.log 2023-10-16T20:11:40.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113270.log: /var/log/ceph/ceph-client.admin.117691.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113270.log.gz 2023-10-16T20:11:40.783 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117691.log.gz 2023-10-16T20:11:40.783 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121189.log 2023-10-16T20:11:40.783 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112074.log 2023-10-16T20:11:40.784 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121189.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121189.log.gz 2023-10-16T20:11:40.784 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112074.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112074.log.gz 2023-10-16T20:11:40.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110336.log 2023-10-16T20:11:40.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110158.log 2023-10-16T20:11:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110336.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110336.log.gz 2023-10-16T20:11:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110158.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110158.log.gz 2023-10-16T20:11:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119339.log 2023-10-16T20:11:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121302.log 2023-10-16T20:11:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121951.log 2023-10-16T20:11:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119339.log.gz 2023-10-16T20:11:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123135.log 2023-10-16T20:11:40.786 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121302.log.gz 2023-10-16T20:11:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123081.log 2023-10-16T20:11:40.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123135.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121951.log.gz 2023-10-16T20:11:40.787 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123135.log.gz 2023-10-16T20:11:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123081.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123081.log.gz 2023-10-16T20:11:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117231.log 2023-10-16T20:11:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118699.log 2023-10-16T20:11:40.788 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121394.log 2023-10-16T20:11:40.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118699.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117231.log.gz 2023-10-16T20:11:40.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121394.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118699.log.gz 2023-10-16T20:11:40.789 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123204.log 2023-10-16T20:11:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120109.log 2023-10-16T20:11:40.790 INFO:teuthology.orchestra.run.smithi152.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.121394.log.gz 2023-10-16T20:11:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123204.log: /var/log/ceph/ceph-client.admin.120109.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123204.log.gz 2023-10-16T20:11:40.790 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110925.log 2023-10-16T20:11:40.791 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120109.log.gz 2023-10-16T20:11:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114490.log 2023-10-16T20:11:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122825.log 2023-10-16T20:11:40.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114490.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110925.log.gz 2023-10-16T20:11:40.792 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114490.log.gz 2023-10-16T20:11:40.792 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114006.log 2023-10-16T20:11:40.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121464.log 2023-10-16T20:11:40.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114006.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122825.log.gz 2023-10-16T20:11:40.793 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114006.log.gz 2023-10-16T20:11:40.793 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122043.log 2023-10-16T20:11:40.793 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116770.log 2023-10-16T20:11:40.793 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121464.log.gz 2023-10-16T20:11:40.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122043.log: /var/log/ceph/ceph-client.admin.116770.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122043.log.gz 2023-10-16T20:11:40.794 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116770.log.gz 2023-10-16T20:11:40.794 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119452.log 2023-10-16T20:11:40.794 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118791.log 2023-10-16T20:11:40.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112166.log 2023-10-16T20:11:40.795 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119452.log.gz 2023-10-16T20:11:40.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118791.log: /var/log/ceph/ceph-client.admin.112166.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118791.log.gz 2023-10-16T20:11:40.795 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112166.log.gz 2023-10-16T20:11:40.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118186.log 2023-10-16T20:11:40.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123271.log 2023-10-16T20:11:40.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118186.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-16T20:11:40.796 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118186.log.gz 2023-10-16T20:11:40.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122181.log 2023-10-16T20:11:40.797 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123271.log.gz 2023-10-16T20:11:40.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114398.log 2023-10-16T20:11:40.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120293.log 2023-10-16T20:11:40.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114398.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122181.log.gz 2023-10-16T20:11:40.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120293.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114398.log.gz 2023-10-16T20:11:40.798 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-16T20:11:40.799 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120293.log.gz 2023-10-16T20:11:40.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117093.log 2023-10-16T20:11:40.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112918.log 2023-10-16T20:11:40.799 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116955.log 2023-10-16T20:11:40.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112918.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117093.log.gz 2023-10-16T20:11:40.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123505.log 2023-10-16T20:11:40.800 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112918.log.gz 2023-10-16T20:11:40.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116955.log: /var/log/ceph/ceph-client.admin.123505.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116955.log.gz 2023-10-16T20:11:40.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118745.log 2023-10-16T20:11:40.801 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123505.log.gz 2023-10-16T20:11:40.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113265.log 2023-10-16T20:11:40.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114674.log 2023-10-16T20:11:40.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113265.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118745.log.gz 2023-10-16T20:11:40.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114674.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113265.log.gz 2023-10-16T20:11:40.802 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114674.log.gz 2023-10-16T20:11:40.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114002.log 2023-10-16T20:11:40.803 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117829.log 2023-10-16T20:11:40.803 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122273.log 2023-10-16T20:11:40.803 INFO:teuthology.orchestra.run.smithi152.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114002.log.gz 2023-10-16T20:11:40.803 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117829.log: /var/log/ceph/ceph-client.admin.122273.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117829.log.gz 2023-10-16T20:11:40.804 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122273.log.gz 2023-10-16T20:11:40.804 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112964.log 2023-10-16T20:11:40.804 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114582.log 2023-10-16T20:11:40.804 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122227.log 2023-10-16T20:11:40.805 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112964.log.gz 2023-10-16T20:11:40.805 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123438.log 2023-10-16T20:11:40.805 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114582.log.gz 2023-10-16T20:11:40.806 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122227.log: /var/log/ceph/ceph-client.admin.123438.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122227.log.gz 2023-10-16T20:11:40.806 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123438.log.gz 2023-10-16T20:11:40.806 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119885.log 2023-10-16T20:11:40.806 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118412.log 2023-10-16T20:11:40.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117599.log 2023-10-16T20:11:40.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118412.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119885.log.gz 2023-10-16T20:11:40.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117599.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118412.log.gz 2023-10-16T20:11:40.807 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117599.log.gz 2023-10-16T20:11:40.808 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120385.log 2023-10-16T20:11:40.808 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114306.log 2023-10-16T20:11:40.808 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110382.log 2023-10-16T20:11:40.808 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4%/var/log/ceph/ceph-client.admin.114306.log: -- replaced with /var/log/ceph/ceph-client.admin.120385.log.gz 2023-10-16T20:11:40.809 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110382.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114306.log.gz 2023-10-16T20:11:40.809 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110382.log.gz 2023-10-16T20:11:40.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117737.log 2023-10-16T20:11:40.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122595.log 2023-10-16T20:11:40.810 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117737.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117737.log.gz 2023-10-16T20:11:40.810 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109953.log 2023-10-16T20:11:40.810 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-16T20:11:40.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111109.log 2023-10-16T20:11:40.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109953.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122595.log.gzgzip 2023-10-16T20:11:40.811 INFO:teuthology.orchestra.run.smithi152.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.121143.log 2023-10-16T20:11:40.811 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-16T20:11:40.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111109.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109953.log.gz 2023-10-16T20:11:40.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121143.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.111109.log.gz 2023-10-16T20:11:40.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121143.log.gz 2023-10-16T20:11:40.812 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.116314.log 2023-10-16T20:11:40.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112641.log 2023-10-16T20:11:40.813 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.2.116314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116862.log 2023-10-16T20:11:40.813 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.116314.log.gz 2023-10-16T20:11:40.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110520.log 2023-10-16T20:11:40.814 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112641.log.gz/var/log/ceph/ceph-client.admin.116862.log: 2023-10-16T20:11:40.814 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-16T20:11:40.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110520.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116862.log.gz 2023-10-16T20:11:40.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112779.log 2023-10-16T20:11:40.815 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110520.log.gz 2023-10-16T20:11:40.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113998.log 2023-10-16T20:11:40.815 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103827.log 2023-10-16T20:11:40.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115661.log 2023-10-16T20:11:40.816 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112779.log.gz 2023-10-16T20:11:40.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.103827.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113998.log.gz 2023-10-16T20:11:40.816 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118048.log 2023-10-16T20:11:40.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.115661.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103827.log.gz 2023-10-16T20:11:40.817 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113264.log 2023-10-16T20:11:40.817 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115661.log.gz 2023-10-16T20:11:40.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114214.log 2023-10-16T20:11:40.818 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118048.log.gz 2023-10-16T20:11:40.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119728.log 2023-10-16T20:11:40.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114214.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113264.log.gz 2023-10-16T20:11:40.819 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119728.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114214.log.gz 2023-10-16T20:11:40.819 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119728.log.gz 2023-10-16T20:11:40.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114536.log 2023-10-16T20:11:40.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117553.log 2023-10-16T20:11:40.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111982.log 2023-10-16T20:11:40.820 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114536.log.gz 2023-10-16T20:11:40.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122365.log 2023-10-16T20:11:40.820 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113622.log 2023-10-16T20:11:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111982.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117553.log.gz 2023-10-16T20:11:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122893.log 2023-10-16T20:11:40.821 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111982.log.gz 2023-10-16T20:11:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113622.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122365.log.gz 2023-10-16T20:11:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113268.log 2023-10-16T20:11:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122893.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113622.log.gz 2023-10-16T20:11:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113268.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122893.log.gz 2023-10-16T20:11:40.822 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113268.log.gz 2023-10-16T20:11:40.823 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118653.log 2023-10-16T20:11:40.823 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117001.log 2023-10-16T20:11:40.823 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122733.log 2023-10-16T20:11:40.824 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118653.log.gz 2023-10-16T20:11:40.824 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117001.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117001.log.gz 2023-10-16T20:11:40.824 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122733.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122733.log.gz 2023-10-16T20:11:40.824 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120727.log 2023-10-16T20:11:40.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104137.log 2023-10-16T20:11:40.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121005.log 2023-10-16T20:11:40.825 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120727.log.gz 2023-10-16T20:11:40.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.104137.log: /var/log/ceph/ceph-client.admin.121005.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104137.log.gz 2023-10-16T20:11:40.826 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121005.log.gz 2023-10-16T20:11:40.826 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116586.log 2023-10-16T20:11:40.826 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113997.log 2023-10-16T20:11:40.826 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113846.log 2023-10-16T20:11:40.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113997.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116586.log.gz 2023-10-16T20:11:40.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113846.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113997.log.gz 2023-10-16T20:11:40.827 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113846.log.gz 2023-10-16T20:11:40.827 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115201.log 2023-10-16T20:11:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120042.log 2023-10-16T20:11:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119498.log 2023-10-16T20:11:40.828 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115201.log.gz 2023-10-16T20:11:40.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120042.log: /var/log/ceph/ceph-client.admin.119498.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120042.log.gz 2023-10-16T20:11:40.829 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119498.log.gz 2023-10-16T20:11:40.829 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-16T20:11:40.829 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114766.log 2023-10-16T20:11:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113010.log 2023-10-16T20:11:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114766.log: /var/log/ceph/ceph-client.admin.113010.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114766.log.gz 2023-10-16T20:11:40.830 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113010.log.gz 2023-10-16T20:11:40.830 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120339.log 2023-10-16T20:11:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122089.log 2023-10-16T20:11:40.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113269.log 2023-10-16T20:11:40.831 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120339.log.gz 2023-10-16T20:11:40.832 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111017.log 2023-10-16T20:11:40.832 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113269.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122089.log.gz 2023-10-16T20:11:40.832 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113269.log.gz 2023-10-16T20:11:40.832 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111017.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111017.log.gz 2023-10-16T20:11:40.833 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97580.log 2023-10-16T20:11:40.833 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113637.log 2023-10-16T20:11:40.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.tmp-client.admin.97580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121348.log 2023-10-16T20:11:40.833 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97580.log.gz 2023-10-16T20:11:40.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113637.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113637.log.gz 2023-10-16T20:11:40.834 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110474.log 2023-10-16T20:11:40.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120913.log 2023-10-16T20:11:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121348.log.gz 2023-10-16T20:11:40.835 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110474.log.gz 2023-10-16T20:11:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120913.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120913.log.gz 2023-10-16T20:11:40.835 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110589.log 2023-10-16T20:11:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114904.log 2023-10-16T20:11:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110589.log: /var/log/ceph/ceph-client.admin.114904.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110589.log.gz 2023-10-16T20:11:40.836 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114904.log.gz 2023-10-16T20:11:40.836 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116540.log 2023-10-16T20:11:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104252.log 2023-10-16T20:11:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113628.log 2023-10-16T20:11:40.837 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.116540.log.gz 2023-10-16T20:11:40.837 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.104252.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104252.log.gz 2023-10-16T20:11:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113628.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113628.log.gz 2023-10-16T20:11:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112825.log 2023-10-16T20:11:40.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121905.log 2023-10-16T20:11:40.839 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112825.log: /var/log/ceph/ceph-client.admin.121905.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112825.log.gz 2023-10-16T20:11:40.839 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121905.log.gz 2023-10-16T20:11:40.839 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116908.log 2023-10-16T20:11:40.839 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112277.log 2023-10-16T20:11:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117783.log 2023-10-16T20:11:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112277.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116908.log.gz 2023-10-16T20:11:40.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117783.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112277.log.gz 2023-10-16T20:11:40.840 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117783.log.gz 2023-10-16T20:11:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110691.log 2023-10-16T20:11:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120773.log 2023-10-16T20:11:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113638.log 2023-10-16T20:11:40.841 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120773.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110691.log.gz 2023-10-16T20:11:40.842 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120773.log.gz 2023-10-16T20:11:40.842 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113638.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113638.log.gz 2023-10-16T20:11:40.842 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122319.log 2023-10-16T20:11:40.843 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119017.log 2023-10-16T20:11:40.843 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122319.log: /var/log/ceph/ceph-client.admin.119017.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122319.log.gz 2023-10-16T20:11:40.843 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119017.log.gz 2023-10-16T20:11:40.843 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112028.log 2023-10-16T20:11:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115883.log 2023-10-16T20:11:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118094.log 2023-10-16T20:11:40.844 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112028.log.gz 2023-10-16T20:11:40.844 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115883.log: /var/log/ceph/ceph-client.admin.118094.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.115883.log.gz 2023-10-16T20:11:40.845 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118094.log.gz 2023-10-16T20:11:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.116318.log 2023-10-16T20:11:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117047.log 2023-10-16T20:11:40.845 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.2.116318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123325.log 0.0% 2023-10-16T20:11:40.846 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.2.116318.log.gz 2023-10-16T20:11:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117047.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117047.log.gz 2023-10-16T20:11:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120477.log 2023-10-16T20:11:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111063.log 2023-10-16T20:11:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120477.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123325.log.gz 2023-10-16T20:11:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111063.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120477.log.gz 2023-10-16T20:11:40.847 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111063.log.gz 2023-10-16T20:11:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117956.log 2023-10-16T20:11:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113267.log 2023-10-16T20:11:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119293.log 2023-10-16T20:11:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117956.log.gz 2023-10-16T20:11:40.849 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119293.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113267.log.gz 2023-10-16T20:11:40.849 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.119293.log.gz 2023-10-16T20:11:40.849 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119590.log 2023-10-16T20:11:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113630.log 2023-10-16T20:11:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113064.log 2023-10-16T20:11:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113630.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119590.log.gz 2023-10-16T20:11:40.850 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113630.log.gz 2023-10-16T20:11:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113064.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.113064.log.gz 2023-10-16T20:11:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110637.log 2023-10-16T20:11:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120523.log 2023-10-16T20:11:40.851 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110637.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110637.log.gz 2023-10-16T20:11:40.852 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120523.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120523.log.gz 2023-10-16T20:11:40.852 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122549.log 2023-10-16T20:11:40.852 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122947.log 2023-10-16T20:11:40.853 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110049.log 2023-10-16T20:11:40.853 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122947.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122549.log.gz 2023-10-16T20:11:40.853 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110049.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122947.log.gz 2023-10-16T20:11:40.853 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110049.log.gz 2023-10-16T20:11:40.854 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118140.log 2023-10-16T20:11:40.854 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117461.log 2023-10-16T20:11:40.854 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119839.log 2023-10-16T20:11:40.854 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117461.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118140.log.gz 2023-10-16T20:11:40.855 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110833.log 2023-10-16T20:11:40.855 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.119839.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117461.log.gz 2023-10-16T20:11:40.855 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110833.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119839.log.gz 2023-10-16T20:11:40.856 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110833.log.gz 2023-10-16T20:11:40.856 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120617.log 2023-10-16T20:11:40.856 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121097.log 2023-10-16T20:11:40.856 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120617.log.gz 2023-10-16T20:11:40.857 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121097.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121097.log.gz 2023-10-16T20:11:40.857 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121051.log 2023-10-16T20:11:40.857 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120201.log 2023-10-16T20:11:40.857 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120673.log 2023-10-16T20:11:40.858 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120201.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121051.log.gz 2023-10-16T20:11:40.858 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120673.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120201.log.gz 2023-10-16T20:11:40.858 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.120673.log.gz 2023-10-16T20:11:40.859 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113639.log 2023-10-16T20:11:40.859 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-16T20:11:40.859 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113639.log: /var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113639.log.gz 2023-10-16T20:11:40.859 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118458.log 2023-10-16T20:11:40.860 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118607.log 2023-10-16T20:11:40.860 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118458.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118458.log.gz 2023-10-16T20:11:40.860 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117645.log 2023-10-16T20:11:40.860 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118607.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118607.log.gz 2023-10-16T20:11:40.861 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117645.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117645.log.gz 2023-10-16T20:11:40.861 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112507.log 2023-10-16T20:11:40.861 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115017.log 2023-10-16T20:11:40.861 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112507.log: /var/log/ceph/ceph-client.admin.115017.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112507.log.gz 2023-10-16T20:11:40.863 INFO:teuthology.orchestra.run.smithi163.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-16T20:11:40.863 INFO:teuthology.orchestra.run.smithi163.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-16T20:11:40.866 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113636.log 2023-10-16T20:11:40.867 INFO:teuthology.orchestra.run.smithi152.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.115017.log.gz 2023-10-16T20:11:40.867 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113636.log.gz 2023-10-16T20:11:40.867 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116678.log 2023-10-16T20:11:40.867 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119682.log 2023-10-16T20:11:40.868 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116678.log: /var/log/ceph/ceph-client.admin.119682.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116678.log.gz 2023-10-16T20:11:40.868 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119682.log.gz 2023-10-16T20:11:40.868 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120431.log 2023-10-16T20:11:40.869 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112461.log 2023-10-16T20:11:40.869 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.120431.log: /var/log/ceph/ceph-client.admin.112461.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120431.log.gz 2023-10-16T20:11:40.869 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110428.log 2023-10-16T20:11:40.869 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112461.log.gz 2023-10-16T20:11:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118504.log 2023-10-16T20:11:40.870 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110428.log: /var/log/ceph/ceph-client.admin.118504.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110428.log.gz 2023-10-16T20:11:40.870 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118504.log.gz 2023-10-16T20:11:40.871 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110243.log 2023-10-16T20:11:40.871 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-16T20:11:40.871 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110243.log: /var/log/ceph/ceph-mgr.y.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.110243.log.gz 2023-10-16T20:11:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118002.log 2023-10-16T20:11:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118002.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118002.log.gz 2023-10-16T20:11:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117185.log 2023-10-16T20:11:40.872 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117185.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117185.log.gz 2023-10-16T20:11:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121997.log 2023-10-16T20:11:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.121997.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121997.log.gz 2023-10-16T20:11:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114352.log 2023-10-16T20:11:40.873 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114352.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114352.log.gz 2023-10-16T20:11:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122411.log 2023-10-16T20:11:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122411.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122411.log.gz 2023-10-16T20:11:40.874 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112212.log 2023-10-16T20:11:40.875 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112212.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112212.log.gz 2023-10-16T20:11:40.875 INFO:teuthology.orchestra.run.smithi152.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-16T20:11:41.059 INFO:teuthology.orchestra.run.smithi152.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-16T20:11:41.323 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-16T20:11:41.356 INFO:teuthology.orchestra.run.smithi163.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-16T20:11:41.403 INFO:teuthology.orchestra.run.smithi163.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-16T20:11:41.411 INFO:teuthology.orchestra.run.smithi163.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-16T20:11:41.426 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-16T20:11:41.472 INFO:teuthology.orchestra.run.smithi163.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-16T20:11:41.474 INFO:teuthology.orchestra.run.smithi163.stderr: 2023-10-16T20:11:41.474 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m0.788s 2023-10-16T20:11:41.475 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m2.983s 2023-10-16T20:11:41.475 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m0.134s 2023-10-16T20:11:41.488 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-16T20:11:41.507 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-16T20:11:41.509 INFO:teuthology.orchestra.run.smithi152.stderr: 2023-10-16T20:11:41.509 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m0.849s 2023-10-16T20:11:41.510 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m3.322s 2023-10-16T20:11:41.510 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m0.239s 2023-10-16T20:11:41.510 INFO:tasks.ceph:Archiving logs... 2023-10-16T20:11:41.511 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/remote/smithi152/log 2023-10-16T20:11:41.512 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T20:11:42.192 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/remote/smithi163/log 2023-10-16T20:11:42.193 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T20:11:42.639 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T20:11:42.648 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T20:11:42.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T20:11:42.652 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T20:11:42.733 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T20:11:42.742 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T20:11:42.743 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T20:11:42.746 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T20:11:42.761 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-10-16T20:11:42.764 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-10-16T20:11:42.766 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T20:11:42.766 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-10-16T20:11:42.766 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 3 +58us[ +58us] +/- 82ms 2023-10-16T20:11:42.767 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -2030us[-1995us] +/- 61ms 2023-10-16T20:11:42.767 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +3744us[+3744us] +/- 108ms 2023-10-16T20:11:42.767 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:11:42.769 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T20:11:42.769 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-10-16T20:11:42.770 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +23us[ +23us] +/- 82ms 2023-10-16T20:11:42.770 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 -2068us[-1972us] +/- 61ms 2023-10-16T20:11:42.770 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +3708us[+3708us] +/- 108ms 2023-10-16T20:11:42.771 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T20:11:42.772 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T20:11:42.782 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T20:11:42.782 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T20:11:42.833 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T20:11:42.933 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T20:11:43.035 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T20:11:43.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:11:43.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T20:11:43.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:11:43.104 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T20:11:43.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T20:11:43.175 INFO:teuthology.task.internal:Duration was 1059.091402 seconds 2023-10-16T20:11:43.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T20:11:43.225 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T20:11:43.225 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T20:11:43.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T20:11:43.273 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T20:11:43.277 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T20:11:43.693 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T20:11:43.693 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2023-10-16T20:11:43.693 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T20:11:43.716 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2023-10-16T20:11:43.717 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T20:11:43.739 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T20:11:43.740 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T20:11:43.759 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T20:11:43.823 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T20:11:43.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T20:11:43.843 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T20:11:43.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T20:11:43.951 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T20:11:43.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T20:11:43.977 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T20:11:44.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T20:11:44.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:11:44.020 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:11:44.043 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2023-10-16T20:11:44.070 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2023-10-16T20:11:44.084 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:11:44.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:11:44.114 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T20:11:44.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:11:44.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T20:11:44.152 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T20:11:44.153 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/remote/smithi152 2023-10-16T20:11:44.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T20:11:44.194 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097/remote/smithi163 2023-10-16T20:11:44.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T20:11:44.233 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T20:11:44.233 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T20:11:44.236 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T20:11:44.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T20:11:44.299 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T20:11:44.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T20:11:44.334 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T20:11:44.335 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T20:11:44.337 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T20:11:44.351 INFO:teuthology.orchestra.run.smithi152.stdout: 262320 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 16 20:11 /home/ubuntu/cephtest 2023-10-16T20:11:44.352 INFO:teuthology.orchestra.run.smithi152.stdout: 787650 4 d--------- 2 ubuntu ubuntu 4096 Oct 16 20:08 /home/ubuntu/cephtest/mnt.0 2023-10-16T20:11:44.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T20:11:44.353 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-16T20:11:44.354 INFO:teuthology.orchestra.run.smithi152.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-16T20:11:44.354 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T20:11:44.363 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T20:11:44.384 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T20:11:44.436 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi152 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T20:11:44.437 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T20:11:44.444 INFO:teuthology.orchestra.run.smithi163.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 20:11 /home/ubuntu/cephtest 2023-10-16T20:11:44.476 DEBUG:teuthology.nuke:shortname: smithi152 2023-10-16T20:11:44.476 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T20:11:44.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:48:15.947730', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T20:11:44.503 DEBUG:teuthology.nuke:shortname: smithi163 2023-10-16T20:11:44.504 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T20:11:44.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:48:15.945828', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T20:11:44.546 INFO:teuthology.orchestra.console.smithi152:Power off 2023-10-16T20:11:44.547 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T20:11:44.570 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-10-16T20:11:44.571 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:44.587 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-16T20:11:44.588 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T20:11:44.597 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-16T20:11:44.612 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-16T20:11:44.612 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:44.635 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-16T20:11:48.599 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:48.637 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:48.710 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-16T20:11:48.747 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-16T20:11:52.714 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:52.749 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:52.824 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-16T20:11:52.860 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-16T20:11:52.926 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-10-16T20:11:56.863 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T20:11:56.973 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-16T20:11:57.074 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-16T20:11:57.179 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} duration: 1059.0914018154144 failure_reason: 'Test failure: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fb160f1212ed4789b41ae9f8f7a91b8e status: fail success: false 2023-10-16T20:11:57.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:11:57.259 INFO:teuthology.run:FAIL